[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786375520124696-18706-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 15:25:20 dist-test-slave-2p8l krb5kdc[18718](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 15:25:20 dist-test-slave-2p8l krb5kdc[18718](info): set up 2 sockets
Aug 10 15:25:20 dist-test-slave-2p8l krb5kdc[18718](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260810 15:25:21.638779 18706 mini_kdc.cc:121] Time spent starting KDC: real 1.495s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786375520124696-18706-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786375520124696-18706-0/krb5kdc/test-user.keytab.
Aug 10 15:25:21 dist-test-slave-2p8l krb5kdc[18718](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375521, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T15:25:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T15:25:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.68.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.68.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.68.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab.
Entry for principal kudu/127.18.68.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab.
I20260810 15:25:21.768374 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786375520124696-18706-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786375520124696-18706-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786375520124696-18706-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.190:40751
--webserver_interface=127.18.68.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab
--principal=kudu/127.18.68.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:39509
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.68.190:40751
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:25:21.853338 18755 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:25:21.853574 18755 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:25:21.853600 18755 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:25:21.854965 18755 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 15:25:21.855017 18755 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:25:21.855033 18755 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:25:21.855048 18755 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 15:25:21.855062 18755 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 15:25:21.856779 18755 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:39509
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786375520124696-18706-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786375520124696-18706-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.68.190:40751
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab
--principal=kudu/127.18.68.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.190:40751
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.68.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18755
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786375520124696-18706-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:25:21.857146 18755 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:25:21.857409 18755 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:25:21.863142 18767 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:25:21.863210 18755 server_base.cc:1034] running on GCE node
W20260810 15:25:21.863277 18773 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:21.863277 18770 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:25:21.863668 18755 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:25:21.863978 18755 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:25:21.865144 18755 hybrid_clock.cc:648] HybridClock initialized: now 1786375521865128 us; error 95 us; skew 500 ppm
Aug 10 15:25:21 dist-test-slave-2p8l krb5kdc[18718](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375521, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:25:21.867762 18755 init.cc:377] Logged in from keytab as kudu/127.18.68.190@KRBTEST.COM (short username kudu)
I20260810 15:25:21.868271 18755 webserver.cc:460] Webserver started at http://127.18.68.190:38043/ using document root <none> and password file <none>
I20260810 15:25:21.868515 18755 fs_manager.cc:359] Metadata directory not provided
I20260810 15:25:21.868585 18755 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:25:21.868743 18755 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:25:21.869871 18755 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786375520124696-18706-0/minicluster-data/master-0/data/instance:
uuid: "f605677aa34440d3b0a38fbf0b6ed87d"
format_stamp: "Formatted at 2026-08-10 15:25:21 on dist-test-slave-2p8l"
server_key: "692569b1d33633ef1d6cd6f0f6774116"
server_key_iv: "6058fe9e8de99e4632e1241ca084c778"
server_key_version: "encryptionkey@0"
I20260810 15:25:21.870311 18755 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786375520124696-18706-0/minicluster-data/master-0/wal/instance:
uuid: "f605677aa34440d3b0a38fbf0b6ed87d"
format_stamp: "Formatted at 2026-08-10 15:25:21 on dist-test-slave-2p8l"
server_key: "692569b1d33633ef1d6cd6f0f6774116"
server_key_iv: "6058fe9e8de99e4632e1241ca084c778"
server_key_version: "encryptionkey@0"
I20260810 15:25:21.871766 18755 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260810 15:25:21.872625 18790 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:21.872896 18755 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 15:25:21.873050 18755 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786375520124696-18706-0/minicluster-data/master-0/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786375520124696-18706-0/minicluster-data/master-0/wal
uuid: "f605677aa34440d3b0a38fbf0b6ed87d"
format_stamp: "Formatted at 2026-08-10 15:25:21 on dist-test-slave-2p8l"
server_key: "692569b1d33633ef1d6cd6f0f6774116"
server_key_iv: "6058fe9e8de99e4632e1241ca084c778"
server_key_version: "encryptionkey@0"
I20260810 15:25:21.873133 18755 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786375520124696-18706-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786375520124696-18706-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786375520124696-18706-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:25:21.888288 18755 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:25:21.890874 18755 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:25:21.891048 18755 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:25:21.895977 18755 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.190:40751
I20260810 15:25:21.896117 18902 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.190:40751 every 8 connection(s)
I20260810 15:25:21.896445 18755 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
I20260810 15:25:21.897475 18903 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:25:21.900063 18903 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f605677aa34440d3b0a38fbf0b6ed87d: Bootstrap starting.
I20260810 15:25:21.900849 18903 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f605677aa34440d3b0a38fbf0b6ed87d: Neither blocks nor log segments found. Creating new log.
I20260810 15:25:21.901237 18903 log.cc:824] T 00000000000000000000000000000000 P f605677aa34440d3b0a38fbf0b6ed87d: Log is configured to *not* fsync() on all Append() calls
I20260810 15:25:21.902030 18903 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f605677aa34440d3b0a38fbf0b6ed87d: No bootstrap required, opened a new log
I20260810 15:25:21.903786 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 18755
I20260810 15:25:21.903899 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786375520124696-18706-0/minicluster-data/master-0/wal/instance
I20260810 15:25:21.904044 18903 raft_consensus.cc:348] T 00000000000000000000000000000000 P f605677aa34440d3b0a38fbf0b6ed87d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f605677aa34440d3b0a38fbf0b6ed87d" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 40751 } }
I20260810 15:25:21.904219 18903 raft_consensus.cc:374] T 00000000000000000000000000000000 P f605677aa34440d3b0a38fbf0b6ed87d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:25:21.904253 18903 raft_consensus.cc:729] T 00000000000000000000000000000000 P f605677aa34440d3b0a38fbf0b6ed87d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f605677aa34440d3b0a38fbf0b6ed87d, State: Initialized, Role: FOLLOWER
I20260810 15:25:21.904389 18903 consensus_queue.cc:260] T 00000000000000000000000000000000 P f605677aa34440d3b0a38fbf0b6ed87d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f605677aa34440d3b0a38fbf0b6ed87d" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 40751 } }
I20260810 15:25:21.904467 18903 raft_consensus.cc:388] T 00000000000000000000000000000000 P f605677aa34440d3b0a38fbf0b6ed87d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 15:25:21.904511 18903 raft_consensus.cc:482] T 00000000000000000000000000000000 P f605677aa34440d3b0a38fbf0b6ed87d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 15:25:21.904572 18903 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f605677aa34440d3b0a38fbf0b6ed87d [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:25:21.904721 18706 external_mini_cluster.cc:1428] Setting key 430f439bf91c19c53746fcdadc5d6b3c
I20260810 15:25:21.905306 18903 raft_consensus.cc:504] T 00000000000000000000000000000000 P f605677aa34440d3b0a38fbf0b6ed87d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f605677aa34440d3b0a38fbf0b6ed87d" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 40751 } }
I20260810 15:25:21.905443 18903 leader_election.cc:302] T 00000000000000000000000000000000 P f605677aa34440d3b0a38fbf0b6ed87d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f605677aa34440d3b0a38fbf0b6ed87d; no voters:
I20260810 15:25:21.905659 18903 leader_election.cc:288] T 00000000000000000000000000000000 P f605677aa34440d3b0a38fbf0b6ed87d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 15:25:21.905678 18910 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f605677aa34440d3b0a38fbf0b6ed87d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 15:25:21.905807 18910 raft_consensus.cc:686] T 00000000000000000000000000000000 P f605677aa34440d3b0a38fbf0b6ed87d [term 1 LEADER]: Becoming Leader. State: Replica: f605677aa34440d3b0a38fbf0b6ed87d, State: Running, Role: LEADER
I20260810 15:25:21.905893 18910 consensus_queue.cc:237] T 00000000000000000000000000000000 P f605677aa34440d3b0a38fbf0b6ed87d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f605677aa34440d3b0a38fbf0b6ed87d" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 40751 } }
I20260810 15:25:21.905970 18903 sys_catalog.cc:564] T 00000000000000000000000000000000 P f605677aa34440d3b0a38fbf0b6ed87d [sys.catalog]: configured and running, proceeding with master startup.
I20260810 15:25:21.906284 18914 sys_catalog.cc:455] T 00000000000000000000000000000000 P f605677aa34440d3b0a38fbf0b6ed87d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f605677aa34440d3b0a38fbf0b6ed87d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f605677aa34440d3b0a38fbf0b6ed87d" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 40751 } } }
I20260810 15:25:21.906545 18914 sys_catalog.cc:458] T 00000000000000000000000000000000 P f605677aa34440d3b0a38fbf0b6ed87d [sys.catalog]: This master's current role is: LEADER
I20260810 15:25:21.906472 18912 sys_catalog.cc:455] T 00000000000000000000000000000000 P f605677aa34440d3b0a38fbf0b6ed87d [sys.catalog]: SysCatalogTable state changed. Reason: New leader f605677aa34440d3b0a38fbf0b6ed87d. Latest consensus state: current_term: 1 leader_uuid: "f605677aa34440d3b0a38fbf0b6ed87d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f605677aa34440d3b0a38fbf0b6ed87d" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 40751 } } }
I20260810 15:25:21.906838 18912 sys_catalog.cc:458] T 00000000000000000000000000000000 P f605677aa34440d3b0a38fbf0b6ed87d [sys.catalog]: This master's current role is: LEADER
I20260810 15:25:21.907039 18918 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 15:25:21.907661 18918 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 15:25:21.909210 18918 catalog_manager.cc:1347] Generated new cluster ID: 008a229a18b64e74b9c7901f8e588aa9
I20260810 15:25:21.909420 18918 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 15:25:21.918917 18918 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 15:25:21.919471 18918 catalog_manager.cc:1504] Loading token signing keys...
Aug 10 15:25:21 dist-test-slave-2p8l krb5kdc[18718](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375521, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
I20260810 15:25:21.925987 18918 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f605677aa34440d3b0a38fbf0b6ed87d: Generated new TSK 0
I20260810 15:25:21.926146 18917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:21.906411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36524 (local address 127.18.68.190:40751)
0810 15:25:21.906592 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:21.906601 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:21.907216 (+ 615us) server_negotiation.cc:407] Connection header received
0810 15:25:21.909989 (+ 2773us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:21.909996 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:21.910086 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:21.910252 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:21.912553 (+ 2301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:21.914104 (+ 1551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:21.915808 (+ 1704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:21.916448 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:21.916553 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:21.921538 (+ 4985us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:21.921543 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:21.921543 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:21.921556 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:21.923869 (+ 2313us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:21.924393 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:21.924396 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:21.924397 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:21.924529 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:21.924843 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:21.924844 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:21.924845 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:21.925158 (+ 313us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:21.925311 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:21.925647 (+ 336us) server_negotiation.cc:299] Negotiation successful
0810 15:25:21.925814 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":80,"threads_started":1}
I20260810 15:25:21.926194 18918 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.18.68.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.68.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.68.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.129.keytab.
Entry for principal kudu/127.18.68.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.129.keytab.
I20260810 15:25:21.960835 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786375520124696-18706-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786375520124696-18706-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786375520124696-18706-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786375520124696-18706-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.68.129:0
--local_ip_for_outbound_sockets=127.18.68.129
--webserver_interface=127.18.68.129
--webserver_port=0
--tserver_master_addrs=127.18.68.190:40751
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.129.keytab
--principal=kudu/127.18.68.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:39509
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:25:22.058856 18943 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:25:22.059121 18943 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:25:22.059165 18943 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:25:22.060365 18943 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:25:22.060438 18943 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:25:22.060488 18943 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.68.129
I20260810 15:25:22.062049 18943 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:39509
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786375520124696-18706-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786375520124696-18706-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.129.keytab
--principal=kudu/127.18.68.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.68.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786375520124696-18706-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.68.129
--webserver_port=0
--tserver_master_addrs=127.18.68.190:40751
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18943
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.68.129
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786375520124696-18706-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:25:22.062388 18943 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:25:22.062639 18943 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:25:22.068710 18954 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:22.068722 18955 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:22.068722 18957 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:25:22.069231 18943 server_base.cc:1034] running on GCE node
I20260810 15:25:22.069427 18943 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:25:22.069697 18943 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:25:22.070870 18943 hybrid_clock.cc:648] HybridClock initialized: now 1786375522070850 us; error 27 us; skew 500 ppm
Aug 10 15:25:22 dist-test-slave-2p8l krb5kdc[18718](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375522, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:25:22.073436 18943 init.cc:377] Logged in from keytab as kudu/127.18.68.129@KRBTEST.COM (short username kudu)
I20260810 15:25:22.073962 18943 webserver.cc:460] Webserver started at http://127.18.68.129:36347/ using document root <none> and password file <none>
I20260810 15:25:22.074232 18943 fs_manager.cc:359] Metadata directory not provided
I20260810 15:25:22.074306 18943 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:25:22.074460 18943 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:25:22.075553 18943 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786375520124696-18706-0/minicluster-data/ts-0/data/instance:
uuid: "3dfa0c1d61064f6d8696c6ec608769d6"
format_stamp: "Formatted at 2026-08-10 15:25:22 on dist-test-slave-2p8l"
server_key: "b4a4c9c9c54a3fbd8057c36cdaa71c7a"
server_key_iv: "8425166cfc7a6cd0817ee8a2a9e5183b"
server_key_version: "encryptionkey@0"
I20260810 15:25:22.075991 18943 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786375520124696-18706-0/minicluster-data/ts-0/wal/instance:
uuid: "3dfa0c1d61064f6d8696c6ec608769d6"
format_stamp: "Formatted at 2026-08-10 15:25:22 on dist-test-slave-2p8l"
server_key: "b4a4c9c9c54a3fbd8057c36cdaa71c7a"
server_key_iv: "8425166cfc7a6cd0817ee8a2a9e5183b"
server_key_version: "encryptionkey@0"
I20260810 15:25:22.077492 18943 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 15:25:22.078337 18971 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:22.078627 18943 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:25:22.078758 18943 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786375520124696-18706-0/minicluster-data/ts-0/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786375520124696-18706-0/minicluster-data/ts-0/wal
uuid: "3dfa0c1d61064f6d8696c6ec608769d6"
format_stamp: "Formatted at 2026-08-10 15:25:22 on dist-test-slave-2p8l"
server_key: "b4a4c9c9c54a3fbd8057c36cdaa71c7a"
server_key_iv: "8425166cfc7a6cd0817ee8a2a9e5183b"
server_key_version: "encryptionkey@0"
I20260810 15:25:22.078832 18943 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786375520124696-18706-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786375520124696-18706-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786375520124696-18706-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:25:22.096971 18943 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:25:22.099457 18943 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:25:22.099620 18943 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:25:22.099872 18943 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 15:25:22.100201 18943 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 15:25:22.100257 18943 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:22.100299 18943 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 15:25:22.100327 18943 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:22.107280 18943 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.129:41877
I20260810 15:25:22.107326 19159 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.129:41877 every 8 connection(s)
I20260810 15:25:22.107700 18943 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786375520124696-18706-0/minicluster-data/ts-0/data/info.pb
I20260810 15:25:22.107981 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 18943
I20260810 15:25:22.108083 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786375520124696-18706-0/minicluster-data/ts-0/wal/instance
I20260810 15:25:22.108268 18706 external_mini_cluster.cc:1428] Setting key 9e8ee3e3ef601597aa7de946f08d3650
Aug 10 15:25:22 dist-test-slave-2p8l krb5kdc[18718](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375522, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.129@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
I20260810 15:25:22.119221 19164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:22.108448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:40751 (local address 127.18.68.129:32913)
0810 15:25:22.108685 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:22.108735 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:22.109460 (+ 725us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:22.109766 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:22.109770 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:22.110665 (+ 895us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:25:22.110981 (+ 316us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:22.110990 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:22.112074 (+ 1084us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:22.112075 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:22.112888 (+ 813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:22.112891 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:22.113328 (+ 437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:22.113329 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:22.113478 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:22.114000 (+ 522us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:25:22.114010 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:25:22.115732 (+ 1722us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:25:22.117822 (+ 2090us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:22.117829 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:22.117831 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:22.118055 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:22.118335 (+ 280us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:22.118335 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:22.118336 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:22.118438 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:22.118741 (+ 303us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:25:22.118745 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:25:22.118857 (+ 112us) client_negotiation.cc:769] Sending connection context
0810 15:25:22.118934 (+ 77us) client_negotiation.cc:240] Negotiation successful
0810 15:25:22.119054 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":97,"threads_started":1}
I20260810 15:25:22.119234 18917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:22.108451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.129:32913 (local address 127.18.68.190:40751)
0810 15:25:22.108500 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:22.108502 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:22.108822 (+ 320us) server_negotiation.cc:407] Connection header received
0810 15:25:22.109606 (+ 784us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:22.109607 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:22.109619 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:22.109680 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:22.111114 (+ 1434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:22.111961 (+ 847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:22.112977 (+ 1016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:22.113227 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:22.113290 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:22.115827 (+ 2537us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:22.115829 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:22.115829 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:22.115838 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:22.117715 (+ 1877us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:22.118184 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:22.118186 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:22.118186 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:22.118252 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:22.118514 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:22.118516 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:22.118516 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:22.118670 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:22.118748 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:22.119009 (+ 261us) server_negotiation.cc:299] Negotiation successful
0810 15:25:22.119116 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
WARNING: no policy specified for kudu/127.18.68.130@KRBTEST.COM; defaulting to no policy
I20260810 15:25:22.119899 19162 heartbeater.cc:347] Connected to a master server at 127.18.68.190:40751
I20260810 15:25:22.119995 19162 heartbeater.cc:464] Registering TS with master...
I20260810 15:25:22.120146 19162 heartbeater.cc:511] Master 127.18.68.190:40751 requested a full tablet report, sending...
I20260810 15:25:22.120697 18834 ts_manager.cc:194] Registered new tserver with Master: 3dfa0c1d61064f6d8696c6ec608769d6 (127.18.68.129:41877)
I20260810 15:25:22.121285 18834 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.68.129@KRBTEST.COM'} at 127.18.68.129:32913
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.68.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.68.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.130.keytab.
Entry for principal kudu/127.18.68.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.130.keytab.
I20260810 15:25:22.136703 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786375520124696-18706-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786375520124696-18706-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786375520124696-18706-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786375520124696-18706-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.68.130:0
--local_ip_for_outbound_sockets=127.18.68.130
--webserver_interface=127.18.68.130
--webserver_port=0
--tserver_master_addrs=127.18.68.190:40751
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.130.keytab
--principal=kudu/127.18.68.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:39509
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:25:22.222182 19168 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:25:22.222368 19168 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:25:22.222390 19168 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:25:22.223510 19168 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:25:22.223552 19168 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:25:22.223579 19168 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.68.130
I20260810 15:25:22.225016 19168 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:39509
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786375520124696-18706-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786375520124696-18706-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.130.keytab
--principal=kudu/127.18.68.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.68.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786375520124696-18706-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.68.130
--webserver_port=0
--tserver_master_addrs=127.18.68.190:40751
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19168
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.68.130
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786375520124696-18706-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:25:22.225247 19168 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:25:22.225476 19168 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:25:22.230880 19175 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:25:22.230921 19168 server_base.cc:1034] running on GCE node
W20260810 15:25:22.230894 19183 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:22.230927 19174 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:25:22.231267 19168 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:25:22.231537 19168 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:25:22.232713 19168 hybrid_clock.cc:648] HybridClock initialized: now 1786375522232714 us; error 50 us; skew 500 ppm
Aug 10 15:25:22 dist-test-slave-2p8l krb5kdc[18718](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375522, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:25:22.235384 19168 init.cc:377] Logged in from keytab as kudu/127.18.68.130@KRBTEST.COM (short username kudu)
I20260810 15:25:22.235841 19168 webserver.cc:460] Webserver started at http://127.18.68.130:37461/ using document root <none> and password file <none>
I20260810 15:25:22.236071 19168 fs_manager.cc:359] Metadata directory not provided
I20260810 15:25:22.236140 19168 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:25:22.236303 19168 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:25:22.237366 19168 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786375520124696-18706-0/minicluster-data/ts-1/data/instance:
uuid: "91f8b946c6ef4af79a900a44d058eb92"
format_stamp: "Formatted at 2026-08-10 15:25:22 on dist-test-slave-2p8l"
server_key: "0892b9b778b07a588055db2d56ab3c86"
server_key_iv: "edca7c0d4ec8084cefb9bd1347ad477e"
server_key_version: "encryptionkey@0"
I20260810 15:25:22.237744 19168 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786375520124696-18706-0/minicluster-data/ts-1/wal/instance:
uuid: "91f8b946c6ef4af79a900a44d058eb92"
format_stamp: "Formatted at 2026-08-10 15:25:22 on dist-test-slave-2p8l"
server_key: "0892b9b778b07a588055db2d56ab3c86"
server_key_iv: "edca7c0d4ec8084cefb9bd1347ad477e"
server_key_version: "encryptionkey@0"
I20260810 15:25:22.239288 19168 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 15:25:22.240077 19196 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:22.240269 19168 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:25:22.240374 19168 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786375520124696-18706-0/minicluster-data/ts-1/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786375520124696-18706-0/minicluster-data/ts-1/wal
uuid: "91f8b946c6ef4af79a900a44d058eb92"
format_stamp: "Formatted at 2026-08-10 15:25:22 on dist-test-slave-2p8l"
server_key: "0892b9b778b07a588055db2d56ab3c86"
server_key_iv: "edca7c0d4ec8084cefb9bd1347ad477e"
server_key_version: "encryptionkey@0"
I20260810 15:25:22.240458 19168 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786375520124696-18706-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786375520124696-18706-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786375520124696-18706-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:25:22.252276 19168 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:25:22.254112 19168 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:25:22.254288 19168 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:25:22.254526 19168 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 15:25:22.254858 19168 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 15:25:22.254918 19168 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:22.254959 19168 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 15:25:22.254987 19168 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:22.262107 19168 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.130:44557
I20260810 15:25:22.262168 19406 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.130:44557 every 8 connection(s)
I20260810 15:25:22.262517 19168 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786375520124696-18706-0/minicluster-data/ts-1/data/info.pb
Aug 10 15:25:22 dist-test-slave-2p8l krb5kdc[18718](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375522, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.130@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
I20260810 15:25:22.272213 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 19168
I20260810 15:25:22.272305 18917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:22.263476 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.130:33977 (local address 127.18.68.190:40751)
0810 15:25:22.263549 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:22.263551 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:22.263770 (+ 219us) server_negotiation.cc:407] Connection header received
0810 15:25:22.264270 (+ 500us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:22.264272 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:22.264286 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:22.264367 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:22.265304 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:22.265805 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:22.266845 (+ 1040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:22.267038 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:22.267120 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:22.269297 (+ 2177us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:22.269299 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:22.269299 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:22.269305 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:22.270865 (+ 1560us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:22.271228 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:22.271229 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:22.271229 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:22.271331 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:22.271631 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:22.271632 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:22.271632 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:22.271752 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:22.271816 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:22.272092 (+ 276us) server_negotiation.cc:299] Negotiation successful
0810 15:25:22.272190 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260810 15:25:22.272316 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786375520124696-18706-0/minicluster-data/ts-1/wal/instance
I20260810 15:25:22.272380 19412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:22.263450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:40751 (local address 127.18.68.130:33977)
0810 15:25:22.263639 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:22.263675 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:22.264150 (+ 475us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:22.264419 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:22.264422 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:22.265006 (+ 584us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:25:22.265206 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:22.265210 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:22.265888 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:22.265889 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:22.266767 (+ 878us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:22.266769 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:22.267138 (+ 369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:22.267138 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:22.267246 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:22.267769 (+ 523us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:25:22.267777 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:25:22.269202 (+ 1425us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:25:22.270944 (+ 1742us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:22.270950 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:22.270952 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:22.271164 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:22.271420 (+ 256us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:22.271422 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:22.271422 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:22.271539 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:22.271822 (+ 283us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:25:22.271827 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:25:22.271938 (+ 111us) client_negotiation.cc:769] Sending connection context
0810 15:25:22.272040 (+ 102us) client_negotiation.cc:240] Negotiation successful
0810 15:25:22.272164 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":120,"threads_started":1}
I20260810 15:25:22.272500 18706 external_mini_cluster.cc:1428] Setting key 22b8939d529a5072aa7ff1077c8116ac
I20260810 15:25:22.272910 19407 heartbeater.cc:347] Connected to a master server at 127.18.68.190:40751
I20260810 15:25:22.273015 19407 heartbeater.cc:464] Registering TS with master...
I20260810 15:25:22.273252 19407 heartbeater.cc:511] Master 127.18.68.190:40751 requested a full tablet report, sending...
I20260810 15:25:22.273667 18834 ts_manager.cc:194] Registered new tserver with Master: 91f8b946c6ef4af79a900a44d058eb92 (127.18.68.130:44557)
I20260810 15:25:22.274052 18834 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.68.130@KRBTEST.COM'} at 127.18.68.130:33977
WARNING: no policy specified for kudu/127.18.68.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.68.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.68.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.131.keytab.
Entry for principal kudu/127.18.68.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.131.keytab.
I20260810 15:25:22.300807 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786375520124696-18706-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786375520124696-18706-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786375520124696-18706-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786375520124696-18706-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.68.131:0
--local_ip_for_outbound_sockets=127.18.68.131
--webserver_interface=127.18.68.131
--webserver_port=0
--tserver_master_addrs=127.18.68.190:40751
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.131.keytab
--principal=kudu/127.18.68.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:39509
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:25:22.386574 19417 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:25:22.386778 19417 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:25:22.386803 19417 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:25:22.387934 19417 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:25:22.387977 19417 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:25:22.388036 19417 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.68.131
I20260810 15:25:22.389542 19417 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:39509
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786375520124696-18706-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786375520124696-18706-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.131.keytab
--principal=kudu/127.18.68.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.68.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786375520124696-18706-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.68.131
--webserver_port=0
--tserver_master_addrs=127.18.68.190:40751
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19417
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.68.131
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786375520124696-18706-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:25:22.389786 19417 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:25:22.390020 19417 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:25:22.395021 19430 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:25:22.395124 19417 server_base.cc:1034] running on GCE node
W20260810 15:25:22.395031 19428 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:22.395037 19427 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:25:22.395455 19417 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:25:22.395707 19417 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:25:22.396869 19417 hybrid_clock.cc:648] HybridClock initialized: now 1786375522396872 us; error 40 us; skew 500 ppm
Aug 10 15:25:22 dist-test-slave-2p8l krb5kdc[18718](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375522, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:25:22.399399 19417 init.cc:377] Logged in from keytab as kudu/127.18.68.131@KRBTEST.COM (short username kudu)
I20260810 15:25:22.399766 19417 webserver.cc:460] Webserver started at http://127.18.68.131:42437/ using document root <none> and password file <none>
I20260810 15:25:22.399977 19417 fs_manager.cc:359] Metadata directory not provided
I20260810 15:25:22.400017 19417 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:25:22.400103 19417 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:25:22.401023 19417 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786375520124696-18706-0/minicluster-data/ts-2/data/instance:
uuid: "5839cebefda7436987331e1ad3904dca"
format_stamp: "Formatted at 2026-08-10 15:25:22 on dist-test-slave-2p8l"
server_key: "d35082095c1f141a19f5865109298a64"
server_key_iv: "d586b6c1a916caa21a1e075aad38acc8"
server_key_version: "encryptionkey@0"
I20260810 15:25:22.401319 19417 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786375520124696-18706-0/minicluster-data/ts-2/wal/instance:
uuid: "5839cebefda7436987331e1ad3904dca"
format_stamp: "Formatted at 2026-08-10 15:25:22 on dist-test-slave-2p8l"
server_key: "d35082095c1f141a19f5865109298a64"
server_key_iv: "d586b6c1a916caa21a1e075aad38acc8"
server_key_version: "encryptionkey@0"
I20260810 15:25:22.402742 19417 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 15:25:22.403450 19446 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:22.403622 19417 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 15:25:22.403702 19417 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786375520124696-18706-0/minicluster-data/ts-2/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786375520124696-18706-0/minicluster-data/ts-2/wal
uuid: "5839cebefda7436987331e1ad3904dca"
format_stamp: "Formatted at 2026-08-10 15:25:22 on dist-test-slave-2p8l"
server_key: "d35082095c1f141a19f5865109298a64"
server_key_iv: "d586b6c1a916caa21a1e075aad38acc8"
server_key_version: "encryptionkey@0"
I20260810 15:25:22.403750 19417 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786375520124696-18706-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786375520124696-18706-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786375520124696-18706-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:25:22.425303 19417 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:25:22.427814 19417 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:25:22.427929 19417 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:25:22.428124 19417 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 15:25:22.428435 19417 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 15:25:22.428471 19417 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:22.428494 19417 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 15:25:22.428546 19417 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:22.435755 19417 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.131:42399
I20260810 15:25:22.435882 19646 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.131:42399 every 8 connection(s)
I20260810 15:25:22.436187 19417 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786375520124696-18706-0/minicluster-data/ts-2/data/info.pb
I20260810 15:25:22.436674 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 19417
I20260810 15:25:22.436774 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786375520124696-18706-0/minicluster-data/ts-2/wal/instance
I20260810 15:25:22.436928 18706 external_mini_cluster.cc:1428] Setting key f97aa82376353e3033dfac7b2303a04e
Aug 10 15:25:22 dist-test-slave-2p8l krb5kdc[18718](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375522, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.131@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
I20260810 15:25:22.445819 18917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:22.437082 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.131:52361 (local address 127.18.68.190:40751)
0810 15:25:22.437133 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:22.437136 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:22.437530 (+ 394us) server_negotiation.cc:407] Connection header received
0810 15:25:22.438086 (+ 556us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:22.438088 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:22.438101 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:22.438162 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:22.439117 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:22.439625 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:22.440622 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:22.440832 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:22.440918 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:22.442990 (+ 2072us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:22.442991 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:22.442992 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:22.443000 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:22.444387 (+ 1387us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:22.444817 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:22.444819 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:22.444819 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:22.444877 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:22.445178 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:22.445179 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:22.445180 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:22.445298 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:22.445377 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:22.445648 (+ 271us) server_negotiation.cc:299] Negotiation successful
0810 15:25:22.445730 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260810 15:25:22.446010 19650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:22.437089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:40751 (local address 127.18.68.131:52361)
0810 15:25:22.437404 (+ 315us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:22.437449 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:22.437956 (+ 507us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:22.438233 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:22.438237 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:22.438825 (+ 588us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:25:22.439008 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:22.439014 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:22.439727 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:22.439728 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:22.440515 (+ 787us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:22.440518 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:22.440927 (+ 409us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:22.440928 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:22.441055 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:22.441561 (+ 506us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:25:22.441569 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:25:22.442896 (+ 1327us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:25:22.444480 (+ 1584us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:22.444488 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:22.444490 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:22.444736 (+ 246us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:22.444955 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:22.444956 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:22.444956 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:22.445105 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:22.445367 (+ 262us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:25:22.445374 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:25:22.445508 (+ 134us) client_negotiation.cc:769] Sending connection context
0810 15:25:22.445615 (+ 107us) client_negotiation.cc:240] Negotiation successful
0810 15:25:22.445770 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":275,"thread_start_us":149,"threads_started":1}
I20260810 15:25:22.446573 19647 heartbeater.cc:347] Connected to a master server at 127.18.68.190:40751
I20260810 15:25:22.446694 19647 heartbeater.cc:464] Registering TS with master...
I20260810 15:25:22.446875 19647 heartbeater.cc:511] Master 127.18.68.190:40751 requested a full tablet report, sending...
I20260810 15:25:22.447268 18834 ts_manager.cc:194] Registered new tserver with Master: 5839cebefda7436987331e1ad3904dca (127.18.68.131:42399)
I20260810 15:25:22.447683 18834 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.68.131@KRBTEST.COM'} at 127.18.68.131:52361
I20260810 15:25:22.449002 18706 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 10 15:25:22 dist-test-slave-2p8l krb5kdc[18718](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375522, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 10 15:25:22 dist-test-slave-2p8l krb5kdc[18718](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375522, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.18.68.129@KRBTEST.COM
I20260810 15:25:22.473551 19658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:22.465833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41226 (local address 127.18.68.129:41877)
0810 15:25:22.466041 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:22.466045 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:22.466095 (+ 50us) server_negotiation.cc:407] Connection header received
0810 15:25:22.466131 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:22.466133 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:22.466147 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:22.466276 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:22.466866 (+ 590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:22.467620 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:22.468355 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:22.468663 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:22.468718 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:22.471037 (+ 2319us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:22.471044 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:22.471044 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:22.471051 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:22.472473 (+ 1422us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:22.472797 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:22.472799 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:22.472800 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:22.472856 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:22.473046 (+ 190us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:22.473047 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:22.473047 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:22.473175 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:22.473278 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:22.473354 (+ 76us) server_negotiation.cc:299] Negotiation successful
0810 15:25:22.473418 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":175,"thread_start_us":103,"threads_started":1}
W20260810 15:25:22.473973 19020 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41226
Aug 10 15:25:22 dist-test-slave-2p8l krb5kdc[18718](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375522, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 10 15:25:22 dist-test-slave-2p8l krb5kdc[18718](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375522, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.68.129@KRBTEST.COM
I20260810 15:25:22.497656 19658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:22.490555 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41242 (local address 127.18.68.129:41877)
0810 15:25:22.490657 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:22.490659 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:22.490669 (+ 10us) server_negotiation.cc:407] Connection header received
0810 15:25:22.490736 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:22.490737 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:22.490749 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:22.490802 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:22.491350 (+ 548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:22.491846 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:22.492573 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:22.492790 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:22.492843 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:22.495097 (+ 2254us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:22.495098 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:22.495098 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:22.495105 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:22.496629 (+ 1524us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:22.496940 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:22.496940 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:22.496941 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:22.496990 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:22.497214 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:22.497215 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:22.497215 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:22.497303 (+ 88us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:22.497393 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:22.497473 (+ 80us) server_negotiation.cc:299] Negotiation successful
0810 15:25:22.497533 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260810 15:25:22.498377 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 18943
I20260810 15:25:22.517715 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 19168
I20260810 15:25:22.532960 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 19417
I20260810 15:25:22.543300 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 18755
2026-08-10T15:25:22Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (2432 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786375520124696-18706-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 15:25:22 dist-test-slave-2p8l krb5kdc[19669](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 15:25:22 dist-test-slave-2p8l krb5kdc[19669](info): set up 2 sockets
Aug 10 15:25:22 dist-test-slave-2p8l krb5kdc[19669](info): commencing operation
krb5kdc: starting...
W20260810 15:25:23.839495 18706 mini_kdc.cc:121] Time spent starting KDC: real 1.268s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786375520124696-18706-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786375520124696-18706-0/krb5kdc/test-user.keytab.
Aug 10 15:25:23 dist-test-slave-2p8l krb5kdc[19669](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375523, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T15:25:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T15:25:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.68.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.68.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.68.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab.
Entry for principal kudu/127.18.68.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab.
I20260810 15:25:23.964346 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786375520124696-18706-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786375520124696-18706-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786375520124696-18706-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.190:34211
--webserver_interface=127.18.68.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab
--principal=kudu/127.18.68.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:35871
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.68.190:34211
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:25:24.046396 19690 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:25:24.046589 19690 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:25:24.046612 19690 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:25:24.047830 19690 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 15:25:24.047874 19690 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:25:24.047889 19690 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:25:24.047901 19690 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 15:25:24.047950 19690 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 15:25:24.049389 19690 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:35871
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786375520124696-18706-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786375520124696-18706-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.68.190:34211
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab
--principal=kudu/127.18.68.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.190:34211
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.68.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19690
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786375520124696-18706-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:25:24.049643 19690 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:25:24.049886 19690 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:25:24.056212 19702 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:24.056286 19700 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:24.056181 19707 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:25:24.056725 19690 server_base.cc:1034] running on GCE node
I20260810 15:25:24.056960 19690 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:25:24.057281 19690 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:25:24.058463 19690 hybrid_clock.cc:648] HybridClock initialized: now 1786375524058448 us; error 29 us; skew 500 ppm
Aug 10 15:25:24 dist-test-slave-2p8l krb5kdc[19669](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375524, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:25:24.061061 19690 init.cc:377] Logged in from keytab as kudu/127.18.68.190@KRBTEST.COM (short username kudu)
I20260810 15:25:24.061460 19690 webserver.cc:460] Webserver started at http://127.18.68.190:39429/ using document root <none> and password file <none>
I20260810 15:25:24.061671 19690 fs_manager.cc:359] Metadata directory not provided
I20260810 15:25:24.061713 19690 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:25:24.061800 19690 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:25:24.062862 19690 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786375520124696-18706-0/minicluster-data/master-0/data/instance:
uuid: "bf42e63771cf4aa3bb1b7188335c4a9c"
format_stamp: "Formatted at 2026-08-10 15:25:24 on dist-test-slave-2p8l"
server_key: "2a685a7356df907d82035f3d6c5464e2"
server_key_iv: "a640323be54a862fb62926ce8f8cbd37"
server_key_version: "encryptionkey@0"
I20260810 15:25:24.063163 19690 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786375520124696-18706-0/minicluster-data/master-0/wal/instance:
uuid: "bf42e63771cf4aa3bb1b7188335c4a9c"
format_stamp: "Formatted at 2026-08-10 15:25:24 on dist-test-slave-2p8l"
server_key: "2a685a7356df907d82035f3d6c5464e2"
server_key_iv: "a640323be54a862fb62926ce8f8cbd37"
server_key_version: "encryptionkey@0"
I20260810 15:25:24.064426 19690 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 15:25:24.065182 19717 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:24.065383 19690 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:25:24.065462 19690 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786375520124696-18706-0/minicluster-data/master-0/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786375520124696-18706-0/minicluster-data/master-0/wal
uuid: "bf42e63771cf4aa3bb1b7188335c4a9c"
format_stamp: "Formatted at 2026-08-10 15:25:24 on dist-test-slave-2p8l"
server_key: "2a685a7356df907d82035f3d6c5464e2"
server_key_iv: "a640323be54a862fb62926ce8f8cbd37"
server_key_version: "encryptionkey@0"
I20260810 15:25:24.065517 19690 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786375520124696-18706-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786375520124696-18706-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786375520124696-18706-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:25:24.076540 19690 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:25:24.078601 19690 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:25:24.078717 19690 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:25:24.083299 19690 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.190:34211
I20260810 15:25:24.083362 19813 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.190:34211 every 8 connection(s)
I20260810 15:25:24.083719 19690 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
I20260810 15:25:24.084651 19815 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:25:24.087131 19815 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bf42e63771cf4aa3bb1b7188335c4a9c: Bootstrap starting.
I20260810 15:25:24.087831 19815 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bf42e63771cf4aa3bb1b7188335c4a9c: Neither blocks nor log segments found. Creating new log.
I20260810 15:25:24.088132 19815 log.cc:824] T 00000000000000000000000000000000 P bf42e63771cf4aa3bb1b7188335c4a9c: Log is configured to *not* fsync() on all Append() calls
I20260810 15:25:24.088869 19815 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bf42e63771cf4aa3bb1b7188335c4a9c: No bootstrap required, opened a new log
I20260810 15:25:24.089649 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 19690
I20260810 15:25:24.089720 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786375520124696-18706-0/minicluster-data/master-0/wal/instance
I20260810 15:25:24.089875 18706 external_mini_cluster.cc:1428] Setting key 004270597cf5ba57a8297517467e4ec8
I20260810 15:25:24.090968 19815 raft_consensus.cc:348] T 00000000000000000000000000000000 P bf42e63771cf4aa3bb1b7188335c4a9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf42e63771cf4aa3bb1b7188335c4a9c" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 34211 } }
I20260810 15:25:24.091128 19815 raft_consensus.cc:374] T 00000000000000000000000000000000 P bf42e63771cf4aa3bb1b7188335c4a9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:25:24.091177 19815 raft_consensus.cc:729] T 00000000000000000000000000000000 P bf42e63771cf4aa3bb1b7188335c4a9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf42e63771cf4aa3bb1b7188335c4a9c, State: Initialized, Role: FOLLOWER
I20260810 15:25:24.091334 19815 consensus_queue.cc:260] T 00000000000000000000000000000000 P bf42e63771cf4aa3bb1b7188335c4a9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf42e63771cf4aa3bb1b7188335c4a9c" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 34211 } }
I20260810 15:25:24.091427 19815 raft_consensus.cc:388] T 00000000000000000000000000000000 P bf42e63771cf4aa3bb1b7188335c4a9c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 15:25:24.091475 19815 raft_consensus.cc:482] T 00000000000000000000000000000000 P bf42e63771cf4aa3bb1b7188335c4a9c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 15:25:24.091543 19815 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bf42e63771cf4aa3bb1b7188335c4a9c [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:25:24.092535 19815 raft_consensus.cc:504] T 00000000000000000000000000000000 P bf42e63771cf4aa3bb1b7188335c4a9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf42e63771cf4aa3bb1b7188335c4a9c" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 34211 } }
I20260810 15:25:24.092671 19815 leader_election.cc:302] T 00000000000000000000000000000000 P bf42e63771cf4aa3bb1b7188335c4a9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bf42e63771cf4aa3bb1b7188335c4a9c; no voters:
I20260810 15:25:24.092888 19815 leader_election.cc:288] T 00000000000000000000000000000000 P bf42e63771cf4aa3bb1b7188335c4a9c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 15:25:24.092971 19822 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bf42e63771cf4aa3bb1b7188335c4a9c [term 1 FOLLOWER]: Leader election won for term 1
I20260810 15:25:24.093151 19822 raft_consensus.cc:686] T 00000000000000000000000000000000 P bf42e63771cf4aa3bb1b7188335c4a9c [term 1 LEADER]: Becoming Leader. State: Replica: bf42e63771cf4aa3bb1b7188335c4a9c, State: Running, Role: LEADER
I20260810 15:25:24.093231 19815 sys_catalog.cc:564] T 00000000000000000000000000000000 P bf42e63771cf4aa3bb1b7188335c4a9c [sys.catalog]: configured and running, proceeding with master startup.
I20260810 15:25:24.093233 19822 consensus_queue.cc:237] T 00000000000000000000000000000000 P bf42e63771cf4aa3bb1b7188335c4a9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf42e63771cf4aa3bb1b7188335c4a9c" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 34211 } }
I20260810 15:25:24.093691 19822 sys_catalog.cc:455] T 00000000000000000000000000000000 P bf42e63771cf4aa3bb1b7188335c4a9c [sys.catalog]: SysCatalogTable state changed. Reason: New leader bf42e63771cf4aa3bb1b7188335c4a9c. Latest consensus state: current_term: 1 leader_uuid: "bf42e63771cf4aa3bb1b7188335c4a9c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf42e63771cf4aa3bb1b7188335c4a9c" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 34211 } } }
I20260810 15:25:24.093703 19827 sys_catalog.cc:455] T 00000000000000000000000000000000 P bf42e63771cf4aa3bb1b7188335c4a9c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bf42e63771cf4aa3bb1b7188335c4a9c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf42e63771cf4aa3bb1b7188335c4a9c" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 34211 } } }
I20260810 15:25:24.093802 19822 sys_catalog.cc:458] T 00000000000000000000000000000000 P bf42e63771cf4aa3bb1b7188335c4a9c [sys.catalog]: This master's current role is: LEADER
I20260810 15:25:24.093811 19827 sys_catalog.cc:458] T 00000000000000000000000000000000 P bf42e63771cf4aa3bb1b7188335c4a9c [sys.catalog]: This master's current role is: LEADER
I20260810 15:25:24.094045 19840 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 15:25:24.094885 19840 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 15:25:24.097117 19840 catalog_manager.cc:1347] Generated new cluster ID: a2f7d37a19864ecea54a0c167ef1ff5f
I20260810 15:25:24.097182 19840 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 10 15:25:24 dist-test-slave-2p8l krb5kdc[19669](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375523, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
I20260810 15:25:24.101807 19821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:24.090503 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56374 (local address 127.18.68.190:34211)
0810 15:25:24.090710 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:24.090718 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:24.090746 (+ 28us) server_negotiation.cc:407] Connection header received
0810 15:25:24.090948 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:24.090954 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:24.090999 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:24.091151 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:24.091908 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:24.092989 (+ 1081us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:24.094233 (+ 1244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:24.094816 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:24.094924 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:24.097976 (+ 3052us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:24.097980 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:24.097980 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:24.097991 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:24.099944 (+ 1953us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:24.100386 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:24.100389 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:24.100390 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:24.100510 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:24.100770 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:24.100771 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:24.100772 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:24.101058 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:24.101213 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:24.101341 (+ 128us) server_negotiation.cc:299] Negotiation successful
0810 15:25:24.101468 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":101,"threads_started":1}
I20260810 15:25:24.104687 19840 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 15:25:24.105178 19840 catalog_manager.cc:1504] Loading token signing keys...
I20260810 15:25:24.109892 19840 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bf42e63771cf4aa3bb1b7188335c4a9c: Generated new TSK 0
I20260810 15:25:24.110093 19840 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.18.68.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.68.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.68.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.129.keytab.
Entry for principal kudu/127.18.68.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.129.keytab.
I20260810 15:25:24.136891 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786375520124696-18706-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786375520124696-18706-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786375520124696-18706-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786375520124696-18706-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.68.129:0
--local_ip_for_outbound_sockets=127.18.68.129
--webserver_interface=127.18.68.129
--webserver_port=0
--tserver_master_addrs=127.18.68.190:34211
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.129.keytab
--principal=kudu/127.18.68.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:35871
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:25:24.221309 19858 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:25:24.221553 19858 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:25:24.221594 19858 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:25:24.222795 19858 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:25:24.222865 19858 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:25:24.222910 19858 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.68.129
I20260810 15:25:24.224431 19858 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:35871
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786375520124696-18706-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786375520124696-18706-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.129.keytab
--principal=kudu/127.18.68.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.68.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786375520124696-18706-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.68.129
--webserver_port=0
--tserver_master_addrs=127.18.68.190:34211
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19858
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.68.129
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786375520124696-18706-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:25:24.224730 19858 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:25:24.224972 19858 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:25:24.230018 19869 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:24.230018 19868 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:24.230168 19877 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:25:24.230350 19858 server_base.cc:1034] running on GCE node
I20260810 15:25:24.230624 19858 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:25:24.230844 19858 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:25:24.232056 19858 hybrid_clock.cc:648] HybridClock initialized: now 1786375524232041 us; error 52 us; skew 500 ppm
Aug 10 15:25:24 dist-test-slave-2p8l krb5kdc[19669](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375524, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:25:24.234799 19858 init.cc:377] Logged in from keytab as kudu/127.18.68.129@KRBTEST.COM (short username kudu)
I20260810 15:25:24.235317 19858 webserver.cc:460] Webserver started at http://127.18.68.129:42557/ using document root <none> and password file <none>
I20260810 15:25:24.235597 19858 fs_manager.cc:359] Metadata directory not provided
I20260810 15:25:24.235648 19858 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:25:24.235814 19858 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:25:24.236984 19858 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786375520124696-18706-0/minicluster-data/ts-0/data/instance:
uuid: "22109e9670d44a5398418b3de801170c"
format_stamp: "Formatted at 2026-08-10 15:25:24 on dist-test-slave-2p8l"
server_key: "b4562cb241a86bf275a501b617a2fd11"
server_key_iv: "a6abd240e75763bf0468f7175e3b2ad4"
server_key_version: "encryptionkey@0"
I20260810 15:25:24.237396 19858 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786375520124696-18706-0/minicluster-data/ts-0/wal/instance:
uuid: "22109e9670d44a5398418b3de801170c"
format_stamp: "Formatted at 2026-08-10 15:25:24 on dist-test-slave-2p8l"
server_key: "b4562cb241a86bf275a501b617a2fd11"
server_key_iv: "a6abd240e75763bf0468f7175e3b2ad4"
server_key_version: "encryptionkey@0"
I20260810 15:25:24.238966 19858 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 15:25:24.239751 19887 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:24.239977 19858 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:25:24.240105 19858 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786375520124696-18706-0/minicluster-data/ts-0/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786375520124696-18706-0/minicluster-data/ts-0/wal
uuid: "22109e9670d44a5398418b3de801170c"
format_stamp: "Formatted at 2026-08-10 15:25:24 on dist-test-slave-2p8l"
server_key: "b4562cb241a86bf275a501b617a2fd11"
server_key_iv: "a6abd240e75763bf0468f7175e3b2ad4"
server_key_version: "encryptionkey@0"
I20260810 15:25:24.240190 19858 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786375520124696-18706-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786375520124696-18706-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786375520124696-18706-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:25:24.254024 19858 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:25:24.256050 19858 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:25:24.256223 19858 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:25:24.256454 19858 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 15:25:24.256901 19858 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 15:25:24.256942 19858 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:24.256963 19858 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 15:25:24.257004 19858 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:24.263511 19858 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.129:35639
I20260810 15:25:24.263561 20097 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.129:35639 every 8 connection(s)
I20260810 15:25:24.263870 19858 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786375520124696-18706-0/minicluster-data/ts-0/data/info.pb
Aug 10 15:25:24 dist-test-slave-2p8l krb5kdc[19669](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375524, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.129@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
I20260810 15:25:24.272408 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 19858
I20260810 15:25:24.272511 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786375520124696-18706-0/minicluster-data/ts-0/wal/instance
I20260810 15:25:24.272708 18706 external_mini_cluster.cc:1428] Setting key 9e7c06986b8241d85f8f2b9c3d88d73b
I20260810 15:25:24.273440 19821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:24.264576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.129:44799 (local address 127.18.68.190:34211)
0810 15:25:24.264682 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:24.264685 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:24.264877 (+ 192us) server_negotiation.cc:407] Connection header received
0810 15:25:24.265802 (+ 925us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:24.265804 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:24.265818 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:24.265880 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:24.266570 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:24.267062 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:24.268019 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:24.268232 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:24.268296 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:24.270495 (+ 2199us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:24.270496 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:24.270496 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:24.270503 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:24.271970 (+ 1467us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:24.272336 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:24.272337 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:24.272338 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:24.272404 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:24.272698 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:24.272699 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:24.272700 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:24.272841 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:24.272917 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:24.273241 (+ 324us) server_negotiation.cc:299] Negotiation successful
0810 15:25:24.273331 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260810 15:25:24.273653 20106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:24.264542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:34211 (local address 127.18.68.129:44799)
0810 15:25:24.264752 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:24.264787 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:24.265680 (+ 893us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:24.265956 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:24.265959 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:24.266297 (+ 338us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:25:24.266479 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:24.266483 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:24.267142 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:24.267143 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:24.267946 (+ 803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:24.267948 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:24.268313 (+ 365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:24.268314 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:24.268412 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:24.268944 (+ 532us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:25:24.268952 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:25:24.270409 (+ 1457us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:25:24.272043 (+ 1634us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:24.272050 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:24.272051 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:24.272259 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:24.272494 (+ 235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:24.272495 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:24.272496 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:24.272626 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:24.272916 (+ 290us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:25:24.272923 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:25:24.273102 (+ 179us) client_negotiation.cc:769] Sending connection context
0810 15:25:24.273215 (+ 113us) client_negotiation.cc:240] Negotiation successful
0810 15:25:24.273372 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":135,"threads_started":1}
I20260810 15:25:24.274160 20098 heartbeater.cc:347] Connected to a master server at 127.18.68.190:34211
I20260810 15:25:24.274251 20098 heartbeater.cc:464] Registering TS with master...
I20260810 15:25:24.274444 20098 heartbeater.cc:511] Master 127.18.68.190:34211 requested a full tablet report, sending...
I20260810 15:25:24.275091 19750 ts_manager.cc:194] Registered new tserver with Master: 22109e9670d44a5398418b3de801170c (127.18.68.129:35639)
I20260810 15:25:24.275851 19750 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.68.129@KRBTEST.COM'} at 127.18.68.129:44799
WARNING: no policy specified for kudu/127.18.68.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.68.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.68.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.130.keytab.
Entry for principal kudu/127.18.68.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.130.keytab.
I20260810 15:25:24.298200 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786375520124696-18706-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786375520124696-18706-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786375520124696-18706-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786375520124696-18706-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.68.130:0
--local_ip_for_outbound_sockets=127.18.68.130
--webserver_interface=127.18.68.130
--webserver_port=0
--tserver_master_addrs=127.18.68.190:34211
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.130.keytab
--principal=kudu/127.18.68.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:35871
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:25:24.383212 20110 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:25:24.383456 20110 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:25:24.383497 20110 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:25:24.384684 20110 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:25:24.384752 20110 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:25:24.384799 20110 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.68.130
I20260810 15:25:24.386437 20110 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:35871
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786375520124696-18706-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786375520124696-18706-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.130.keytab
--principal=kudu/127.18.68.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.68.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786375520124696-18706-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.68.130
--webserver_port=0
--tserver_master_addrs=127.18.68.190:34211
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20110
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.68.130
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786375520124696-18706-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:25:24.386716 20110 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:25:24.386955 20110 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:25:24.392015 20121 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:24.392007 20122 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:24.392007 20126 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:25:24.392540 20110 server_base.cc:1034] running on GCE node
I20260810 15:25:24.392784 20110 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:25:24.393052 20110 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:25:24.394217 20110 hybrid_clock.cc:648] HybridClock initialized: now 1786375524394195 us; error 42 us; skew 500 ppm
Aug 10 15:25:24 dist-test-slave-2p8l krb5kdc[19669](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375524, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:25:24.396896 20110 init.cc:377] Logged in from keytab as kudu/127.18.68.130@KRBTEST.COM (short username kudu)
I20260810 15:25:24.397383 20110 webserver.cc:460] Webserver started at http://127.18.68.130:32995/ using document root <none> and password file <none>
I20260810 15:25:24.397614 20110 fs_manager.cc:359] Metadata directory not provided
I20260810 15:25:24.397683 20110 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:25:24.397845 20110 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:25:24.398933 20110 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786375520124696-18706-0/minicluster-data/ts-1/data/instance:
uuid: "a4a7cbdfcba545b0b026028e581bedfe"
format_stamp: "Formatted at 2026-08-10 15:25:24 on dist-test-slave-2p8l"
server_key: "5dbd95ecf5198ede8fad15a9e9e981fc"
server_key_iv: "b5a56adc78bd4e72c87f654ea5162c53"
server_key_version: "encryptionkey@0"
I20260810 15:25:24.399307 20110 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786375520124696-18706-0/minicluster-data/ts-1/wal/instance:
uuid: "a4a7cbdfcba545b0b026028e581bedfe"
format_stamp: "Formatted at 2026-08-10 15:25:24 on dist-test-slave-2p8l"
server_key: "5dbd95ecf5198ede8fad15a9e9e981fc"
server_key_iv: "b5a56adc78bd4e72c87f654ea5162c53"
server_key_version: "encryptionkey@0"
I20260810 15:25:24.400733 20110 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 15:25:24.401491 20141 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:24.401736 20110 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:25:24.401839 20110 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786375520124696-18706-0/minicluster-data/ts-1/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786375520124696-18706-0/minicluster-data/ts-1/wal
uuid: "a4a7cbdfcba545b0b026028e581bedfe"
format_stamp: "Formatted at 2026-08-10 15:25:24 on dist-test-slave-2p8l"
server_key: "5dbd95ecf5198ede8fad15a9e9e981fc"
server_key_iv: "b5a56adc78bd4e72c87f654ea5162c53"
server_key_version: "encryptionkey@0"
I20260810 15:25:24.401925 20110 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786375520124696-18706-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786375520124696-18706-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786375520124696-18706-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:25:24.431416 20110 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:25:24.433440 20110 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:25:24.433629 20110 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:25:24.433887 20110 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 15:25:24.434260 20110 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 15:25:24.434322 20110 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:24.434365 20110 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 15:25:24.434393 20110 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:24.441025 20110 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.130:33929
I20260810 15:25:24.441087 20342 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.130:33929 every 8 connection(s)
I20260810 15:25:24.441414 20110 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786375520124696-18706-0/minicluster-data/ts-1/data/info.pb
I20260810 15:25:24.443523 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 20110
I20260810 15:25:24.443696 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786375520124696-18706-0/minicluster-data/ts-1/wal/instance
I20260810 15:25:24.443884 18706 external_mini_cluster.cc:1428] Setting key 7797bfc6df33a4f4a5873f83c3c3abd6
Aug 10 15:25:24 dist-test-slave-2p8l krb5kdc[19669](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375524, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.130@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
I20260810 15:25:24.451892 19821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:24.442255 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.130:55985 (local address 127.18.68.190:34211)
0810 15:25:24.442330 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:24.442332 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:24.442512 (+ 180us) server_negotiation.cc:407] Connection header received
0810 15:25:24.443599 (+ 1087us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:24.443600 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:24.443614 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:24.443665 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:24.444458 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:24.444968 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:24.445993 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:24.446341 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:24.446412 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:24.448722 (+ 2310us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:24.448724 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:24.448724 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:24.448733 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:24.450332 (+ 1599us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:24.450827 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:24.450828 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:24.450828 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:24.450892 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:24.451182 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:24.451183 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:24.451184 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:24.451313 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:24.451397 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:24.451695 (+ 298us) server_negotiation.cc:299] Negotiation successful
0810 15:25:24.451793 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260810 15:25:24.452116 20346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:24.442254 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:34211 (local address 127.18.68.130:55985)
0810 15:25:24.442404 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:24.442442 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:24.443473 (+ 1031us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:24.443740 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:24.443745 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:24.444093 (+ 348us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:25:24.444300 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:24.444305 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:24.445078 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:24.445079 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:24.445889 (+ 810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:24.445892 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:24.446419 (+ 527us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:24.446420 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:24.446595 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:24.447172 (+ 577us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:25:24.447188 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:25:24.448619 (+ 1431us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:25:24.450449 (+ 1830us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:24.450457 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:24.450459 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:24.450726 (+ 267us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:24.450961 (+ 235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:24.450962 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:24.450963 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:24.451103 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:24.451387 (+ 284us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:25:24.451394 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:25:24.451553 (+ 159us) client_negotiation.cc:769] Sending connection context
0810 15:25:24.451672 (+ 119us) client_negotiation.cc:240] Negotiation successful
0810 15:25:24.451847 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":88,"threads_started":1}
I20260810 15:25:24.452656 20344 heartbeater.cc:347] Connected to a master server at 127.18.68.190:34211
I20260810 15:25:24.452790 20344 heartbeater.cc:464] Registering TS with master...
I20260810 15:25:24.453047 20344 heartbeater.cc:511] Master 127.18.68.190:34211 requested a full tablet report, sending...
I20260810 15:25:24.453487 19750 ts_manager.cc:194] Registered new tserver with Master: a4a7cbdfcba545b0b026028e581bedfe (127.18.68.130:33929)
WARNING: no policy specified for kudu/127.18.68.131@KRBTEST.COM; defaulting to no policy
I20260810 15:25:24.453914 19750 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.68.130@KRBTEST.COM'} at 127.18.68.130:55985
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.68.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.68.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.131.keytab.
Entry for principal kudu/127.18.68.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.131.keytab.
I20260810 15:25:24.472563 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786375520124696-18706-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786375520124696-18706-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786375520124696-18706-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786375520124696-18706-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.68.131:0
--local_ip_for_outbound_sockets=127.18.68.131
--webserver_interface=127.18.68.131
--webserver_port=0
--tserver_master_addrs=127.18.68.190:34211
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.131.keytab
--principal=kudu/127.18.68.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:35871
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:25:24.558734 20351 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:25:24.558933 20351 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:25:24.558957 20351 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:25:24.560122 20351 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:25:24.560165 20351 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:25:24.560192 20351 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.68.131
I20260810 15:25:24.561762 20351 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:35871
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786375520124696-18706-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786375520124696-18706-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.131.keytab
--principal=kudu/127.18.68.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.68.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786375520124696-18706-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.68.131
--webserver_port=0
--tserver_master_addrs=127.18.68.190:34211
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20351
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.68.131
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786375520124696-18706-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:25:24.562012 20351 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:25:24.562278 20351 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:25:24.567746 20364 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:24.567760 20363 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:24.567752 20367 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:25:24.568166 20351 server_base.cc:1034] running on GCE node
I20260810 15:25:24.568399 20351 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:25:24.568647 20351 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:25:24.569813 20351 hybrid_clock.cc:648] HybridClock initialized: now 1786375524569804 us; error 43 us; skew 500 ppm
Aug 10 15:25:24 dist-test-slave-2p8l krb5kdc[19669](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375524, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:25:24.572525 20351 init.cc:377] Logged in from keytab as kudu/127.18.68.131@KRBTEST.COM (short username kudu)
I20260810 15:25:24.572973 20351 webserver.cc:460] Webserver started at http://127.18.68.131:41887/ using document root <none> and password file <none>
I20260810 15:25:24.573215 20351 fs_manager.cc:359] Metadata directory not provided
I20260810 15:25:24.573285 20351 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:25:24.573442 20351 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:25:24.574545 20351 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786375520124696-18706-0/minicluster-data/ts-2/data/instance:
uuid: "f76d12d6bdb34b2cbd085b14c73a816d"
format_stamp: "Formatted at 2026-08-10 15:25:24 on dist-test-slave-2p8l"
server_key: "1965b958d681dd10be267eb400d0d774"
server_key_iv: "35611444136a0ceeb6fa561d4457dd3b"
server_key_version: "encryptionkey@0"
I20260810 15:25:24.574916 20351 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786375520124696-18706-0/minicluster-data/ts-2/wal/instance:
uuid: "f76d12d6bdb34b2cbd085b14c73a816d"
format_stamp: "Formatted at 2026-08-10 15:25:24 on dist-test-slave-2p8l"
server_key: "1965b958d681dd10be267eb400d0d774"
server_key_iv: "35611444136a0ceeb6fa561d4457dd3b"
server_key_version: "encryptionkey@0"
I20260810 15:25:24.576321 20351 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 15:25:24.577080 20381 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:24.577267 20351 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 15:25:24.577371 20351 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786375520124696-18706-0/minicluster-data/ts-2/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786375520124696-18706-0/minicluster-data/ts-2/wal
uuid: "f76d12d6bdb34b2cbd085b14c73a816d"
format_stamp: "Formatted at 2026-08-10 15:25:24 on dist-test-slave-2p8l"
server_key: "1965b958d681dd10be267eb400d0d774"
server_key_iv: "35611444136a0ceeb6fa561d4457dd3b"
server_key_version: "encryptionkey@0"
I20260810 15:25:24.577454 20351 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786375520124696-18706-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786375520124696-18706-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786375520124696-18706-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:25:24.590461 20351 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:25:24.592471 20351 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:25:24.592646 20351 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:25:24.592885 20351 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 15:25:24.593279 20351 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 15:25:24.593334 20351 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:24.593379 20351 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 15:25:24.593410 20351 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:24.601215 20351 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.131:46239
I20260810 15:25:24.601275 20578 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.131:46239 every 8 connection(s)
I20260810 15:25:24.601670 20351 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786375520124696-18706-0/minicluster-data/ts-2/data/info.pb
I20260810 15:25:24.608209 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 20351
I20260810 15:25:24.608322 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786375520124696-18706-0/minicluster-data/ts-2/wal/instance
I20260810 15:25:24.608528 18706 external_mini_cluster.cc:1428] Setting key 334f9372fcabf73a940c549e2afafd5e
Aug 10 15:25:24 dist-test-slave-2p8l krb5kdc[19669](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375524, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.131@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
I20260810 15:25:24.612605 19821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:24.602555 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.131:37201 (local address 127.18.68.190:34211)
0810 15:25:24.602624 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:24.602626 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:24.602865 (+ 239us) server_negotiation.cc:407] Connection header received
0810 15:25:24.603887 (+ 1022us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:24.603889 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:24.603902 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:24.603960 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:24.604743 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:24.605254 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:24.606390 (+ 1136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:24.606592 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:24.606680 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:24.609410 (+ 2730us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:24.609412 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:24.609412 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:24.609419 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:24.611213 (+ 1794us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:24.611649 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:24.611650 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:24.611650 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:24.611705 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:24.611973 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:24.611974 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:24.611974 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:24.612094 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:24.612170 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:24.612471 (+ 301us) server_negotiation.cc:299] Negotiation successful
0810 15:25:24.612540 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260810 15:25:24.612825 20585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:24.602544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:34211 (local address 127.18.68.131:37201)
0810 15:25:24.602736 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:24.602774 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:24.603768 (+ 994us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:24.604048 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:24.604051 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:24.604320 (+ 269us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:25:24.604639 (+ 319us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:24.604644 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:24.605352 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:24.605353 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:24.606299 (+ 946us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:24.606302 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:24.606694 (+ 392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:24.606695 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:24.606819 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:24.607401 (+ 582us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:25:24.607410 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:25:24.609270 (+ 1860us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:25:24.611328 (+ 2058us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:24.611335 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:24.611337 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:24.611575 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:24.611775 (+ 200us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:24.611775 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:24.611776 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:24.611886 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:24.612195 (+ 309us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:25:24.612202 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:25:24.612340 (+ 138us) client_negotiation.cc:769] Sending connection context
0810 15:25:24.612442 (+ 102us) client_negotiation.cc:240] Negotiation successful
0810 15:25:24.612584 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":101,"threads_started":1}
I20260810 15:25:24.613484 20579 heartbeater.cc:347] Connected to a master server at 127.18.68.190:34211
I20260810 15:25:24.613600 20579 heartbeater.cc:464] Registering TS with master...
I20260810 15:25:24.613785 20579 heartbeater.cc:511] Master 127.18.68.190:34211 requested a full tablet report, sending...
I20260810 15:25:24.614284 19750 ts_manager.cc:194] Registered new tserver with Master: f76d12d6bdb34b2cbd085b14c73a816d (127.18.68.131:46239)
I20260810 15:25:24.614666 19750 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.68.131@KRBTEST.COM'} at 127.18.68.131:37201
I20260810 15:25:24.620774 18706 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 15:25:24.628743 19821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:24.622551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56376 (local address 127.18.68.190:34211)
0810 15:25:24.622602 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:24.622604 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:24.622744 (+ 140us) server_negotiation.cc:407] Connection header received
0810 15:25:24.622771 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:24.622772 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:24.622783 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:24.622847 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:24.623416 (+ 569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:24.623917 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:24.624712 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:24.624918 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:24.624987 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:24.626293 (+ 1306us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:24.626295 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:24.626295 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:24.626301 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:24.627730 (+ 1429us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:24.628071 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:24.628072 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:24.628072 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:24.628133 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:24.628291 (+ 158us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:24.628292 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:24.628292 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:24.628428 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:24.628501 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:24.628611 (+ 110us) server_negotiation.cc:299] Negotiation successful
0810 15:25:24.628679 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260810 15:25:24.631106 19750 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56376:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 15:25:24.632766 19750 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 15:25:24.639689 20606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:24.635314 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46518 (local address 127.18.68.129:35639)
0810 15:25:24.635488 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:24.635493 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:24.635639 (+ 146us) server_negotiation.cc:407] Connection header received
0810 15:25:24.635806 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:24.635809 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:24.635824 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:24.635880 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:25:24.636176 (+ 296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:24.637269 (+ 1093us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:24.638496 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:24.639212 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:24.639296 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:24.639360 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:24.639558 (+ 198us) server_negotiation.cc:299] Negotiation successful
0810 15:25:24.639610 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":102,"threads_started":1}
I20260810 15:25:24.639737 20607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:24.635495 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59548 (local address 127.18.68.131:46239)
0810 15:25:24.635740 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:24.635745 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:24.636113 (+ 368us) server_negotiation.cc:407] Connection header received
0810 15:25:24.636158 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:24.636160 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:24.636176 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:24.636246 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:25:24.636466 (+ 220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:24.637488 (+ 1022us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:24.638799 (+ 1311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:24.639391 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:24.639472 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:24.639532 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:24.639613 (+ 81us) server_negotiation.cc:299] Negotiation successful
0810 15:25:24.639653 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":204,"thread_start_us":101,"threads_started":1}
I20260810 15:25:24.639808 20608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:24.635547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55336 (local address 127.18.68.130:33929)
0810 15:25:24.635779 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:24.635783 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:24.635893 (+ 110us) server_negotiation.cc:407] Connection header received
0810 15:25:24.635979 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:24.635982 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:24.635999 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:24.636074 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:25:24.636326 (+ 252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:24.637045 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:24.638579 (+ 1534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:24.639288 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:24.639349 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:24.639395 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:24.639677 (+ 282us) server_negotiation.cc:299] Negotiation successful
0810 15:25:24.639719 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":195,"thread_start_us":147,"threads_started":1}
I20260810 15:25:24.639706 20603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:24.635252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.131:46239 (local address 127.0.0.1:59548)
0810 15:25:24.635996 (+ 744us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:24.636005 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:24.636053 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:24.636336 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:24.636337 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:24.636338 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:25:24.636380 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:24.636381 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:24.637621 (+ 1240us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:24.637623 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:24.638713 (+ 1090us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:24.638715 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:24.639478 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:24.639479 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:24.639529 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:24.639532 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 15:25:24.639592 (+ 60us) client_negotiation.cc:240] Negotiation successful
0810 15:25:24.639625 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":727,"thread_start_us":72,"threads_started":1}
I20260810 15:25:24.639966 20602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:24.635191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.129:35639 (local address 127.0.0.1:46518)
0810 15:25:24.635513 (+ 322us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:24.635555 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:24.635660 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:24.635977 (+ 317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:24.635979 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:24.635981 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:25:24.636082 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:24.636084 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:24.637388 (+ 1304us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:24.637389 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:24.638403 (+ 1014us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:24.638406 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:24.639318 (+ 912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:24.639319 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:24.639417 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:24.639435 (+ 18us) client_negotiation.cc:769] Sending connection context
0810 15:25:24.639818 (+ 383us) client_negotiation.cc:240] Negotiation successful
0810 15:25:24.639860 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":294,"mutex_wait_us":2,"thread_start_us":74,"threads_started":1}
I20260810 15:25:24.640027 20605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:24.635223 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.130:33929 (local address 127.0.0.1:55336)
0810 15:25:24.635800 (+ 577us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:24.635811 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:24.635898 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:24.636186 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:24.636187 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:24.636190 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:25:24.636241 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:24.636242 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:24.637163 (+ 921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:24.637164 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:24.638487 (+ 1323us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:24.638490 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:24.639429 (+ 939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:24.639430 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:24.639501 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:24.639505 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 15:25:24.639557 (+ 52us) client_negotiation.cc:240] Negotiation successful
0810 15:25:24.639629 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":556,"mutex_wait_us":105,"thread_start_us":97,"threads_started":1}
I20260810 15:25:24.640883 20457 tablet_service.cc:1467] Processing CreateTablet for tablet 5d55c23674fa4aa9b259c67b94ab49c2 (DEFAULT_TABLE table=test-table [id=d36b3e4e40fb47e3ada7940069b621a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 15:25:24.640883 20231 tablet_service.cc:1467] Processing CreateTablet for tablet 5d55c23674fa4aa9b259c67b94ab49c2 (DEFAULT_TABLE table=test-table [id=d36b3e4e40fb47e3ada7940069b621a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 15:25:24.641258 20231 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5d55c23674fa4aa9b259c67b94ab49c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:25:24.641258 20457 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5d55c23674fa4aa9b259c67b94ab49c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:25:24.642583 19977 tablet_service.cc:1467] Processing CreateTablet for tablet 5d55c23674fa4aa9b259c67b94ab49c2 (DEFAULT_TABLE table=test-table [id=d36b3e4e40fb47e3ada7940069b621a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 15:25:24.642959 19977 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5d55c23674fa4aa9b259c67b94ab49c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:25:24.644979 20611 tablet_bootstrap.cc:492] T 5d55c23674fa4aa9b259c67b94ab49c2 P f76d12d6bdb34b2cbd085b14c73a816d: Bootstrap starting.
I20260810 15:25:24.645835 20611 tablet_bootstrap.cc:654] T 5d55c23674fa4aa9b259c67b94ab49c2 P f76d12d6bdb34b2cbd085b14c73a816d: Neither blocks nor log segments found. Creating new log.
I20260810 15:25:24.646313 20613 tablet_bootstrap.cc:492] T 5d55c23674fa4aa9b259c67b94ab49c2 P 22109e9670d44a5398418b3de801170c: Bootstrap starting.
I20260810 15:25:24.646309 20610 tablet_bootstrap.cc:492] T 5d55c23674fa4aa9b259c67b94ab49c2 P a4a7cbdfcba545b0b026028e581bedfe: Bootstrap starting.
I20260810 15:25:24.646868 20611 log.cc:824] T 5d55c23674fa4aa9b259c67b94ab49c2 P f76d12d6bdb34b2cbd085b14c73a816d: Log is configured to *not* fsync() on all Append() calls
I20260810 15:25:24.647114 20613 tablet_bootstrap.cc:654] T 5d55c23674fa4aa9b259c67b94ab49c2 P 22109e9670d44a5398418b3de801170c: Neither blocks nor log segments found. Creating new log.
I20260810 15:25:24.647143 20610 tablet_bootstrap.cc:654] T 5d55c23674fa4aa9b259c67b94ab49c2 P a4a7cbdfcba545b0b026028e581bedfe: Neither blocks nor log segments found. Creating new log.
I20260810 15:25:24.647691 20611 tablet_bootstrap.cc:492] T 5d55c23674fa4aa9b259c67b94ab49c2 P f76d12d6bdb34b2cbd085b14c73a816d: No bootstrap required, opened a new log
I20260810 15:25:24.647732 20613 log.cc:824] T 5d55c23674fa4aa9b259c67b94ab49c2 P 22109e9670d44a5398418b3de801170c: Log is configured to *not* fsync() on all Append() calls
I20260810 15:25:24.647758 20610 log.cc:824] T 5d55c23674fa4aa9b259c67b94ab49c2 P a4a7cbdfcba545b0b026028e581bedfe: Log is configured to *not* fsync() on all Append() calls
I20260810 15:25:24.647778 20611 ts_tablet_manager.cc:1397] T 5d55c23674fa4aa9b259c67b94ab49c2 P f76d12d6bdb34b2cbd085b14c73a816d: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260810 15:25:24.648473 20610 tablet_bootstrap.cc:492] T 5d55c23674fa4aa9b259c67b94ab49c2 P a4a7cbdfcba545b0b026028e581bedfe: No bootstrap required, opened a new log
I20260810 15:25:24.648598 20610 ts_tablet_manager.cc:1397] T 5d55c23674fa4aa9b259c67b94ab49c2 P a4a7cbdfcba545b0b026028e581bedfe: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 15:25:24.648967 20613 tablet_bootstrap.cc:492] T 5d55c23674fa4aa9b259c67b94ab49c2 P 22109e9670d44a5398418b3de801170c: No bootstrap required, opened a new log
I20260810 15:25:24.649065 20613 ts_tablet_manager.cc:1397] T 5d55c23674fa4aa9b259c67b94ab49c2 P 22109e9670d44a5398418b3de801170c: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260810 15:25:24.649794 20611 raft_consensus.cc:348] T 5d55c23674fa4aa9b259c67b94ab49c2 P f76d12d6bdb34b2cbd085b14c73a816d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76d12d6bdb34b2cbd085b14c73a816d" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 46239 } } peers { permanent_uuid: "22109e9670d44a5398418b3de801170c" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35639 } } peers { permanent_uuid: "a4a7cbdfcba545b0b026028e581bedfe" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 33929 } }
I20260810 15:25:24.649962 20611 raft_consensus.cc:374] T 5d55c23674fa4aa9b259c67b94ab49c2 P f76d12d6bdb34b2cbd085b14c73a816d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:25:24.650007 20611 raft_consensus.cc:729] T 5d55c23674fa4aa9b259c67b94ab49c2 P f76d12d6bdb34b2cbd085b14c73a816d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f76d12d6bdb34b2cbd085b14c73a816d, State: Initialized, Role: FOLLOWER
I20260810 15:25:24.650161 20611 consensus_queue.cc:260] T 5d55c23674fa4aa9b259c67b94ab49c2 P f76d12d6bdb34b2cbd085b14c73a816d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76d12d6bdb34b2cbd085b14c73a816d" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 46239 } } peers { permanent_uuid: "22109e9670d44a5398418b3de801170c" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35639 } } peers { permanent_uuid: "a4a7cbdfcba545b0b026028e581bedfe" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 33929 } }
I20260810 15:25:24.650471 20611 ts_tablet_manager.cc:1428] T 5d55c23674fa4aa9b259c67b94ab49c2 P f76d12d6bdb34b2cbd085b14c73a816d: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 15:25:24.650619 20579 heartbeater.cc:503] Master 127.18.68.190:34211 was elected leader, sending a full tablet report...
I20260810 15:25:24.650779 20610 raft_consensus.cc:348] T 5d55c23674fa4aa9b259c67b94ab49c2 P a4a7cbdfcba545b0b026028e581bedfe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76d12d6bdb34b2cbd085b14c73a816d" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 46239 } } peers { permanent_uuid: "22109e9670d44a5398418b3de801170c" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35639 } } peers { permanent_uuid: "a4a7cbdfcba545b0b026028e581bedfe" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 33929 } }
I20260810 15:25:24.650949 20610 raft_consensus.cc:374] T 5d55c23674fa4aa9b259c67b94ab49c2 P a4a7cbdfcba545b0b026028e581bedfe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:25:24.650982 20610 raft_consensus.cc:729] T 5d55c23674fa4aa9b259c67b94ab49c2 P a4a7cbdfcba545b0b026028e581bedfe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4a7cbdfcba545b0b026028e581bedfe, State: Initialized, Role: FOLLOWER
I20260810 15:25:24.651085 20610 consensus_queue.cc:260] T 5d55c23674fa4aa9b259c67b94ab49c2 P a4a7cbdfcba545b0b026028e581bedfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76d12d6bdb34b2cbd085b14c73a816d" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 46239 } } peers { permanent_uuid: "22109e9670d44a5398418b3de801170c" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35639 } } peers { permanent_uuid: "a4a7cbdfcba545b0b026028e581bedfe" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 33929 } }
I20260810 15:25:24.651178 20613 raft_consensus.cc:348] T 5d55c23674fa4aa9b259c67b94ab49c2 P 22109e9670d44a5398418b3de801170c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76d12d6bdb34b2cbd085b14c73a816d" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 46239 } } peers { permanent_uuid: "22109e9670d44a5398418b3de801170c" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35639 } } peers { permanent_uuid: "a4a7cbdfcba545b0b026028e581bedfe" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 33929 } }
I20260810 15:25:24.651336 20613 raft_consensus.cc:374] T 5d55c23674fa4aa9b259c67b94ab49c2 P 22109e9670d44a5398418b3de801170c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:25:24.651362 20610 ts_tablet_manager.cc:1428] T 5d55c23674fa4aa9b259c67b94ab49c2 P a4a7cbdfcba545b0b026028e581bedfe: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 15:25:24.651373 20613 raft_consensus.cc:729] T 5d55c23674fa4aa9b259c67b94ab49c2 P 22109e9670d44a5398418b3de801170c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22109e9670d44a5398418b3de801170c, State: Initialized, Role: FOLLOWER
I20260810 15:25:24.651429 20344 heartbeater.cc:503] Master 127.18.68.190:34211 was elected leader, sending a full tablet report...
I20260810 15:25:24.651484 20613 consensus_queue.cc:260] T 5d55c23674fa4aa9b259c67b94ab49c2 P 22109e9670d44a5398418b3de801170c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76d12d6bdb34b2cbd085b14c73a816d" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 46239 } } peers { permanent_uuid: "22109e9670d44a5398418b3de801170c" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35639 } } peers { permanent_uuid: "a4a7cbdfcba545b0b026028e581bedfe" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 33929 } }
I20260810 15:25:24.651767 20613 ts_tablet_manager.cc:1428] T 5d55c23674fa4aa9b259c67b94ab49c2 P 22109e9670d44a5398418b3de801170c: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 15:25:24.651788 20098 heartbeater.cc:503] Master 127.18.68.190:34211 was elected leader, sending a full tablet report...
W20260810 15:25:24.691985 20345 tablet.cc:2369] T 5d55c23674fa4aa9b259c67b94ab49c2 P a4a7cbdfcba545b0b026028e581bedfe: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 15:25:24.764595 20099 tablet.cc:2369] T 5d55c23674fa4aa9b259c67b94ab49c2 P 22109e9670d44a5398418b3de801170c: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 15:25:24.852373 20583 tablet.cc:2369] T 5d55c23674fa4aa9b259c67b94ab49c2 P f76d12d6bdb34b2cbd085b14c73a816d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 15:25:24.878449 20622 raft_consensus.cc:482] T 5d55c23674fa4aa9b259c67b94ab49c2 P 22109e9670d44a5398418b3de801170c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 15:25:24.878585 20622 raft_consensus.cc:504] T 5d55c23674fa4aa9b259c67b94ab49c2 P 22109e9670d44a5398418b3de801170c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76d12d6bdb34b2cbd085b14c73a816d" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 46239 } } peers { permanent_uuid: "22109e9670d44a5398418b3de801170c" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35639 } } peers { permanent_uuid: "a4a7cbdfcba545b0b026028e581bedfe" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 33929 } }
I20260810 15:25:24.879029 20622 leader_election.cc:288] T 5d55c23674fa4aa9b259c67b94ab49c2 P 22109e9670d44a5398418b3de801170c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f76d12d6bdb34b2cbd085b14c73a816d (127.18.68.131:46239), a4a7cbdfcba545b0b026028e581bedfe (127.18.68.130:33929)
I20260810 15:25:24.882323 20607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:24.879404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.129:57403 (local address 127.18.68.131:46239)
0810 15:25:24.879491 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:24.879493 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:24.879506 (+ 13us) server_negotiation.cc:407] Connection header received
0810 15:25:24.879658 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:24.879659 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:24.879669 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:24.879745 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:25:24.879962 (+ 217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:24.880442 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:24.881519 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:24.881912 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:24.882000 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:24.882018 (+ 18us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:24.882219 (+ 201us) server_negotiation.cc:299] Negotiation successful
0810 15:25:24.882261 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260810 15:25:24.882323 20623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:24.879268 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.131:46239 (local address 127.18.68.129:57403)
0810 15:25:24.879445 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:24.879459 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:24.879568 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:24.879783 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:24.879784 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:24.879787 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:25:24.879887 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:24.879889 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:24.880531 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:24.880532 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:24.881418 (+ 886us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:24.881420 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:24.882000 (+ 580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:24.882001 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:24.882128 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:24.882138 (+ 10us) client_negotiation.cc:769] Sending connection context
0810 15:25:24.882199 (+ 61us) client_negotiation.cc:240] Negotiation successful
0810 15:25:24.882242 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"mutex_wait_us":23,"thread_start_us":69,"threads_started":1}
I20260810 15:25:24.882462 20608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:24.879352 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.129:50759 (local address 127.18.68.130:33929)
0810 15:25:24.879406 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:24.879408 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:24.879567 (+ 159us) server_negotiation.cc:407] Connection header received
0810 15:25:24.879674 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:24.879675 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:24.879683 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:24.879754 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:25:24.880001 (+ 247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:24.880545 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:24.881601 (+ 1056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:24.882086 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:24.882181 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:24.882191 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:24.882357 (+ 166us) server_negotiation.cc:299] Negotiation successful
0810 15:25:24.882397 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260810 15:25:24.882483 20624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:24.879268 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.130:33929 (local address 127.18.68.129:50759)
0810 15:25:24.879479 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:24.879490 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:24.879583 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:24.879786 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:24.879788 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:24.879790 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:25:24.879892 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:24.879893 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:24.880628 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:24.880629 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:24.881504 (+ 875us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:24.881507 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:24.882191 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:24.882193 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:24.882282 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:24.882285 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 15:25:24.882352 (+ 67us) client_negotiation.cc:240] Negotiation successful
0810 15:25:24.882389 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":189,"mutex_wait_us":23,"thread_start_us":64,"threads_started":1}
I20260810 15:25:24.882916 20262 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d55c23674fa4aa9b259c67b94ab49c2" candidate_uuid: "22109e9670d44a5398418b3de801170c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4a7cbdfcba545b0b026028e581bedfe" is_pre_election: true
I20260810 15:25:24.883028 20496 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d55c23674fa4aa9b259c67b94ab49c2" candidate_uuid: "22109e9670d44a5398418b3de801170c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f76d12d6bdb34b2cbd085b14c73a816d" is_pre_election: true
I20260810 15:25:24.883107 20262 raft_consensus.cc:2454] T 5d55c23674fa4aa9b259c67b94ab49c2 P a4a7cbdfcba545b0b026028e581bedfe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22109e9670d44a5398418b3de801170c in term 0.
I20260810 15:25:24.883209 20496 raft_consensus.cc:2454] T 5d55c23674fa4aa9b259c67b94ab49c2 P f76d12d6bdb34b2cbd085b14c73a816d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22109e9670d44a5398418b3de801170c in term 0.
I20260810 15:25:24.883344 19890 leader_election.cc:302] T 5d55c23674fa4aa9b259c67b94ab49c2 P 22109e9670d44a5398418b3de801170c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22109e9670d44a5398418b3de801170c, a4a7cbdfcba545b0b026028e581bedfe; no voters:
I20260810 15:25:24.883497 20622 raft_consensus.cc:2781] T 5d55c23674fa4aa9b259c67b94ab49c2 P 22109e9670d44a5398418b3de801170c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 15:25:24.883566 20622 raft_consensus.cc:482] T 5d55c23674fa4aa9b259c67b94ab49c2 P 22109e9670d44a5398418b3de801170c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 15:25:24.883590 20622 raft_consensus.cc:3037] T 5d55c23674fa4aa9b259c67b94ab49c2 P 22109e9670d44a5398418b3de801170c [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:25:24.884299 20622 raft_consensus.cc:504] T 5d55c23674fa4aa9b259c67b94ab49c2 P 22109e9670d44a5398418b3de801170c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76d12d6bdb34b2cbd085b14c73a816d" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 46239 } } peers { permanent_uuid: "22109e9670d44a5398418b3de801170c" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35639 } } peers { permanent_uuid: "a4a7cbdfcba545b0b026028e581bedfe" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 33929 } }
I20260810 15:25:24.884452 20622 leader_election.cc:288] T 5d55c23674fa4aa9b259c67b94ab49c2 P 22109e9670d44a5398418b3de801170c [CANDIDATE]: Term 1 election: Requested vote from peers f76d12d6bdb34b2cbd085b14c73a816d (127.18.68.131:46239), a4a7cbdfcba545b0b026028e581bedfe (127.18.68.130:33929)
I20260810 15:25:24.884684 20496 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d55c23674fa4aa9b259c67b94ab49c2" candidate_uuid: "22109e9670d44a5398418b3de801170c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f76d12d6bdb34b2cbd085b14c73a816d"
I20260810 15:25:24.884712 20262 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d55c23674fa4aa9b259c67b94ab49c2" candidate_uuid: "22109e9670d44a5398418b3de801170c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4a7cbdfcba545b0b026028e581bedfe"
I20260810 15:25:24.884778 20262 raft_consensus.cc:3037] T 5d55c23674fa4aa9b259c67b94ab49c2 P a4a7cbdfcba545b0b026028e581bedfe [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:25:24.884778 20496 raft_consensus.cc:3037] T 5d55c23674fa4aa9b259c67b94ab49c2 P f76d12d6bdb34b2cbd085b14c73a816d [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:25:24.885766 20262 raft_consensus.cc:2454] T 5d55c23674fa4aa9b259c67b94ab49c2 P a4a7cbdfcba545b0b026028e581bedfe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22109e9670d44a5398418b3de801170c in term 1.
I20260810 15:25:24.885828 20496 raft_consensus.cc:2454] T 5d55c23674fa4aa9b259c67b94ab49c2 P f76d12d6bdb34b2cbd085b14c73a816d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22109e9670d44a5398418b3de801170c in term 1.
I20260810 15:25:24.886018 19891 leader_election.cc:302] T 5d55c23674fa4aa9b259c67b94ab49c2 P 22109e9670d44a5398418b3de801170c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22109e9670d44a5398418b3de801170c, f76d12d6bdb34b2cbd085b14c73a816d; no voters:
I20260810 15:25:24.886173 20622 raft_consensus.cc:2781] T 5d55c23674fa4aa9b259c67b94ab49c2 P 22109e9670d44a5398418b3de801170c [term 1 FOLLOWER]: Leader election won for term 1
I20260810 15:25:24.886397 20622 raft_consensus.cc:686] T 5d55c23674fa4aa9b259c67b94ab49c2 P 22109e9670d44a5398418b3de801170c [term 1 LEADER]: Becoming Leader. State: Replica: 22109e9670d44a5398418b3de801170c, State: Running, Role: LEADER
I20260810 15:25:24.886507 20622 consensus_queue.cc:237] T 5d55c23674fa4aa9b259c67b94ab49c2 P 22109e9670d44a5398418b3de801170c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76d12d6bdb34b2cbd085b14c73a816d" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 46239 } } peers { permanent_uuid: "22109e9670d44a5398418b3de801170c" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35639 } } peers { permanent_uuid: "a4a7cbdfcba545b0b026028e581bedfe" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 33929 } }
I20260810 15:25:24.887377 19750 catalog_manager.cc:5495] T 5d55c23674fa4aa9b259c67b94ab49c2 P 22109e9670d44a5398418b3de801170c reported cstate change: term changed from 0 to 1, leader changed from <none> to 22109e9670d44a5398418b3de801170c (127.18.68.129). New cstate: current_term: 1 leader_uuid: "22109e9670d44a5398418b3de801170c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f76d12d6bdb34b2cbd085b14c73a816d" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 46239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22109e9670d44a5398418b3de801170c" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35639 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4a7cbdfcba545b0b026028e581bedfe" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 33929 } health_report { overall_health: UNKNOWN } } }
Aug 10 15:25:24 dist-test-slave-2p8l krb5kdc[19669](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375523, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.68.129@KRBTEST.COM
I20260810 15:25:24.927268 20606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:24.918998 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46532 (local address 127.18.68.129:35639)
0810 15:25:24.919076 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:24.919079 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:24.919206 (+ 127us) server_negotiation.cc:407] Connection header received
0810 15:25:24.919303 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:24.919305 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:24.919324 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:24.919397 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:24.920134 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:24.920664 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:24.921509 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:24.921771 (+ 262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:24.921883 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:24.924512 (+ 2629us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:24.924528 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:24.924529 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:24.924539 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:24.926237 (+ 1698us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:24.926571 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:24.926574 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:24.926574 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:24.926640 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:24.926815 (+ 175us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:24.926816 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:24.926816 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:24.926951 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:24.927105 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:24.927135 (+ 30us) server_negotiation.cc:299] Negotiation successful
0810 15:25:24.927199 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
Aug 10 15:25:24 dist-test-slave-2p8l krb5kdc[19669](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375524, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 10 15:25:24 dist-test-slave-2p8l krb5kdc[19669](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375524, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.18.68.129@KRBTEST.COM
I20260810 15:25:24.953907 20606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:24.945795 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46548 (local address 127.18.68.129:35639)
0810 15:25:24.945885 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:24.945887 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:24.945996 (+ 109us) server_negotiation.cc:407] Connection header received
0810 15:25:24.946135 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:24.946142 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:24.946153 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:24.946209 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:24.946812 (+ 603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:24.947308 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:24.948076 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:24.948274 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:24.948354 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:24.950923 (+ 2569us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:24.950924 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:24.950925 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:24.950933 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:24.952457 (+ 1524us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:24.952913 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:24.952914 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:24.952915 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:24.952982 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:24.953233 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:24.953234 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:24.953235 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:24.953350 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:24.953468 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:24.953702 (+ 234us) server_negotiation.cc:299] Negotiation successful
0810 15:25:24.953791 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
Aug 10 15:25:24 dist-test-slave-2p8l krb5kdc[19669](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375524, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 10 15:25:24 dist-test-slave-2p8l krb5kdc[19669](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375524, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.68.129@KRBTEST.COM
I20260810 15:25:24.980719 20606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:24.972992 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46564 (local address 127.18.68.129:35639)
0810 15:25:24.973102 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:24.973105 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:24.973224 (+ 119us) server_negotiation.cc:407] Connection header received
0810 15:25:24.973312 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:24.973313 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:24.973325 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:24.973377 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:24.974231 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:24.974744 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:24.975497 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:24.975695 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:24.975773 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:24.978196 (+ 2423us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:24.978198 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:24.978198 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:24.978205 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:24.979680 (+ 1475us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:24.980097 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:24.980098 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:24.980099 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:24.980153 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:24.980329 (+ 176us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:24.980329 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:24.980330 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:24.980420 (+ 90us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:24.980510 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:24.980586 (+ 76us) server_negotiation.cc:299] Negotiation successful
0810 15:25:24.980651 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
W20260810 15:25:24.981313 19938 tablet_service.cc:2908] Rejecting scan request for tablet 5d55c23674fa4aa9b259c67b94ab49c2: Uninitialized: clean time has not yet been initialized
I20260810 15:25:24.982373 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 19858
I20260810 15:25:24.994794 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 20110
I20260810 15:25:25.002146 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 20351
I20260810 15:25:25.017385 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 19690
2026-08-10T15:25:25Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2475 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 15:25:25 dist-test-slave-2p8l krb5kdc[20646](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 15:25:25 dist-test-slave-2p8l krb5kdc[20646](info): set up 2 sockets
Aug 10 15:25:25 dist-test-slave-2p8l krb5kdc[20646](info): commencing operation
krb5kdc: starting...
W20260810 15:25:26.332454 18706 mini_kdc.cc:121] Time spent starting KDC: real 1.286s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/krb5kdc/test-user.keytab.
Aug 10 15:25:26 dist-test-slave-2p8l krb5kdc[20646](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375526, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T15:25:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T15:25:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.68.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.68.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.68.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab.
Entry for principal kudu/127.18.68.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab.
I20260810 15:25:26.465175 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.190:46101
--webserver_interface=127.18.68.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab
--principal=kudu/127.18.68.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:33911
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.68.190:46101
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:25:26.548678 20670 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:25:26.548890 20670 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:25:26.548913 20670 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:25:26.549988 20670 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 15:25:26.550020 20670 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260810 15:25:26.550033 20670 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:25:26.550046 20670 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:25:26.550078 20670 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 15:25:26.550148 20670 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 15:25:26.552284 20670 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:33911
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.68.190:46101
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab
--principal=kudu/127.18.68.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.190:46101
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.68.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20670
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:25:26.552512 20670 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:25:26.552693 20670 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:25:26.557688 20683 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:26.557699 20679 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:25:26.557718 20670 server_base.cc:1034] running on GCE node
W20260810 15:25:26.557715 20677 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:25:26.558254 20670 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:25:26.558617 20670 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:25:26.559818 20670 hybrid_clock.cc:648] HybridClock initialized: now 1786375526559801 us; error 29 us; skew 500 ppm
Aug 10 15:25:26 dist-test-slave-2p8l krb5kdc[20646](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375526, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:25:26.562492 20670 init.cc:377] Logged in from keytab as kudu/127.18.68.190@KRBTEST.COM (short username kudu)
I20260810 15:25:26.562973 20670 webserver.cc:460] Webserver started at http://127.18.68.190:45641/ using document root <none> and password file <none>
I20260810 15:25:26.563248 20670 fs_manager.cc:359] Metadata directory not provided
I20260810 15:25:26.563325 20670 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:25:26.563485 20670 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:25:26.564762 20670 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/minicluster-data/master-0/data/instance:
uuid: "60a3742891de4b53a6d1da73e2e9de00"
format_stamp: "Formatted at 2026-08-10 15:25:26 on dist-test-slave-2p8l"
server_key: "01f2e0066c9bfa594826fbf377e25aa9"
server_key_iv: "7c91099e8036cd0a910562c5a0a49c00"
server_key_version: "encryptionkey@0"
I20260810 15:25:26.565189 20670 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/minicluster-data/master-0/wal/instance:
uuid: "60a3742891de4b53a6d1da73e2e9de00"
format_stamp: "Formatted at 2026-08-10 15:25:26 on dist-test-slave-2p8l"
server_key: "01f2e0066c9bfa594826fbf377e25aa9"
server_key_iv: "7c91099e8036cd0a910562c5a0a49c00"
server_key_version: "encryptionkey@0"
I20260810 15:25:26.566751 20670 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 15:25:26.567677 20695 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:26.567896 20670 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 15:25:26.568022 20670 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/minicluster-data/master-0/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/minicluster-data/master-0/wal
uuid: "60a3742891de4b53a6d1da73e2e9de00"
format_stamp: "Formatted at 2026-08-10 15:25:26 on dist-test-slave-2p8l"
server_key: "01f2e0066c9bfa594826fbf377e25aa9"
server_key_iv: "7c91099e8036cd0a910562c5a0a49c00"
server_key_version: "encryptionkey@0"
I20260810 15:25:26.568140 20670 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:25:26.578449 20670 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:25:26.580929 20670 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:25:26.581140 20670 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:25:26.587348 20670 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.190:46101
I20260810 15:25:26.587396 20816 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.190:46101 every 8 connection(s)
I20260810 15:25:26.587800 20670 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
I20260810 15:25:26.588629 20817 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:25:26.590430 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 20670
I20260810 15:25:26.590541 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/minicluster-data/master-0/wal/instance
I20260810 15:25:26.590737 18706 external_mini_cluster.cc:1428] Setting key 2bd8ca2c46b1d073620cd1d95dc87083
I20260810 15:25:26.591763 20817 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 60a3742891de4b53a6d1da73e2e9de00: Bootstrap starting.
I20260810 15:25:26.592540 20817 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 60a3742891de4b53a6d1da73e2e9de00: Neither blocks nor log segments found. Creating new log.
I20260810 15:25:26.592936 20817 log.cc:824] T 00000000000000000000000000000000 P 60a3742891de4b53a6d1da73e2e9de00: Log is configured to *not* fsync() on all Append() calls
I20260810 15:25:26.593801 20817 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 60a3742891de4b53a6d1da73e2e9de00: No bootstrap required, opened a new log
I20260810 15:25:26.596500 20817 raft_consensus.cc:348] T 00000000000000000000000000000000 P 60a3742891de4b53a6d1da73e2e9de00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60a3742891de4b53a6d1da73e2e9de00" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46101 } }
I20260810 15:25:26.596748 20817 raft_consensus.cc:374] T 00000000000000000000000000000000 P 60a3742891de4b53a6d1da73e2e9de00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:25:26.596796 20817 raft_consensus.cc:729] T 00000000000000000000000000000000 P 60a3742891de4b53a6d1da73e2e9de00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60a3742891de4b53a6d1da73e2e9de00, State: Initialized, Role: FOLLOWER
I20260810 15:25:26.596982 20817 consensus_queue.cc:260] T 00000000000000000000000000000000 P 60a3742891de4b53a6d1da73e2e9de00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60a3742891de4b53a6d1da73e2e9de00" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46101 } }
I20260810 15:25:26.597132 20817 raft_consensus.cc:388] T 00000000000000000000000000000000 P 60a3742891de4b53a6d1da73e2e9de00 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 15:25:26.597191 20817 raft_consensus.cc:482] T 00000000000000000000000000000000 P 60a3742891de4b53a6d1da73e2e9de00 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 15:25:26.597254 20817 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 60a3742891de4b53a6d1da73e2e9de00 [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:25:26.597895 20817 raft_consensus.cc:504] T 00000000000000000000000000000000 P 60a3742891de4b53a6d1da73e2e9de00 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60a3742891de4b53a6d1da73e2e9de00" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46101 } }
I20260810 15:25:26.598035 20817 leader_election.cc:302] T 00000000000000000000000000000000 P 60a3742891de4b53a6d1da73e2e9de00 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 60a3742891de4b53a6d1da73e2e9de00; no voters:
I20260810 15:25:26.598331 20817 leader_election.cc:288] T 00000000000000000000000000000000 P 60a3742891de4b53a6d1da73e2e9de00 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 15:25:26.598423 20827 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 60a3742891de4b53a6d1da73e2e9de00 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 15:25:26.598649 20817 sys_catalog.cc:564] T 00000000000000000000000000000000 P 60a3742891de4b53a6d1da73e2e9de00 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 15:25:26.598675 20827 raft_consensus.cc:686] T 00000000000000000000000000000000 P 60a3742891de4b53a6d1da73e2e9de00 [term 1 LEADER]: Becoming Leader. State: Replica: 60a3742891de4b53a6d1da73e2e9de00, State: Running, Role: LEADER
I20260810 15:25:26.598804 20827 consensus_queue.cc:237] T 00000000000000000000000000000000 P 60a3742891de4b53a6d1da73e2e9de00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60a3742891de4b53a6d1da73e2e9de00" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46101 } }
Aug 10 15:25:26 dist-test-slave-2p8l krb5kdc[20646](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375526, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
I20260810 15:25:26.599154 20827 sys_catalog.cc:455] T 00000000000000000000000000000000 P 60a3742891de4b53a6d1da73e2e9de00 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 60a3742891de4b53a6d1da73e2e9de00. Latest consensus state: current_term: 1 leader_uuid: "60a3742891de4b53a6d1da73e2e9de00" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60a3742891de4b53a6d1da73e2e9de00" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46101 } } }
I20260810 15:25:26.599261 20827 sys_catalog.cc:458] T 00000000000000000000000000000000 P 60a3742891de4b53a6d1da73e2e9de00 [sys.catalog]: This master's current role is: LEADER
I20260810 15:25:26.599166 20835 sys_catalog.cc:455] T 00000000000000000000000000000000 P 60a3742891de4b53a6d1da73e2e9de00 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "60a3742891de4b53a6d1da73e2e9de00" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60a3742891de4b53a6d1da73e2e9de00" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46101 } } }
I20260810 15:25:26.599432 20835 sys_catalog.cc:458] T 00000000000000000000000000000000 P 60a3742891de4b53a6d1da73e2e9de00 [sys.catalog]: This master's current role is: LEADER
I20260810 15:25:26.599558 20846 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 15:25:26.600194 20846 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 15:25:26.602393 20846 catalog_manager.cc:1347] Generated new cluster ID: 25a4e5c8d50d40a8b41e0095aebc32b3
I20260810 15:25:26.602455 20846 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 15:25:26.604063 20825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:26.591336 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40470 (local address 127.18.68.190:46101)
0810 15:25:26.591517 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:26.591525 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:26.591552 (+ 27us) server_negotiation.cc:407] Connection header received
0810 15:25:26.592012 (+ 460us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:26.592019 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:26.592071 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:26.592203 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:26.593135 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:26.594689 (+ 1554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:26.595577 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:26.596303 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:26.596438 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:26.599767 (+ 3329us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:26.599772 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:26.599773 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:26.599788 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:26.602204 (+ 2416us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:26.602722 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:26.602725 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:26.602726 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:26.602834 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:26.603069 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:26.603070 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:26.603070 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:26.603343 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:26.603520 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:26.603666 (+ 146us) server_negotiation.cc:299] Negotiation successful
0810 15:25:26.603830 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":90,"threads_started":1}
I20260810 15:25:26.635337 20846 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 15:25:26.636179 20846 catalog_manager.cc:1504] Loading token signing keys...
I20260810 15:25:26.641956 20846 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 60a3742891de4b53a6d1da73e2e9de00: Generated new TSK 0
I20260810 15:25:26.642216 20846 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.18.68.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.68.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.68.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.129.keytab.
Entry for principal kudu/127.18.68.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.129.keytab.
I20260810 15:25:26.678556 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.68.129:0
--local_ip_for_outbound_sockets=127.18.68.129
--webserver_interface=127.18.68.129
--webserver_port=0
--tserver_master_addrs=127.18.68.190:46101
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.129.keytab
--principal=kudu/127.18.68.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:33911
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:25:26.767155 20863 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:25:26.767383 20863 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:25:26.767413 20863 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:25:26.768774 20863 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:25:26.768815 20863 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:25:26.768836 20863 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 15:25:26.768853 20863 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.68.129
I20260810 15:25:26.770273 20863 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:33911
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.129.keytab
--principal=kudu/127.18.68.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.68.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.68.129
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.18.68.190:46101
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20863
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.68.129
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:25:26.770460 20863 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:25:26.770650 20863 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:25:26.776165 20877 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:26.776196 20871 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:26.776206 20872 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:25:26.776456 20863 server_base.cc:1034] running on GCE node
I20260810 15:25:26.776698 20863 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:25:26.776957 20863 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:25:26.778167 20863 hybrid_clock.cc:648] HybridClock initialized: now 1786375526778150 us; error 29 us; skew 500 ppm
Aug 10 15:25:26 dist-test-slave-2p8l krb5kdc[20646](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375526, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:25:26.781134 20863 init.cc:377] Logged in from keytab as kudu/127.18.68.129@KRBTEST.COM (short username kudu)
I20260810 15:25:26.781605 20863 webserver.cc:460] Webserver started at http://127.18.68.129:45935/ using document root <none> and password file <none>
I20260810 15:25:26.781878 20863 fs_manager.cc:359] Metadata directory not provided
I20260810 15:25:26.781951 20863 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:25:26.782130 20863 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:25:26.783246 20863 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/minicluster-data/ts-0/data/instance:
uuid: "98e620e717bf43f79ca704b81843aa1e"
format_stamp: "Formatted at 2026-08-10 15:25:26 on dist-test-slave-2p8l"
server_key: "13508279db6eb4c7c18e49631e1ee75a"
server_key_iv: "28711427f62368518d75a1b6e23794b6"
server_key_version: "encryptionkey@0"
I20260810 15:25:26.783643 20863 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/minicluster-data/ts-0/wal/instance:
uuid: "98e620e717bf43f79ca704b81843aa1e"
format_stamp: "Formatted at 2026-08-10 15:25:26 on dist-test-slave-2p8l"
server_key: "13508279db6eb4c7c18e49631e1ee75a"
server_key_iv: "28711427f62368518d75a1b6e23794b6"
server_key_version: "encryptionkey@0"
I20260810 15:25:26.785041 20863 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 15:25:26.785919 20888 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:26.786171 20863 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:25:26.786279 20863 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/minicluster-data/ts-0/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/minicluster-data/ts-0/wal
uuid: "98e620e717bf43f79ca704b81843aa1e"
format_stamp: "Formatted at 2026-08-10 15:25:26 on dist-test-slave-2p8l"
server_key: "13508279db6eb4c7c18e49631e1ee75a"
server_key_iv: "28711427f62368518d75a1b6e23794b6"
server_key_version: "encryptionkey@0"
I20260810 15:25:26.786365 20863 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:25:26.806442 20863 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:25:26.808852 20863 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:25:26.809047 20863 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:25:26.809657 20863 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 15:25:26.809736 20863 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:26.809772 20863 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 15:25:26.809804 20863 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 10 15:25:26 dist-test-slave-2p8l krb5kdc[20646](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375526, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.129@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
I20260810 15:25:26.818291 20863 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.129:44591
I20260810 15:25:26.818372 21112 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.129:44591 every 8 connection(s)
I20260810 15:25:26.818691 20863 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/minicluster-data/ts-0/data/info.pb
I20260810 15:25:26.821182 20825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:26.810474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.129:58413 (local address 127.18.68.190:46101)
0810 15:25:26.810543 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:26.810546 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:26.810796 (+ 250us) server_negotiation.cc:407] Connection header received
0810 15:25:26.811342 (+ 546us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:26.811344 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:26.811360 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:26.811448 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:26.812493 (+ 1045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:26.813400 (+ 907us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:26.814892 (+ 1492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:26.815262 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:26.815365 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:26.818283 (+ 2918us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:26.818285 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:26.818285 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:26.818293 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:26.819983 (+ 1690us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:26.820387 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:26.820388 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:26.820388 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:26.820441 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:26.820652 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:26.820653 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:26.820653 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:26.820755 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:26.820805 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:26.821046 (+ 241us) server_negotiation.cc:299] Negotiation successful
0810 15:25:26.821117 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260810 15:25:26.821338 20906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:26.810450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46101 (local address 127.18.68.129:58413)
0810 15:25:26.810640 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:26.810687 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:26.811238 (+ 551us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:26.811569 (+ 331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:26.811576 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:26.812036 (+ 460us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:25:26.812375 (+ 339us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:26.812382 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:26.813516 (+ 1134us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:26.813517 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:26.814785 (+ 1268us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:26.814789 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:26.815388 (+ 599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:26.815389 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:26.815539 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:26.816130 (+ 591us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:25:26.816140 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:25:26.818182 (+ 2042us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:25:26.820073 (+ 1891us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:26.820079 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:26.820081 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:26.820319 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:26.820500 (+ 181us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:26.820500 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:26.820500 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:26.820597 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:26.820810 (+ 213us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:25:26.820815 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:25:26.820926 (+ 111us) client_negotiation.cc:769] Sending connection context
0810 15:25:26.821008 (+ 82us) client_negotiation.cc:240] Negotiation successful
0810 15:25:26.821151 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":111,"threads_started":1}
I20260810 15:25:26.821889 21113 heartbeater.cc:347] Connected to a master server at 127.18.68.190:46101
I20260810 15:25:26.822000 21113 heartbeater.cc:464] Registering TS with master...
I20260810 15:25:26.822237 21113 heartbeater.cc:511] Master 127.18.68.190:46101 requested a full tablet report, sending...
I20260810 15:25:26.822850 20725 ts_manager.cc:194] Registered new tserver with Master: 98e620e717bf43f79ca704b81843aa1e (127.18.68.129:44591)
I20260810 15:25:26.823764 20725 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.68.129@KRBTEST.COM'} at 127.18.68.129:58413
I20260810 15:25:26.824352 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 20863
I20260810 15:25:26.824460 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/minicluster-data/ts-0/wal/instance
I20260810 15:25:26.824668 18706 external_mini_cluster.cc:1428] Setting key 397aa853f1449eedeba463493434cd70
I20260810 15:25:26.829335 21133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:26.823153 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46101 (local address 127.18.68.129:48175)
0810 15:25:26.823305 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:26.823316 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:26.823376 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:26.823492 (+ 116us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:26.823492 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:26.823700 (+ 208us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:25:26.823773 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:26.823775 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:26.824581 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:26.824583 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:26.825264 (+ 681us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:26.825267 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:26.825632 (+ 365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:26.825632 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:26.825708 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:26.826171 (+ 463us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:25:26.826176 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:25:26.826463 (+ 287us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:25:26.828360 (+ 1897us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:26.828361 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:26.828361 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:26.828532 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:26.828751 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:26.828751 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:26.828751 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:26.828807 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:26.829076 (+ 269us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:25:26.829077 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:25:26.829114 (+ 37us) client_negotiation.cc:769] Sending connection context
0810 15:25:26.829179 (+ 65us) client_negotiation.cc:240] Negotiation successful
0810 15:25:26.829260 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":96,"threads_started":1}
I20260810 15:25:26.829535 20825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:26.823250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.129:48175 (local address 127.18.68.190:46101)
0810 15:25:26.823292 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:26.823294 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:26.823362 (+ 68us) server_negotiation.cc:407] Connection header received
0810 15:25:26.823429 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:26.823429 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:26.823437 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:26.823479 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:26.823877 (+ 398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:26.824452 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:26.825339 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:26.825545 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:26.825629 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:26.826574 (+ 945us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:26.826575 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:26.826576 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:26.826582 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:26.828271 (+ 1689us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:26.828609 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:26.828610 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:26.828611 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:26.828680 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:26.828873 (+ 193us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:26.828874 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:26.828874 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:26.829014 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:26.829081 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:26.829216 (+ 135us) server_negotiation.cc:299] Negotiation successful
0810 15:25:26.829299 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
WARNING: no policy specified for kudu/127.18.68.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.68.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.68.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.130.keytab.
Entry for principal kudu/127.18.68.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.130.keytab.
I20260810 15:25:26.852905 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.68.130:0
--local_ip_for_outbound_sockets=127.18.68.130
--webserver_interface=127.18.68.130
--webserver_port=0
--tserver_master_addrs=127.18.68.190:46101
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.130.keytab
--principal=kudu/127.18.68.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:33911
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:25:26.951536 21140 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:25:26.951761 21140 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:25:26.951800 21140 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:25:26.952975 21140 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:25:26.953047 21140 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:25:26.953083 21140 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 15:25:26.953114 21140 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.68.130
I20260810 15:25:26.954715 21140 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:33911
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.130.keytab
--principal=kudu/127.18.68.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.68.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.68.130
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.18.68.190:46101
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21140
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.68.130
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:25:26.955134 21140 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:25:26.955401 21140 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:25:26.961364 21150 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:26.961400 21155 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:26.961680 21149 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:25:26.962134 21140 server_base.cc:1034] running on GCE node
I20260810 15:25:26.962374 21140 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:25:26.962672 21140 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:25:26.963863 21140 hybrid_clock.cc:648] HybridClock initialized: now 1786375526963835 us; error 42 us; skew 500 ppm
Aug 10 15:25:26 dist-test-slave-2p8l krb5kdc[20646](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375526, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:25:26.967927 21140 init.cc:377] Logged in from keytab as kudu/127.18.68.130@KRBTEST.COM (short username kudu)
I20260810 15:25:26.970252 21140 webserver.cc:460] Webserver started at http://127.18.68.130:40631/ using document root <none> and password file <none>
I20260810 15:25:26.970506 21140 fs_manager.cc:359] Metadata directory not provided
I20260810 15:25:26.970628 21140 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:25:26.970804 21140 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:25:26.972445 21140 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/minicluster-data/ts-1/data/instance:
uuid: "1b841e65466449f880787c5210fb44c1"
format_stamp: "Formatted at 2026-08-10 15:25:26 on dist-test-slave-2p8l"
server_key: "028e0063a997eb07ebae192579dcc25c"
server_key_iv: "f4deaa76d988f7bbe62eed9f5b71adf8"
server_key_version: "encryptionkey@0"
I20260810 15:25:26.972987 21140 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/minicluster-data/ts-1/wal/instance:
uuid: "1b841e65466449f880787c5210fb44c1"
format_stamp: "Formatted at 2026-08-10 15:25:26 on dist-test-slave-2p8l"
server_key: "028e0063a997eb07ebae192579dcc25c"
server_key_iv: "f4deaa76d988f7bbe62eed9f5b71adf8"
server_key_version: "encryptionkey@0"
I20260810 15:25:26.974931 21140 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260810 15:25:26.976037 21165 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:26.976262 21140 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:25:26.976379 21140 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/minicluster-data/ts-1/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/minicluster-data/ts-1/wal
uuid: "1b841e65466449f880787c5210fb44c1"
format_stamp: "Formatted at 2026-08-10 15:25:26 on dist-test-slave-2p8l"
server_key: "028e0063a997eb07ebae192579dcc25c"
server_key_iv: "f4deaa76d988f7bbe62eed9f5b71adf8"
server_key_version: "encryptionkey@0"
I20260810 15:25:26.976469 21140 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:25:26.990633 21140 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:25:26.993741 21140 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:25:26.993925 21140 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:25:26.994690 21140 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 15:25:26.994755 21140 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:26.994791 21140 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 15:25:26.994817 21140 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 10 15:25:26 dist-test-slave-2p8l krb5kdc[20646](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375526, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.130@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
I20260810 15:25:27.003144 21140 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.130:34007
I20260810 15:25:27.003290 21387 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.130:34007 every 8 connection(s)
I20260810 15:25:27.003651 21140 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/minicluster-data/ts-1/data/info.pb
I20260810 15:25:27.004778 20825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:26.995048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.130:36451 (local address 127.18.68.190:46101)
0810 15:25:26.995093 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:26.995095 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:26.995364 (+ 269us) server_negotiation.cc:407] Connection header received
0810 15:25:26.996101 (+ 737us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:26.996102 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:26.996118 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:26.996176 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:26.996839 (+ 663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:26.997370 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:26.998554 (+ 1184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:26.998877 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:26.998967 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:27.001425 (+ 2458us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:27.001427 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:27.001427 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:27.001436 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:27.003222 (+ 1786us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:27.003787 (+ 565us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:27.003788 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:27.003788 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:27.003874 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:27.004213 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:27.004214 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:27.004214 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:27.004331 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:27.004387 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:27.004639 (+ 252us) server_negotiation.cc:299] Negotiation successful
0810 15:25:27.004711 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260810 15:25:27.005003 21180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:26.995043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46101 (local address 127.18.68.130:36451)
0810 15:25:26.995237 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:26.995273 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:26.995958 (+ 685us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:26.996243 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:26.996247 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:26.996502 (+ 255us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:25:26.996739 (+ 237us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:26.996745 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:26.997472 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:26.997473 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:26.998448 (+ 975us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:26.998451 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:26.998982 (+ 531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:26.998983 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:26.999152 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:26.999759 (+ 607us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:25:26.999768 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:25:27.001323 (+ 1555us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:25:27.003316 (+ 1993us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:27.003322 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:27.003324 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:27.003658 (+ 334us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:27.003956 (+ 298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:27.003958 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:27.003958 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:27.004112 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:27.004380 (+ 268us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:25:27.004383 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:25:27.004514 (+ 131us) client_negotiation.cc:769] Sending connection context
0810 15:25:27.004604 (+ 90us) client_negotiation.cc:240] Negotiation successful
0810 15:25:27.004733 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":132,"threads_started":1}
I20260810 15:25:27.005471 21388 heartbeater.cc:347] Connected to a master server at 127.18.68.190:46101
I20260810 15:25:27.005563 21388 heartbeater.cc:464] Registering TS with master...
I20260810 15:25:27.005766 21388 heartbeater.cc:511] Master 127.18.68.190:46101 requested a full tablet report, sending...
I20260810 15:25:27.006192 20726 ts_manager.cc:194] Registered new tserver with Master: 1b841e65466449f880787c5210fb44c1 (127.18.68.130:34007)
I20260810 15:25:27.006690 20726 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.68.130@KRBTEST.COM'} at 127.18.68.130:36451
I20260810 15:25:27.012255 21402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:27.006614 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46101 (local address 127.18.68.130:52133)
0810 15:25:27.006845 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:27.006858 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:27.006926 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:27.007033 (+ 107us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:27.007034 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:27.007255 (+ 221us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:25:27.007374 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:27.007376 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:27.008044 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:27.008044 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:27.008552 (+ 508us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:27.008553 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:27.008877 (+ 324us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:27.008877 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:27.008937 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:27.009347 (+ 410us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:25:27.009352 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:25:27.009623 (+ 271us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:25:27.011412 (+ 1789us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:27.011413 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:27.011413 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:27.011582 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:27.011736 (+ 154us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:27.011736 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:27.011737 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:27.011788 (+ 51us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:27.012009 (+ 221us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:25:27.012010 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:25:27.012045 (+ 35us) client_negotiation.cc:769] Sending connection context
0810 15:25:27.012096 (+ 51us) client_negotiation.cc:240] Negotiation successful
0810 15:25:27.012182 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":152,"threads_started":1}
I20260810 15:25:27.012324 20825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:27.006709 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.130:52133 (local address 127.18.68.190:46101)
0810 15:25:27.006755 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:27.006756 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:27.006910 (+ 154us) server_negotiation.cc:407] Connection header received
0810 15:25:27.006980 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:27.006980 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:27.006989 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:27.007051 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:27.007458 (+ 407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:27.007960 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:27.008623 (+ 663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:27.008812 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:27.008863 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:27.009710 (+ 847us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:27.009712 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:27.009712 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:27.009718 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:27.011340 (+ 1622us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:27.011639 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:27.011640 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:27.011640 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:27.011683 (+ 43us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:27.011835 (+ 152us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:27.011836 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:27.011836 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:27.011957 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:27.012004 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:27.012114 (+ 110us) server_negotiation.cc:299] Negotiation successful
0810 15:25:27.012177 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260810 15:25:27.012414 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 21140
I20260810 15:25:27.012496 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/minicluster-data/ts-1/wal/instance
I20260810 15:25:27.012679 18706 external_mini_cluster.cc:1428] Setting key 28a42a4983bdc12dc184330f53f6e876
WARNING: no policy specified for kudu/127.18.68.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.68.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.68.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.131.keytab.
Entry for principal kudu/127.18.68.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.131.keytab.
I20260810 15:25:27.039212 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.68.131:0
--local_ip_for_outbound_sockets=127.18.68.131
--webserver_interface=127.18.68.131
--webserver_port=0
--tserver_master_addrs=127.18.68.190:46101
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.131.keytab
--principal=kudu/127.18.68.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:33911
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:25:27.130291 21407 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:25:27.130512 21407 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:25:27.130539 21407 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:25:27.131795 21407 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:25:27.131834 21407 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:25:27.131857 21407 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 15:25:27.131877 21407 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.68.131
I20260810 15:25:27.133402 21407 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:33911
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.131.keytab
--principal=kudu/127.18.68.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.68.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.68.131
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.18.68.190:46101
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21407
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.68.131
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:25:27.133605 21407 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:25:27.133795 21407 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:25:27.139235 21419 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:27.139268 21416 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:27.139266 21417 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:25:27.139526 21407 server_base.cc:1034] running on GCE node
I20260810 15:25:27.139832 21407 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:25:27.140121 21407 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:25:27.141319 21407 hybrid_clock.cc:648] HybridClock initialized: now 1786375527141294 us; error 36 us; skew 500 ppm
Aug 10 15:25:27 dist-test-slave-2p8l krb5kdc[20646](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375527, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:25:27.144225 21407 init.cc:377] Logged in from keytab as kudu/127.18.68.131@KRBTEST.COM (short username kudu)
I20260810 15:25:27.144748 21407 webserver.cc:460] Webserver started at http://127.18.68.131:43353/ using document root <none> and password file <none>
I20260810 15:25:27.144948 21407 fs_manager.cc:359] Metadata directory not provided
I20260810 15:25:27.144990 21407 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:25:27.145092 21407 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:25:27.146250 21407 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/minicluster-data/ts-2/data/instance:
uuid: "a86d7365b4c3469aa053cd67d05e6e81"
format_stamp: "Formatted at 2026-08-10 15:25:27 on dist-test-slave-2p8l"
server_key: "e7e993f28545414bbf55ec623be1c209"
server_key_iv: "7dd7f8fddd3915c7cfe2df5614c1750d"
server_key_version: "encryptionkey@0"
I20260810 15:25:27.146598 21407 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/minicluster-data/ts-2/wal/instance:
uuid: "a86d7365b4c3469aa053cd67d05e6e81"
format_stamp: "Formatted at 2026-08-10 15:25:27 on dist-test-slave-2p8l"
server_key: "e7e993f28545414bbf55ec623be1c209"
server_key_iv: "7dd7f8fddd3915c7cfe2df5614c1750d"
server_key_version: "encryptionkey@0"
I20260810 15:25:27.148003 21407 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260810 15:25:27.148747 21431 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:27.148919 21407 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 15:25:27.149008 21407 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/minicluster-data/ts-2/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/minicluster-data/ts-2/wal
uuid: "a86d7365b4c3469aa053cd67d05e6e81"
format_stamp: "Formatted at 2026-08-10 15:25:27 on dist-test-slave-2p8l"
server_key: "e7e993f28545414bbf55ec623be1c209"
server_key_iv: "7dd7f8fddd3915c7cfe2df5614c1750d"
server_key_version: "encryptionkey@0"
I20260810 15:25:27.149060 21407 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:25:27.160290 21407 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:25:27.162530 21407 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:25:27.162717 21407 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:25:27.163169 21407 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 15:25:27.163205 21407 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:27.163228 21407 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 15:25:27.163241 21407 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 10 15:25:27 dist-test-slave-2p8l krb5kdc[20646](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375527, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.131@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
I20260810 15:25:27.171593 21407 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.131:35173
I20260810 15:25:27.171700 21647 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.131:35173 every 8 connection(s)
I20260810 15:25:27.172084 21407 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/minicluster-data/ts-2/data/info.pb
I20260810 15:25:27.174942 20825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:27.163824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.131:52649 (local address 127.18.68.190:46101)
0810 15:25:27.163885 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:27.163888 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:27.164096 (+ 208us) server_negotiation.cc:407] Connection header received
0810 15:25:27.164672 (+ 576us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:27.164674 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:27.164690 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:27.164775 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:27.165933 (+ 1158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:27.166977 (+ 1044us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:27.168662 (+ 1685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:27.169020 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:27.169102 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:27.172187 (+ 3085us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:27.172189 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:27.172189 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:27.172198 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:27.173652 (+ 1454us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:27.174051 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:27.174052 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:27.174052 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:27.174182 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:27.174427 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:27.174428 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:27.174428 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:27.174529 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:27.174579 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:27.174820 (+ 241us) server_negotiation.cc:299] Negotiation successful
0810 15:25:27.174881 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260810 15:25:27.175191 21449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:27.163790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46101 (local address 127.18.68.131:52649)
0810 15:25:27.163952 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:27.163988 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:27.164551 (+ 563us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:27.164911 (+ 360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:27.164918 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:27.165342 (+ 424us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:25:27.165780 (+ 438us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:27.165788 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:27.167085 (+ 1297us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:27.167086 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:27.168546 (+ 1460us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:27.168550 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:27.169138 (+ 588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:27.169139 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:27.169295 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:27.169835 (+ 540us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:25:27.169844 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:25:27.172069 (+ 2225us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:25:27.173732 (+ 1663us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:27.173739 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:27.173741 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:27.173978 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:27.174255 (+ 277us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:27.174256 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:27.174256 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:27.174364 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:27.174589 (+ 225us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:25:27.174594 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:25:27.174707 (+ 113us) client_negotiation.cc:769] Sending connection context
0810 15:25:27.174793 (+ 86us) client_negotiation.cc:240] Negotiation successful
0810 15:25:27.174916 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":78,"threads_started":1}
I20260810 15:25:27.175176 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 21407
I20260810 15:25:27.175277 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/minicluster-data/ts-2/wal/instance
I20260810 15:25:27.175487 18706 external_mini_cluster.cc:1428] Setting key cdc3b9d8af6f6b61957fc64811cbe823
I20260810 15:25:27.175807 21648 heartbeater.cc:347] Connected to a master server at 127.18.68.190:46101
I20260810 15:25:27.175899 21648 heartbeater.cc:464] Registering TS with master...
I20260810 15:25:27.176085 21648 heartbeater.cc:511] Master 127.18.68.190:46101 requested a full tablet report, sending...
I20260810 15:25:27.176400 20726 ts_manager.cc:194] Registered new tserver with Master: a86d7365b4c3469aa053cd67d05e6e81 (127.18.68.131:35173)
I20260810 15:25:27.176772 20726 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.68.131@KRBTEST.COM'} at 127.18.68.131:52649
I20260810 15:25:27.182227 21660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:27.176961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46101 (local address 127.18.68.131:47223)
0810 15:25:27.177176 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:27.177187 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:27.177252 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:27.177384 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:27.177385 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:27.177574 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:25:27.177628 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:27.177630 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:27.178301 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:27.178302 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:27.178773 (+ 471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:27.178774 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:27.179151 (+ 377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:27.179152 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:27.179220 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:27.179577 (+ 357us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:25:27.179581 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:25:27.179909 (+ 328us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:25:27.181143 (+ 1234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:27.181144 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:27.181144 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:27.181362 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:27.181606 (+ 244us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:27.181607 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:27.181607 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:27.181687 (+ 80us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:27.181952 (+ 265us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:25:27.181953 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:25:27.181986 (+ 33us) client_negotiation.cc:769] Sending connection context
0810 15:25:27.182029 (+ 43us) client_negotiation.cc:240] Negotiation successful
0810 15:25:27.182165 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":125,"threads_started":1}
I20260810 15:25:27.182251 20825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:27.177030 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.131:47223 (local address 127.18.68.190:46101)
0810 15:25:27.177112 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:27.177114 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:27.177268 (+ 154us) server_negotiation.cc:407] Connection header received
0810 15:25:27.177294 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:27.177295 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:27.177304 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:27.177360 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:27.177700 (+ 340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:27.178220 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:27.178864 (+ 644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:27.179075 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:27.179146 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:27.179991 (+ 845us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:27.179992 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:27.179992 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:27.179998 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:27.181073 (+ 1075us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:27.181449 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:27.181451 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:27.181451 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:27.181514 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:27.181781 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:27.181782 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:27.181782 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:27.181891 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:27.181959 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:27.182116 (+ 157us) server_negotiation.cc:299] Negotiation successful
0810 15:25:27.182197 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260810 15:25:27.187069 18706 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 10 15:25:27 dist-test-slave-2p8l krb5kdc[20646](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375527, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 10 15:25:27 dist-test-slave-2p8l krb5kdc[20646](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375527, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
I20260810 15:25:27.211062 20825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:27.204299 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40478 (local address 127.18.68.190:46101)
0810 15:25:27.204362 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:27.204364 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:27.204372 (+ 8us) server_negotiation.cc:407] Connection header received
0810 15:25:27.204393 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:27.204394 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:27.204402 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:27.204460 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:27.204995 (+ 535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:27.205540 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:27.206298 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:27.206476 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:27.206565 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:27.208646 (+ 2081us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:27.208648 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:27.208648 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:27.208655 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:27.210053 (+ 1398us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:27.210430 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:27.210431 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:27.210431 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:27.210485 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:27.210683 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:27.210683 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:27.210684 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:27.210780 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:27.210854 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:27.210943 (+ 89us) server_negotiation.cc:299] Negotiation successful
0810 15:25:27.210997 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260810 15:25:27.212883 20726 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40478:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 15:25:27.214629 20726 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 15:25:27.221419 21681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:27.217012 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.129:44591 (local address 127.0.0.1:36592)
0810 15:25:27.217557 (+ 545us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:27.217567 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:27.217614 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:27.217828 (+ 214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:27.217831 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:27.217833 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:25:27.217903 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:27.217905 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:27.218952 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:27.218953 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:27.220108 (+ 1155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:27.220111 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:27.221058 (+ 947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:27.221060 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:27.221148 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:27.221162 (+ 14us) client_negotiation.cc:769] Sending connection context
0810 15:25:27.221235 (+ 73us) client_negotiation.cc:240] Negotiation successful
0810 15:25:27.221291 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":528,"mutex_wait_us":4,"thread_start_us":73,"threads_started":1}
I20260810 15:25:27.221441 21680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:27.217165 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36592 (local address 127.18.68.129:44591)
0810 15:25:27.217623 (+ 458us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:27.217627 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:27.217638 (+ 11us) server_negotiation.cc:407] Connection header received
0810 15:25:27.217687 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:27.217689 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:27.217707 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:27.217806 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:25:27.217995 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:27.218850 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:27.220196 (+ 1346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:27.220962 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:27.221044 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:27.221098 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:27.221294 (+ 196us) server_negotiation.cc:299] Negotiation successful
0810 15:25:27.221334 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":425,"thread_start_us":128,"threads_started":1}
I20260810 15:25:27.221632 21685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:27.217398 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47996 (local address 127.18.68.131:35173)
0810 15:25:27.217936 (+ 538us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:27.217940 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:27.217951 (+ 11us) server_negotiation.cc:407] Connection header received
0810 15:25:27.217988 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:27.217990 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:27.218005 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:27.218156 (+ 151us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:25:27.218265 (+ 109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:27.219338 (+ 1073us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:27.220515 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:27.221043 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:27.221115 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:27.221172 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:27.221466 (+ 294us) server_negotiation.cc:299] Negotiation successful
0810 15:25:27.221513 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":502,"thread_start_us":106,"threads_started":1}
I20260810 15:25:27.221892 21684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:27.217372 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52204 (local address 127.18.68.130:34007)
0810 15:25:27.217572 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:27.217577 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:27.217649 (+ 72us) server_negotiation.cc:407] Connection header received
0810 15:25:27.217719 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:27.217721 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:27.217738 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:27.217837 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:25:27.218093 (+ 256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:27.219311 (+ 1218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:27.220633 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:27.221426 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:27.221495 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:27.221564 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:27.221757 (+ 193us) server_negotiation.cc:299] Negotiation successful
0810 15:25:27.221797 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":94,"threads_started":1}
I20260810 15:25:27.221884 21677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:27.217222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.130:34007 (local address 127.0.0.1:52204)
0810 15:25:27.217600 (+ 378us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:27.217609 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:27.217655 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:27.217915 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:27.217917 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:27.217919 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:25:27.217975 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:27.217977 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:27.219417 (+ 1440us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:27.219418 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:27.220531 (+ 1113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:27.220533 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:27.221599 (+ 1066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:27.221600 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:27.221657 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:27.221660 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 15:25:27.221727 (+ 67us) client_negotiation.cc:240] Negotiation successful
0810 15:25:27.221768 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":369,"mutex_wait_us":33,"thread_start_us":96,"threads_started":1}
I20260810 15:25:27.221792 21679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:27.217012 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.131:35173 (local address 127.0.0.1:47996)
0810 15:25:27.217387 (+ 375us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:27.217433 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:27.217499 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:27.218159 (+ 660us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:27.218160 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:27.218162 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:25:27.218200 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:27.218201 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:27.219423 (+ 1222us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:27.219424 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:27.220434 (+ 1010us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:27.220436 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:27.221214 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:27.221215 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:27.221308 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:27.221311 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 15:25:27.221360 (+ 49us) client_negotiation.cc:240] Negotiation successful
0810 15:25:27.221423 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":343,"mutex_wait_us":34,"thread_start_us":58,"threads_started":1}
I20260810 15:25:27.222819 21232 tablet_service.cc:1467] Processing CreateTablet for tablet 77c206f488f04ec7a0c42647f0f7e89c (DEFAULT_TABLE table=test-table [id=0c915845c1e448e08bed74399fbf8eb2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 15:25:27.222877 21529 tablet_service.cc:1467] Processing CreateTablet for tablet 77c206f488f04ec7a0c42647f0f7e89c (DEFAULT_TABLE table=test-table [id=0c915845c1e448e08bed74399fbf8eb2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 15:25:27.222877 20992 tablet_service.cc:1467] Processing CreateTablet for tablet 77c206f488f04ec7a0c42647f0f7e89c (DEFAULT_TABLE table=test-table [id=0c915845c1e448e08bed74399fbf8eb2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 15:25:27.223205 21232 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77c206f488f04ec7a0c42647f0f7e89c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:25:27.223294 20992 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77c206f488f04ec7a0c42647f0f7e89c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:25:27.223284 21529 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77c206f488f04ec7a0c42647f0f7e89c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:25:27.226230 21686 tablet_bootstrap.cc:492] T 77c206f488f04ec7a0c42647f0f7e89c P 1b841e65466449f880787c5210fb44c1: Bootstrap starting.
I20260810 15:25:27.226781 21692 tablet_bootstrap.cc:492] T 77c206f488f04ec7a0c42647f0f7e89c P a86d7365b4c3469aa053cd67d05e6e81: Bootstrap starting.
I20260810 15:25:27.227016 21686 tablet_bootstrap.cc:654] T 77c206f488f04ec7a0c42647f0f7e89c P 1b841e65466449f880787c5210fb44c1: Neither blocks nor log segments found. Creating new log.
I20260810 15:25:27.227191 21693 tablet_bootstrap.cc:492] T 77c206f488f04ec7a0c42647f0f7e89c P 98e620e717bf43f79ca704b81843aa1e: Bootstrap starting.
I20260810 15:25:27.227535 21686 log.cc:824] T 77c206f488f04ec7a0c42647f0f7e89c P 1b841e65466449f880787c5210fb44c1: Log is configured to *not* fsync() on all Append() calls
I20260810 15:25:27.227845 21692 tablet_bootstrap.cc:654] T 77c206f488f04ec7a0c42647f0f7e89c P a86d7365b4c3469aa053cd67d05e6e81: Neither blocks nor log segments found. Creating new log.
I20260810 15:25:27.227851 21693 tablet_bootstrap.cc:654] T 77c206f488f04ec7a0c42647f0f7e89c P 98e620e717bf43f79ca704b81843aa1e: Neither blocks nor log segments found. Creating new log.
I20260810 15:25:27.228241 21693 log.cc:824] T 77c206f488f04ec7a0c42647f0f7e89c P 98e620e717bf43f79ca704b81843aa1e: Log is configured to *not* fsync() on all Append() calls
I20260810 15:25:27.228267 21692 log.cc:824] T 77c206f488f04ec7a0c42647f0f7e89c P a86d7365b4c3469aa053cd67d05e6e81: Log is configured to *not* fsync() on all Append() calls
I20260810 15:25:27.228442 21686 tablet_bootstrap.cc:492] T 77c206f488f04ec7a0c42647f0f7e89c P 1b841e65466449f880787c5210fb44c1: No bootstrap required, opened a new log
I20260810 15:25:27.228513 21686 ts_tablet_manager.cc:1397] T 77c206f488f04ec7a0c42647f0f7e89c P 1b841e65466449f880787c5210fb44c1: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 15:25:27.229012 21693 tablet_bootstrap.cc:492] T 77c206f488f04ec7a0c42647f0f7e89c P 98e620e717bf43f79ca704b81843aa1e: No bootstrap required, opened a new log
I20260810 15:25:27.229074 21693 ts_tablet_manager.cc:1397] T 77c206f488f04ec7a0c42647f0f7e89c P 98e620e717bf43f79ca704b81843aa1e: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 15:25:27.230293 21686 raft_consensus.cc:348] T 77c206f488f04ec7a0c42647f0f7e89c P 1b841e65466449f880787c5210fb44c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a86d7365b4c3469aa053cd67d05e6e81" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 35173 } } peers { permanent_uuid: "98e620e717bf43f79ca704b81843aa1e" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 44591 } } peers { permanent_uuid: "1b841e65466449f880787c5210fb44c1" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 34007 } }
I20260810 15:25:27.230470 21686 raft_consensus.cc:374] T 77c206f488f04ec7a0c42647f0f7e89c P 1b841e65466449f880787c5210fb44c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:25:27.230509 21686 raft_consensus.cc:729] T 77c206f488f04ec7a0c42647f0f7e89c P 1b841e65466449f880787c5210fb44c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b841e65466449f880787c5210fb44c1, State: Initialized, Role: FOLLOWER
I20260810 15:25:27.230680 21692 tablet_bootstrap.cc:492] T 77c206f488f04ec7a0c42647f0f7e89c P a86d7365b4c3469aa053cd67d05e6e81: No bootstrap required, opened a new log
I20260810 15:25:27.230650 21686 consensus_queue.cc:260] T 77c206f488f04ec7a0c42647f0f7e89c P 1b841e65466449f880787c5210fb44c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a86d7365b4c3469aa053cd67d05e6e81" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 35173 } } peers { permanent_uuid: "98e620e717bf43f79ca704b81843aa1e" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 44591 } } peers { permanent_uuid: "1b841e65466449f880787c5210fb44c1" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 34007 } }
I20260810 15:25:27.230742 21692 ts_tablet_manager.cc:1397] T 77c206f488f04ec7a0c42647f0f7e89c P a86d7365b4c3469aa053cd67d05e6e81: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260810 15:25:27.230808 21693 raft_consensus.cc:348] T 77c206f488f04ec7a0c42647f0f7e89c P 98e620e717bf43f79ca704b81843aa1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a86d7365b4c3469aa053cd67d05e6e81" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 35173 } } peers { permanent_uuid: "98e620e717bf43f79ca704b81843aa1e" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 44591 } } peers { permanent_uuid: "1b841e65466449f880787c5210fb44c1" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 34007 } }
I20260810 15:25:27.230942 21686 ts_tablet_manager.cc:1428] T 77c206f488f04ec7a0c42647f0f7e89c P 1b841e65466449f880787c5210fb44c1: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 15:25:27.230988 21693 raft_consensus.cc:374] T 77c206f488f04ec7a0c42647f0f7e89c P 98e620e717bf43f79ca704b81843aa1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:25:27.231052 21693 raft_consensus.cc:729] T 77c206f488f04ec7a0c42647f0f7e89c P 98e620e717bf43f79ca704b81843aa1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98e620e717bf43f79ca704b81843aa1e, State: Initialized, Role: FOLLOWER
I20260810 15:25:27.231067 21388 heartbeater.cc:503] Master 127.18.68.190:46101 was elected leader, sending a full tablet report...
I20260810 15:25:27.231163 21693 consensus_queue.cc:260] T 77c206f488f04ec7a0c42647f0f7e89c P 98e620e717bf43f79ca704b81843aa1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a86d7365b4c3469aa053cd67d05e6e81" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 35173 } } peers { permanent_uuid: "98e620e717bf43f79ca704b81843aa1e" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 44591 } } peers { permanent_uuid: "1b841e65466449f880787c5210fb44c1" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 34007 } }
I20260810 15:25:27.231415 21693 ts_tablet_manager.cc:1428] T 77c206f488f04ec7a0c42647f0f7e89c P 98e620e717bf43f79ca704b81843aa1e: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260810 15:25:27.231479 21113 heartbeater.cc:503] Master 127.18.68.190:46101 was elected leader, sending a full tablet report...
I20260810 15:25:27.232755 21692 raft_consensus.cc:348] T 77c206f488f04ec7a0c42647f0f7e89c P a86d7365b4c3469aa053cd67d05e6e81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a86d7365b4c3469aa053cd67d05e6e81" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 35173 } } peers { permanent_uuid: "98e620e717bf43f79ca704b81843aa1e" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 44591 } } peers { permanent_uuid: "1b841e65466449f880787c5210fb44c1" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 34007 } }
I20260810 15:25:27.232869 21692 raft_consensus.cc:374] T 77c206f488f04ec7a0c42647f0f7e89c P a86d7365b4c3469aa053cd67d05e6e81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:25:27.232890 21692 raft_consensus.cc:729] T 77c206f488f04ec7a0c42647f0f7e89c P a86d7365b4c3469aa053cd67d05e6e81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a86d7365b4c3469aa053cd67d05e6e81, State: Initialized, Role: FOLLOWER
I20260810 15:25:27.232960 21692 consensus_queue.cc:260] T 77c206f488f04ec7a0c42647f0f7e89c P a86d7365b4c3469aa053cd67d05e6e81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a86d7365b4c3469aa053cd67d05e6e81" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 35173 } } peers { permanent_uuid: "98e620e717bf43f79ca704b81843aa1e" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 44591 } } peers { permanent_uuid: "1b841e65466449f880787c5210fb44c1" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 34007 } }
I20260810 15:25:27.233210 21692 ts_tablet_manager.cc:1428] T 77c206f488f04ec7a0c42647f0f7e89c P a86d7365b4c3469aa053cd67d05e6e81: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260810 15:25:27.233315 21648 heartbeater.cc:503] Master 127.18.68.190:46101 was elected leader, sending a full tablet report...
I20260810 15:25:27.249305 21701 raft_consensus.cc:482] T 77c206f488f04ec7a0c42647f0f7e89c P a86d7365b4c3469aa053cd67d05e6e81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 15:25:27.249432 21701 raft_consensus.cc:504] T 77c206f488f04ec7a0c42647f0f7e89c P a86d7365b4c3469aa053cd67d05e6e81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a86d7365b4c3469aa053cd67d05e6e81" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 35173 } } peers { permanent_uuid: "98e620e717bf43f79ca704b81843aa1e" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 44591 } } peers { permanent_uuid: "1b841e65466449f880787c5210fb44c1" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 34007 } }
I20260810 15:25:27.249780 21701 leader_election.cc:288] T 77c206f488f04ec7a0c42647f0f7e89c P a86d7365b4c3469aa053cd67d05e6e81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98e620e717bf43f79ca704b81843aa1e (127.18.68.129:44591), 1b841e65466449f880787c5210fb44c1 (127.18.68.130:34007)
I20260810 15:25:27.253201 21449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:27.250004 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.129:44591 (local address 127.18.68.131:59519)
0810 15:25:27.250086 (+ 82us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:27.250099 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:27.250147 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:27.250433 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:27.250434 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:27.250436 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:25:27.250517 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:27.250519 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:27.251476 (+ 957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:27.251481 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:27.252324 (+ 843us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:27.252327 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:27.252922 (+ 595us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:27.252923 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:27.253011 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:27.253015 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 15:25:27.253091 (+ 76us) client_negotiation.cc:240] Negotiation successful
0810 15:25:27.253130 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41,"mutex_wait_us":42}
I20260810 15:25:27.253211 21680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:27.250231 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.131:59519 (local address 127.18.68.129:44591)
0810 15:25:27.250303 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:27.250305 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:27.250312 (+ 7us) server_negotiation.cc:407] Connection header received
0810 15:25:27.250336 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:27.250337 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:27.250347 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:27.250402 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:25:27.250585 (+ 183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:27.251407 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:27.252431 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:27.252836 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:27.252925 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:27.252933 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:27.253101 (+ 168us) server_negotiation.cc:299] Negotiation successful
0810 15:25:27.253155 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260810 15:25:27.253398 21684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:27.250288 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.131:50817 (local address 127.18.68.130:34007)
0810 15:25:27.250622 (+ 334us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:27.250624 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:27.250633 (+ 9us) server_negotiation.cc:407] Connection header received
0810 15:25:27.250653 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:27.250654 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:27.250663 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:27.250711 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:25:27.250831 (+ 120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:27.251511 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:27.252600 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:27.252975 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:27.253078 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:27.253086 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:27.253265 (+ 179us) server_negotiation.cc:299] Negotiation successful
0810 15:25:27.253316 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":311}
I20260810 15:25:27.253549 21035 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77c206f488f04ec7a0c42647f0f7e89c" candidate_uuid: "a86d7365b4c3469aa053cd67d05e6e81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98e620e717bf43f79ca704b81843aa1e" is_pre_election: true
I20260810 15:25:27.253702 21035 raft_consensus.cc:2454] T 77c206f488f04ec7a0c42647f0f7e89c P 98e620e717bf43f79ca704b81843aa1e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a86d7365b4c3469aa053cd67d05e6e81 in term 0.
I20260810 15:25:27.253741 21704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:27.250151 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.130:34007 (local address 127.18.68.131:50817)
0810 15:25:27.250482 (+ 331us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:27.250492 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:27.250536 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:27.250714 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:27.250715 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:27.250716 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:25:27.250763 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:27.250764 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:27.251607 (+ 843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:27.251608 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:27.252500 (+ 892us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:27.252502 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:27.253085 (+ 583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:27.253086 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:27.253178 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:27.253181 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 15:25:27.253605 (+ 424us) client_negotiation.cc:240] Negotiation successful
0810 15:25:27.253639 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":315,"mutex_wait_us":2,"thread_start_us":117,"threads_started":1}
I20260810 15:25:27.253970 21438 leader_election.cc:302] T 77c206f488f04ec7a0c42647f0f7e89c P a86d7365b4c3469aa053cd67d05e6e81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98e620e717bf43f79ca704b81843aa1e, a86d7365b4c3469aa053cd67d05e6e81; no voters:
I20260810 15:25:27.254127 21701 raft_consensus.cc:2781] T 77c206f488f04ec7a0c42647f0f7e89c P a86d7365b4c3469aa053cd67d05e6e81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 15:25:27.254112 21269 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77c206f488f04ec7a0c42647f0f7e89c" candidate_uuid: "a86d7365b4c3469aa053cd67d05e6e81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b841e65466449f880787c5210fb44c1" is_pre_election: true
I20260810 15:25:27.254199 21701 raft_consensus.cc:482] T 77c206f488f04ec7a0c42647f0f7e89c P a86d7365b4c3469aa053cd67d05e6e81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 15:25:27.254226 21701 raft_consensus.cc:3037] T 77c206f488f04ec7a0c42647f0f7e89c P a86d7365b4c3469aa053cd67d05e6e81 [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:25:27.254262 21269 raft_consensus.cc:2454] T 77c206f488f04ec7a0c42647f0f7e89c P 1b841e65466449f880787c5210fb44c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a86d7365b4c3469aa053cd67d05e6e81 in term 0.
W20260810 15:25:27.254520 21389 tablet.cc:2369] T 77c206f488f04ec7a0c42647f0f7e89c P 1b841e65466449f880787c5210fb44c1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 15:25:27.255090 21701 raft_consensus.cc:504] T 77c206f488f04ec7a0c42647f0f7e89c P a86d7365b4c3469aa053cd67d05e6e81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a86d7365b4c3469aa053cd67d05e6e81" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 35173 } } peers { permanent_uuid: "98e620e717bf43f79ca704b81843aa1e" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 44591 } } peers { permanent_uuid: "1b841e65466449f880787c5210fb44c1" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 34007 } }
I20260810 15:25:27.255224 21701 leader_election.cc:288] T 77c206f488f04ec7a0c42647f0f7e89c P a86d7365b4c3469aa053cd67d05e6e81 [CANDIDATE]: Term 1 election: Requested vote from peers 98e620e717bf43f79ca704b81843aa1e (127.18.68.129:44591), 1b841e65466449f880787c5210fb44c1 (127.18.68.130:34007)
I20260810 15:25:27.255383 21035 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77c206f488f04ec7a0c42647f0f7e89c" candidate_uuid: "a86d7365b4c3469aa053cd67d05e6e81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98e620e717bf43f79ca704b81843aa1e"
I20260810 15:25:27.255393 21269 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77c206f488f04ec7a0c42647f0f7e89c" candidate_uuid: "a86d7365b4c3469aa053cd67d05e6e81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b841e65466449f880787c5210fb44c1"
I20260810 15:25:27.255460 21269 raft_consensus.cc:3037] T 77c206f488f04ec7a0c42647f0f7e89c P 1b841e65466449f880787c5210fb44c1 [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:25:27.255458 21035 raft_consensus.cc:3037] T 77c206f488f04ec7a0c42647f0f7e89c P 98e620e717bf43f79ca704b81843aa1e [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:25:27.256191 21035 raft_consensus.cc:2454] T 77c206f488f04ec7a0c42647f0f7e89c P 98e620e717bf43f79ca704b81843aa1e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a86d7365b4c3469aa053cd67d05e6e81 in term 1.
I20260810 15:25:27.256314 21269 raft_consensus.cc:2454] T 77c206f488f04ec7a0c42647f0f7e89c P 1b841e65466449f880787c5210fb44c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a86d7365b4c3469aa053cd67d05e6e81 in term 1.
I20260810 15:25:27.256353 21438 leader_election.cc:302] T 77c206f488f04ec7a0c42647f0f7e89c P a86d7365b4c3469aa053cd67d05e6e81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98e620e717bf43f79ca704b81843aa1e, a86d7365b4c3469aa053cd67d05e6e81; no voters:
I20260810 15:25:27.256465 21701 raft_consensus.cc:2781] T 77c206f488f04ec7a0c42647f0f7e89c P a86d7365b4c3469aa053cd67d05e6e81 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 15:25:27.256651 21701 raft_consensus.cc:686] T 77c206f488f04ec7a0c42647f0f7e89c P a86d7365b4c3469aa053cd67d05e6e81 [term 1 LEADER]: Becoming Leader. State: Replica: a86d7365b4c3469aa053cd67d05e6e81, State: Running, Role: LEADER
I20260810 15:25:27.256724 21701 consensus_queue.cc:237] T 77c206f488f04ec7a0c42647f0f7e89c P a86d7365b4c3469aa053cd67d05e6e81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a86d7365b4c3469aa053cd67d05e6e81" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 35173 } } peers { permanent_uuid: "98e620e717bf43f79ca704b81843aa1e" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 44591 } } peers { permanent_uuid: "1b841e65466449f880787c5210fb44c1" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 34007 } }
I20260810 15:25:27.257599 20725 catalog_manager.cc:5495] T 77c206f488f04ec7a0c42647f0f7e89c P a86d7365b4c3469aa053cd67d05e6e81 reported cstate change: term changed from 0 to 1, leader changed from <none> to a86d7365b4c3469aa053cd67d05e6e81 (127.18.68.131). New cstate: current_term: 1 leader_uuid: "a86d7365b4c3469aa053cd67d05e6e81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a86d7365b4c3469aa053cd67d05e6e81" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 35173 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98e620e717bf43f79ca704b81843aa1e" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 44591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1b841e65466449f880787c5210fb44c1" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 34007 } health_report { overall_health: UNKNOWN } } }
I20260810 15:25:27.271806 21685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:27.269213 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48006 (local address 127.18.68.131:35173)
0810 15:25:27.269271 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:27.269272 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:27.269282 (+ 10us) server_negotiation.cc:407] Connection header received
0810 15:25:27.269321 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:27.269322 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:27.269341 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:27.269397 (+ 56us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 15:25:27.269516 (+ 119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:27.269967 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:27.270853 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:27.271036 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:27.271093 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:27.271263 (+ 170us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 15:25:27.271344 (+ 81us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 15:25:27.271438 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:27.271469 (+ 31us) server_negotiation.cc:299] Negotiation successful
0810 15:25:27.271488 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260810 15:25:27.273581 21035 raft_consensus.cc:1261] T 77c206f488f04ec7a0c42647f0f7e89c P 98e620e717bf43f79ca704b81843aa1e [term 1 FOLLOWER]: Refusing update from remote peer a86d7365b4c3469aa053cd67d05e6e81: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 15:25:27.273592 21269 raft_consensus.cc:1261] T 77c206f488f04ec7a0c42647f0f7e89c P 1b841e65466449f880787c5210fb44c1 [term 1 FOLLOWER]: Refusing update from remote peer a86d7365b4c3469aa053cd67d05e6e81: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 15:25:27.273942 21706 consensus_queue.cc:1035] T 77c206f488f04ec7a0c42647f0f7e89c P a86d7365b4c3469aa053cd67d05e6e81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98e620e717bf43f79ca704b81843aa1e" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 44591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 15:25:27.274111 21701 consensus_queue.cc:1035] T 77c206f488f04ec7a0c42647f0f7e89c P a86d7365b4c3469aa053cd67d05e6e81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b841e65466449f880787c5210fb44c1" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 34007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 15:25:27.277418 21714 mvcc.cc:205] Tried to move back new op lower bound from 7316994159709794304 to 7316994159644278784. Current Snapshot: MvccSnapshot[applied={T|T < 7316994159709794304}]
I20260810 15:25:27.280877 20725 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40478:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 15:25:27.281031 20725 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40478:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 15:25:27.281920 20725 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 60a3742891de4b53a6d1da73e2e9de00: Sending DeleteTablet for 3 replicas of tablet 77c206f488f04ec7a0c42647f0f7e89c
I20260810 15:25:27.282281 20992 tablet_service.cc:1514] Processing DeleteTablet for tablet 77c206f488f04ec7a0c42647f0f7e89c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 15:25:27 UTC) from {username='kudu', principal='kudu/127.18.68.190@KRBTEST.COM'} at 127.0.0.1:36592
I20260810 15:25:27.282282 21529 tablet_service.cc:1514] Processing DeleteTablet for tablet 77c206f488f04ec7a0c42647f0f7e89c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 15:25:27 UTC) from {username='kudu', principal='kudu/127.18.68.190@KRBTEST.COM'} at 127.0.0.1:47996
I20260810 15:25:27.282356 21232 tablet_service.cc:1514] Processing DeleteTablet for tablet 77c206f488f04ec7a0c42647f0f7e89c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 15:25:27 UTC) from {username='kudu', principal='kudu/127.18.68.190@KRBTEST.COM'} at 127.0.0.1:52204
I20260810 15:25:27.282639 21735 tablet_replica.cc:330] T 77c206f488f04ec7a0c42647f0f7e89c P 1b841e65466449f880787c5210fb44c1: stopping tablet replica
I20260810 15:25:27.282747 21735 raft_consensus.cc:2229] T 77c206f488f04ec7a0c42647f0f7e89c P 1b841e65466449f880787c5210fb44c1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 15:25:27.282876 21735 raft_consensus.cc:2258] T 77c206f488f04ec7a0c42647f0f7e89c P 1b841e65466449f880787c5210fb44c1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 15:25:27.282858 20725 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40478:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 15:25:27.282997 20725 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 15:25:27.283401 21735 ts_tablet_manager.cc:1905] T 77c206f488f04ec7a0c42647f0f7e89c P 1b841e65466449f880787c5210fb44c1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 15:25:27.284487 21529 tablet_service.cc:1467] Processing CreateTablet for tablet 5b58f70ba75f48e4808736e29d43c4cb (DEFAULT_TABLE table=test-table [id=15e3cac899a24fbd9654150d9185d615]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 15:25:27.284543 20992 tablet_service.cc:1467] Processing CreateTablet for tablet 5b58f70ba75f48e4808736e29d43c4cb (DEFAULT_TABLE table=test-table [id=15e3cac899a24fbd9654150d9185d615]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 15:25:27.284550 21232 tablet_service.cc:1467] Processing CreateTablet for tablet 5b58f70ba75f48e4808736e29d43c4cb (DEFAULT_TABLE table=test-table [id=15e3cac899a24fbd9654150d9185d615]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 15:25:27.284631 21529 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5b58f70ba75f48e4808736e29d43c4cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:25:27.284651 20992 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5b58f70ba75f48e4808736e29d43c4cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:25:27.284663 21232 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5b58f70ba75f48e4808736e29d43c4cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:25:27.285641 21735 ts_tablet_manager.cc:1918] T 77c206f488f04ec7a0c42647f0f7e89c P 1b841e65466449f880787c5210fb44c1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 15:25:27.285704 21735 log.cc:1196] T 77c206f488f04ec7a0c42647f0f7e89c P 1b841e65466449f880787c5210fb44c1: Deleting WAL directory at /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/minicluster-data/ts-1/wal/wals/77c206f488f04ec7a0c42647f0f7e89c
I20260810 15:25:27.285965 21735 ts_tablet_manager.cc:1939] T 77c206f488f04ec7a0c42647f0f7e89c P 1b841e65466449f880787c5210fb44c1: Deleting consensus metadata
I20260810 15:25:27.286031 21686 tablet_bootstrap.cc:492] T 5b58f70ba75f48e4808736e29d43c4cb P 1b841e65466449f880787c5210fb44c1: Bootstrap starting.
I20260810 15:25:27.286207 21692 tablet_bootstrap.cc:492] T 5b58f70ba75f48e4808736e29d43c4cb P a86d7365b4c3469aa053cd67d05e6e81: Bootstrap starting.
I20260810 15:25:27.286263 21693 tablet_bootstrap.cc:492] T 5b58f70ba75f48e4808736e29d43c4cb P 98e620e717bf43f79ca704b81843aa1e: Bootstrap starting.
I20260810 15:25:27.286666 21686 tablet_bootstrap.cc:654] T 5b58f70ba75f48e4808736e29d43c4cb P 1b841e65466449f880787c5210fb44c1: Neither blocks nor log segments found. Creating new log.
I20260810 15:25:27.286690 21693 tablet_bootstrap.cc:654] T 5b58f70ba75f48e4808736e29d43c4cb P 98e620e717bf43f79ca704b81843aa1e: Neither blocks nor log segments found. Creating new log.
I20260810 15:25:27.286741 21692 tablet_bootstrap.cc:654] T 5b58f70ba75f48e4808736e29d43c4cb P a86d7365b4c3469aa053cd67d05e6e81: Neither blocks nor log segments found. Creating new log.
I20260810 15:25:27.287352 21693 tablet_bootstrap.cc:492] T 5b58f70ba75f48e4808736e29d43c4cb P 98e620e717bf43f79ca704b81843aa1e: No bootstrap required, opened a new log
I20260810 15:25:27.287367 20701 catalog_manager.cc:4841] TS 1b841e65466449f880787c5210fb44c1 (127.18.68.130:34007): tablet 77c206f488f04ec7a0c42647f0f7e89c (table test-table [id=0c915845c1e448e08bed74399fbf8eb2]) successfully deleted
I20260810 15:25:27.287424 21693 ts_tablet_manager.cc:1397] T 5b58f70ba75f48e4808736e29d43c4cb P 98e620e717bf43f79ca704b81843aa1e: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260810 15:25:27.287655 21693 raft_consensus.cc:348] T 5b58f70ba75f48e4808736e29d43c4cb P 98e620e717bf43f79ca704b81843aa1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98e620e717bf43f79ca704b81843aa1e" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 44591 } } peers { permanent_uuid: "1b841e65466449f880787c5210fb44c1" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 34007 } } peers { permanent_uuid: "a86d7365b4c3469aa053cd67d05e6e81" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 35173 } }
I20260810 15:25:27.287752 21693 raft_consensus.cc:374] T 5b58f70ba75f48e4808736e29d43c4cb P 98e620e717bf43f79ca704b81843aa1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:25:27.287788 21693 raft_consensus.cc:729] T 5b58f70ba75f48e4808736e29d43c4cb P 98e620e717bf43f79ca704b81843aa1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98e620e717bf43f79ca704b81843aa1e, State: Initialized, Role: FOLLOWER
I20260810 15:25:27.287854 21686 tablet_bootstrap.cc:492] T 5b58f70ba75f48e4808736e29d43c4cb P 1b841e65466449f880787c5210fb44c1: No bootstrap required, opened a new log
I20260810 15:25:27.287845 21693 consensus_queue.cc:260] T 5b58f70ba75f48e4808736e29d43c4cb P 98e620e717bf43f79ca704b81843aa1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98e620e717bf43f79ca704b81843aa1e" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 44591 } } peers { permanent_uuid: "1b841e65466449f880787c5210fb44c1" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 34007 } } peers { permanent_uuid: "a86d7365b4c3469aa053cd67d05e6e81" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 35173 } }
I20260810 15:25:27.287927 21686 ts_tablet_manager.cc:1397] T 5b58f70ba75f48e4808736e29d43c4cb P 1b841e65466449f880787c5210fb44c1: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260810 15:25:27.287941 21693 ts_tablet_manager.cc:1428] T 5b58f70ba75f48e4808736e29d43c4cb P 98e620e717bf43f79ca704b81843aa1e: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:27.288159 21686 raft_consensus.cc:348] T 5b58f70ba75f48e4808736e29d43c4cb P 1b841e65466449f880787c5210fb44c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98e620e717bf43f79ca704b81843aa1e" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 44591 } } peers { permanent_uuid: "1b841e65466449f880787c5210fb44c1" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 34007 } } peers { permanent_uuid: "a86d7365b4c3469aa053cd67d05e6e81" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 35173 } }
I20260810 15:25:27.288240 21686 raft_consensus.cc:374] T 5b58f70ba75f48e4808736e29d43c4cb P 1b841e65466449f880787c5210fb44c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:25:27.288261 21686 raft_consensus.cc:729] T 5b58f70ba75f48e4808736e29d43c4cb P 1b841e65466449f880787c5210fb44c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b841e65466449f880787c5210fb44c1, State: Initialized, Role: FOLLOWER
I20260810 15:25:27.288298 21686 consensus_queue.cc:260] T 5b58f70ba75f48e4808736e29d43c4cb P 1b841e65466449f880787c5210fb44c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98e620e717bf43f79ca704b81843aa1e" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 44591 } } peers { permanent_uuid: "1b841e65466449f880787c5210fb44c1" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 34007 } } peers { permanent_uuid: "a86d7365b4c3469aa053cd67d05e6e81" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 35173 } }
I20260810 15:25:27.288404 21686 ts_tablet_manager.cc:1428] T 5b58f70ba75f48e4808736e29d43c4cb P 1b841e65466449f880787c5210fb44c1: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260810 15:25:27.288655 21692 tablet_bootstrap.cc:492] T 5b58f70ba75f48e4808736e29d43c4cb P a86d7365b4c3469aa053cd67d05e6e81: No bootstrap required, opened a new log
I20260810 15:25:27.288712 21692 ts_tablet_manager.cc:1397] T 5b58f70ba75f48e4808736e29d43c4cb P a86d7365b4c3469aa053cd67d05e6e81: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260810 15:25:27.288884 21692 raft_consensus.cc:348] T 5b58f70ba75f48e4808736e29d43c4cb P a86d7365b4c3469aa053cd67d05e6e81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98e620e717bf43f79ca704b81843aa1e" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 44591 } } peers { permanent_uuid: "1b841e65466449f880787c5210fb44c1" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 34007 } } peers { permanent_uuid: "a86d7365b4c3469aa053cd67d05e6e81" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 35173 } }
I20260810 15:25:27.288964 21692 raft_consensus.cc:374] T 5b58f70ba75f48e4808736e29d43c4cb P a86d7365b4c3469aa053cd67d05e6e81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:25:27.288987 21692 raft_consensus.cc:729] T 5b58f70ba75f48e4808736e29d43c4cb P a86d7365b4c3469aa053cd67d05e6e81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a86d7365b4c3469aa053cd67d05e6e81, State: Initialized, Role: FOLLOWER
I20260810 15:25:27.289045 21692 consensus_queue.cc:260] T 5b58f70ba75f48e4808736e29d43c4cb P a86d7365b4c3469aa053cd67d05e6e81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98e620e717bf43f79ca704b81843aa1e" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 44591 } } peers { permanent_uuid: "1b841e65466449f880787c5210fb44c1" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 34007 } } peers { permanent_uuid: "a86d7365b4c3469aa053cd67d05e6e81" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 35173 } }
I20260810 15:25:27.289134 21692 ts_tablet_manager.cc:1428] T 5b58f70ba75f48e4808736e29d43c4cb P a86d7365b4c3469aa053cd67d05e6e81: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260810 15:25:27.290175 21731 tablet_replica.cc:330] T 77c206f488f04ec7a0c42647f0f7e89c P 98e620e717bf43f79ca704b81843aa1e: stopping tablet replica
I20260810 15:25:27.290184 21734 tablet_replica.cc:330] T 77c206f488f04ec7a0c42647f0f7e89c P a86d7365b4c3469aa053cd67d05e6e81: stopping tablet replica
I20260810 15:25:27.290298 21731 raft_consensus.cc:2229] T 77c206f488f04ec7a0c42647f0f7e89c P 98e620e717bf43f79ca704b81843aa1e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 15:25:27.290307 21734 raft_consensus.cc:2229] T 77c206f488f04ec7a0c42647f0f7e89c P a86d7365b4c3469aa053cd67d05e6e81 [term 1 LEADER]: Raft consensus shutting down.
I20260810 15:25:27.290403 21734 raft_consensus.cc:2258] T 77c206f488f04ec7a0c42647f0f7e89c P a86d7365b4c3469aa053cd67d05e6e81 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 15:25:27.290460 21731 raft_consensus.cc:2258] T 77c206f488f04ec7a0c42647f0f7e89c P 98e620e717bf43f79ca704b81843aa1e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 15:25:27.290866 21734 ts_tablet_manager.cc:1905] T 77c206f488f04ec7a0c42647f0f7e89c P a86d7365b4c3469aa053cd67d05e6e81: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 15:25:27.290951 21731 ts_tablet_manager.cc:1905] T 77c206f488f04ec7a0c42647f0f7e89c P 98e620e717bf43f79ca704b81843aa1e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 15:25:27.292326 21734 ts_tablet_manager.cc:1918] T 77c206f488f04ec7a0c42647f0f7e89c P a86d7365b4c3469aa053cd67d05e6e81: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 15:25:27.292411 21734 log.cc:1196] T 77c206f488f04ec7a0c42647f0f7e89c P a86d7365b4c3469aa053cd67d05e6e81: Deleting WAL directory at /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/minicluster-data/ts-2/wal/wals/77c206f488f04ec7a0c42647f0f7e89c
I20260810 15:25:27.292440 21731 ts_tablet_manager.cc:1918] T 77c206f488f04ec7a0c42647f0f7e89c P 98e620e717bf43f79ca704b81843aa1e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 15:25:27.292529 21731 log.cc:1196] T 77c206f488f04ec7a0c42647f0f7e89c P 98e620e717bf43f79ca704b81843aa1e: Deleting WAL directory at /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/minicluster-data/ts-0/wal/wals/77c206f488f04ec7a0c42647f0f7e89c
I20260810 15:25:27.292709 21734 ts_tablet_manager.cc:1939] T 77c206f488f04ec7a0c42647f0f7e89c P a86d7365b4c3469aa053cd67d05e6e81: Deleting consensus metadata
I20260810 15:25:27.292811 21731 ts_tablet_manager.cc:1939] T 77c206f488f04ec7a0c42647f0f7e89c P 98e620e717bf43f79ca704b81843aa1e: Deleting consensus metadata
I20260810 15:25:27.293128 20702 catalog_manager.cc:4841] TS a86d7365b4c3469aa053cd67d05e6e81 (127.18.68.131:35173): tablet 77c206f488f04ec7a0c42647f0f7e89c (table test-table [id=0c915845c1e448e08bed74399fbf8eb2]) successfully deleted
I20260810 15:25:27.293205 20701 catalog_manager.cc:4841] TS 98e620e717bf43f79ca704b81843aa1e (127.18.68.129:44591): tablet 77c206f488f04ec7a0c42647f0f7e89c (table test-table [id=0c915845c1e448e08bed74399fbf8eb2]) successfully deleted
I20260810 15:25:27.319316 21700 raft_consensus.cc:482] T 5b58f70ba75f48e4808736e29d43c4cb P 98e620e717bf43f79ca704b81843aa1e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 15:25:27.319440 21700 raft_consensus.cc:504] T 5b58f70ba75f48e4808736e29d43c4cb P 98e620e717bf43f79ca704b81843aa1e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98e620e717bf43f79ca704b81843aa1e" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 44591 } } peers { permanent_uuid: "1b841e65466449f880787c5210fb44c1" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 34007 } } peers { permanent_uuid: "a86d7365b4c3469aa053cd67d05e6e81" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 35173 } }
W20260810 15:25:27.319589 21115 tablet.cc:2369] T 5b58f70ba75f48e4808736e29d43c4cb P 98e620e717bf43f79ca704b81843aa1e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 15:25:27.319849 21700 leader_election.cc:288] T 5b58f70ba75f48e4808736e29d43c4cb P 98e620e717bf43f79ca704b81843aa1e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1b841e65466449f880787c5210fb44c1 (127.18.68.130:34007), a86d7365b4c3469aa053cd67d05e6e81 (127.18.68.131:35173)
I20260810 15:25:27.323760 21685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:27.320187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.129:39177 (local address 127.18.68.131:35173)
0810 15:25:27.320236 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:27.320238 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:27.320389 (+ 151us) server_negotiation.cc:407] Connection header received
0810 15:25:27.320497 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:27.320498 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:27.320508 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:27.320565 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:25:27.320759 (+ 194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:27.321496 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:27.322759 (+ 1263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:27.323348 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:27.323429 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:27.323438 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:27.323644 (+ 206us) server_negotiation.cc:299] Negotiation successful
0810 15:25:27.323686 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260810 15:25:27.323788 21742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:27.320039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.131:35173 (local address 127.18.68.129:39177)
0810 15:25:27.320328 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:27.320340 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:27.320400 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:27.320591 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:27.320592 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:27.320594 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:25:27.320667 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:27.320669 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:27.321570 (+ 901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:27.321571 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:27.322683 (+ 1112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:27.322687 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:27.323453 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:27.323454 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:27.323540 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:27.323545 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 15:25:27.323616 (+ 71us) client_negotiation.cc:240] Negotiation successful
0810 15:25:27.323661 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":274,"mutex_wait_us":171,"thread_start_us":67,"threads_started":1}
I20260810 15:25:27.323957 21684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:27.320152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.129:60327 (local address 127.18.68.130:34007)
0810 15:25:27.320204 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:27.320207 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:27.320218 (+ 11us) server_negotiation.cc:407] Connection header received
0810 15:25:27.320249 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:27.320250 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:27.320261 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:27.320326 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:25:27.320497 (+ 171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:27.321286 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:27.322896 (+ 1610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:27.323433 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:27.323495 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:27.323503 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:27.323825 (+ 322us) server_negotiation.cc:299] Negotiation successful
0810 15:25:27.323874 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260810 15:25:27.323787 20906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:27.320031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.130:34007 (local address 127.18.68.129:60327)
0810 15:25:27.320099 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:27.320111 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:27.320155 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:27.320337 (+ 182us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:27.320338 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:27.320340 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:25:27.320416 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:27.320418 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:27.321381 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:27.321382 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:27.322789 (+ 1407us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:27.322792 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:27.323496 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:27.323497 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:27.323582 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:27.323587 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 15:25:27.323653 (+ 66us) client_negotiation.cc:240] Negotiation successful
0810 15:25:27.323694 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":47}
I20260810 15:25:27.324374 21269 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b58f70ba75f48e4808736e29d43c4cb" candidate_uuid: "98e620e717bf43f79ca704b81843aa1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b841e65466449f880787c5210fb44c1" is_pre_election: true
I20260810 15:25:27.324491 21269 raft_consensus.cc:2454] T 5b58f70ba75f48e4808736e29d43c4cb P 1b841e65466449f880787c5210fb44c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98e620e717bf43f79ca704b81843aa1e in term 0.
I20260810 15:25:27.324497 21565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b58f70ba75f48e4808736e29d43c4cb" candidate_uuid: "98e620e717bf43f79ca704b81843aa1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a86d7365b4c3469aa053cd67d05e6e81" is_pre_election: true
I20260810 15:25:27.324679 20891 leader_election.cc:302] T 5b58f70ba75f48e4808736e29d43c4cb P 98e620e717bf43f79ca704b81843aa1e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b841e65466449f880787c5210fb44c1, 98e620e717bf43f79ca704b81843aa1e; no voters:
I20260810 15:25:27.324730 21565 raft_consensus.cc:2454] T 5b58f70ba75f48e4808736e29d43c4cb P a86d7365b4c3469aa053cd67d05e6e81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98e620e717bf43f79ca704b81843aa1e in term 0.
I20260810 15:25:27.324813 21700 raft_consensus.cc:2781] T 5b58f70ba75f48e4808736e29d43c4cb P 98e620e717bf43f79ca704b81843aa1e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 15:25:27.324855 21700 raft_consensus.cc:482] T 5b58f70ba75f48e4808736e29d43c4cb P 98e620e717bf43f79ca704b81843aa1e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 15:25:27.324880 21700 raft_consensus.cc:3037] T 5b58f70ba75f48e4808736e29d43c4cb P 98e620e717bf43f79ca704b81843aa1e [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:25:27.325598 21700 raft_consensus.cc:504] T 5b58f70ba75f48e4808736e29d43c4cb P 98e620e717bf43f79ca704b81843aa1e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98e620e717bf43f79ca704b81843aa1e" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 44591 } } peers { permanent_uuid: "1b841e65466449f880787c5210fb44c1" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 34007 } } peers { permanent_uuid: "a86d7365b4c3469aa053cd67d05e6e81" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 35173 } }
I20260810 15:25:27.325758 21700 leader_election.cc:288] T 5b58f70ba75f48e4808736e29d43c4cb P 98e620e717bf43f79ca704b81843aa1e [CANDIDATE]: Term 1 election: Requested vote from peers 1b841e65466449f880787c5210fb44c1 (127.18.68.130:34007), a86d7365b4c3469aa053cd67d05e6e81 (127.18.68.131:35173)
I20260810 15:25:27.325917 21269 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b58f70ba75f48e4808736e29d43c4cb" candidate_uuid: "98e620e717bf43f79ca704b81843aa1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b841e65466449f880787c5210fb44c1"
I20260810 15:25:27.325917 21565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b58f70ba75f48e4808736e29d43c4cb" candidate_uuid: "98e620e717bf43f79ca704b81843aa1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a86d7365b4c3469aa053cd67d05e6e81"
I20260810 15:25:27.325989 21565 raft_consensus.cc:3037] T 5b58f70ba75f48e4808736e29d43c4cb P a86d7365b4c3469aa053cd67d05e6e81 [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:25:27.325989 21269 raft_consensus.cc:3037] T 5b58f70ba75f48e4808736e29d43c4cb P 1b841e65466449f880787c5210fb44c1 [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:25:27.326807 21565 raft_consensus.cc:2454] T 5b58f70ba75f48e4808736e29d43c4cb P a86d7365b4c3469aa053cd67d05e6e81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98e620e717bf43f79ca704b81843aa1e in term 1.
I20260810 15:25:27.326807 21269 raft_consensus.cc:2454] T 5b58f70ba75f48e4808736e29d43c4cb P 1b841e65466449f880787c5210fb44c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98e620e717bf43f79ca704b81843aa1e in term 1.
I20260810 15:25:27.326983 20894 leader_election.cc:302] T 5b58f70ba75f48e4808736e29d43c4cb P 98e620e717bf43f79ca704b81843aa1e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98e620e717bf43f79ca704b81843aa1e, a86d7365b4c3469aa053cd67d05e6e81; no voters:
I20260810 15:25:27.327111 21700 raft_consensus.cc:2781] T 5b58f70ba75f48e4808736e29d43c4cb P 98e620e717bf43f79ca704b81843aa1e [term 1 FOLLOWER]: Leader election won for term 1
I20260810 15:25:27.327247 21700 raft_consensus.cc:686] T 5b58f70ba75f48e4808736e29d43c4cb P 98e620e717bf43f79ca704b81843aa1e [term 1 LEADER]: Becoming Leader. State: Replica: 98e620e717bf43f79ca704b81843aa1e, State: Running, Role: LEADER
I20260810 15:25:27.327322 21700 consensus_queue.cc:237] T 5b58f70ba75f48e4808736e29d43c4cb P 98e620e717bf43f79ca704b81843aa1e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98e620e717bf43f79ca704b81843aa1e" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 44591 } } peers { permanent_uuid: "1b841e65466449f880787c5210fb44c1" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 34007 } } peers { permanent_uuid: "a86d7365b4c3469aa053cd67d05e6e81" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 35173 } }
I20260810 15:25:27.328112 20723 catalog_manager.cc:5495] T 5b58f70ba75f48e4808736e29d43c4cb P 98e620e717bf43f79ca704b81843aa1e reported cstate change: term changed from 0 to 1, leader changed from <none> to 98e620e717bf43f79ca704b81843aa1e (127.18.68.129). New cstate: current_term: 1 leader_uuid: "98e620e717bf43f79ca704b81843aa1e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98e620e717bf43f79ca704b81843aa1e" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 44591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1b841e65466449f880787c5210fb44c1" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 34007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a86d7365b4c3469aa053cd67d05e6e81" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 35173 } health_report { overall_health: UNKNOWN } } }
Aug 10 15:25:27 dist-test-slave-2p8l krb5kdc[20646](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375526, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.190@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
I20260810 15:25:27.359788 20825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:27.350929 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40494 (local address 127.18.68.190:46101)
0810 15:25:27.350989 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:27.350991 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:27.351176 (+ 185us) server_negotiation.cc:407] Connection header received
0810 15:25:27.351247 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:27.351248 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:27.351261 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:27.351323 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:27.351987 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:27.352574 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:27.353666 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:27.353842 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:27.353892 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:27.356641 (+ 2749us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:27.356642 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:27.356642 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:27.356649 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:27.358470 (+ 1821us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:27.358969 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:27.358970 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:27.358970 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:27.359030 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:27.359277 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:27.359278 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:27.359278 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:27.359388 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:27.359451 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:27.359647 (+ 196us) server_negotiation.cc:299] Negotiation successful
0810 15:25:27.359722 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260810 15:25:27.359942 21753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:27.350874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46101 (local address 127.0.0.1:40494)
0810 15:25:27.351074 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:27.351085 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:27.351183 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:27.351358 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:27.351360 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:27.351828 (+ 468us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:25:27.351891 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:27.351894 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:27.352662 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:27.352663 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:27.353550 (+ 887us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:27.353554 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:27.353925 (+ 371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:27.353926 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:27.353995 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:27.354615 (+ 620us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:25:27.354649 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:25:27.356533 (+ 1884us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:25:27.358582 (+ 2049us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:27.358591 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:27.358594 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:27.358884 (+ 290us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:27.359106 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:27.359107 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:27.359107 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:27.359186 (+ 79us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:27.359468 (+ 282us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:25:27.359476 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:25:27.359531 (+ 55us) client_negotiation.cc:769] Sending connection context
0810 15:25:27.359614 (+ 83us) client_negotiation.cc:240] Negotiation successful
0810 15:25:27.359828 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"mutex_wait_us":78,"thread_start_us":93,"threads_started":1}
I20260810 15:25:27.362649 20723 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.18.68.190@KRBTEST.COM'} at 127.0.0.1:40494:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260810 15:25:27.362903 20723 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 15:25:27.364452 21232 tablet_service.cc:1467] Processing CreateTablet for tablet 110333c1527142368ff6b0c0cf351a04 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=7a5dd9d318c347cf869339e769557f2b]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 15:25:27.364440 20992 tablet_service.cc:1467] Processing CreateTablet for tablet 110333c1527142368ff6b0c0cf351a04 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=7a5dd9d318c347cf869339e769557f2b]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 15:25:27.364482 21529 tablet_service.cc:1467] Processing CreateTablet for tablet 110333c1527142368ff6b0c0cf351a04 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=7a5dd9d318c347cf869339e769557f2b]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 15:25:27.364622 20992 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 110333c1527142368ff6b0c0cf351a04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:25:27.364622 21232 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 110333c1527142368ff6b0c0cf351a04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:25:27.364677 21529 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 110333c1527142368ff6b0c0cf351a04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:25:27.368235 21686 tablet_bootstrap.cc:492] T 110333c1527142368ff6b0c0cf351a04 P 1b841e65466449f880787c5210fb44c1: Bootstrap starting.
I20260810 15:25:27.368798 21686 tablet_bootstrap.cc:654] T 110333c1527142368ff6b0c0cf351a04 P 1b841e65466449f880787c5210fb44c1: Neither blocks nor log segments found. Creating new log.
I20260810 15:25:27.369210 21692 tablet_bootstrap.cc:492] T 110333c1527142368ff6b0c0cf351a04 P a86d7365b4c3469aa053cd67d05e6e81: Bootstrap starting.
I20260810 15:25:27.369632 21692 tablet_bootstrap.cc:654] T 110333c1527142368ff6b0c0cf351a04 P a86d7365b4c3469aa053cd67d05e6e81: Neither blocks nor log segments found. Creating new log.
I20260810 15:25:27.369705 21686 tablet_bootstrap.cc:492] T 110333c1527142368ff6b0c0cf351a04 P 1b841e65466449f880787c5210fb44c1: No bootstrap required, opened a new log
I20260810 15:25:27.369778 21686 ts_tablet_manager.cc:1397] T 110333c1527142368ff6b0c0cf351a04 P 1b841e65466449f880787c5210fb44c1: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260810 15:25:27.369966 21686 raft_consensus.cc:348] T 110333c1527142368ff6b0c0cf351a04 P 1b841e65466449f880787c5210fb44c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98e620e717bf43f79ca704b81843aa1e" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 44591 } } peers { permanent_uuid: "1b841e65466449f880787c5210fb44c1" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 34007 } } peers { permanent_uuid: "a86d7365b4c3469aa053cd67d05e6e81" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 35173 } }
I20260810 15:25:27.370122 21686 raft_consensus.cc:374] T 110333c1527142368ff6b0c0cf351a04 P 1b841e65466449f880787c5210fb44c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:25:27.370167 21686 raft_consensus.cc:729] T 110333c1527142368ff6b0c0cf351a04 P 1b841e65466449f880787c5210fb44c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b841e65466449f880787c5210fb44c1, State: Initialized, Role: FOLLOWER
I20260810 15:25:27.370227 21686 consensus_queue.cc:260] T 110333c1527142368ff6b0c0cf351a04 P 1b841e65466449f880787c5210fb44c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98e620e717bf43f79ca704b81843aa1e" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 44591 } } peers { permanent_uuid: "1b841e65466449f880787c5210fb44c1" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 34007 } } peers { permanent_uuid: "a86d7365b4c3469aa053cd67d05e6e81" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 35173 } }
I20260810 15:25:27.370358 21686 ts_tablet_manager.cc:1428] T 110333c1527142368ff6b0c0cf351a04 P 1b841e65466449f880787c5210fb44c1: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260810 15:25:27.370419 21692 tablet_bootstrap.cc:492] T 110333c1527142368ff6b0c0cf351a04 P a86d7365b4c3469aa053cd67d05e6e81: No bootstrap required, opened a new log
I20260810 15:25:27.370474 21692 ts_tablet_manager.cc:1397] T 110333c1527142368ff6b0c0cf351a04 P a86d7365b4c3469aa053cd67d05e6e81: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260810 15:25:27.370553 21698 tablet_replica.cc:439] T 110333c1527142368ff6b0c0cf351a04 P 1b841e65466449f880787c5210fb44c1: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98e620e717bf43f79ca704b81843aa1e" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 44591 } } peers { permanent_uuid: "1b841e65466449f880787c5210fb44c1" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 34007 } } peers { permanent_uuid: "a86d7365b4c3469aa053cd67d05e6e81" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 35173 } } }
I20260810 15:25:27.370627 21692 raft_consensus.cc:348] T 110333c1527142368ff6b0c0cf351a04 P a86d7365b4c3469aa053cd67d05e6e81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98e620e717bf43f79ca704b81843aa1e" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 44591 } } peers { permanent_uuid: "1b841e65466449f880787c5210fb44c1" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 34007 } } peers { permanent_uuid: "a86d7365b4c3469aa053cd67d05e6e81" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 35173 } }
I20260810 15:25:27.370700 21698 tablet_replica.cc:442] T 110333c1527142368ff6b0c0cf351a04 P 1b841e65466449f880787c5210fb44c1: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 15:25:27.370728 21692 raft_consensus.cc:374] T 110333c1527142368ff6b0c0cf351a04 P a86d7365b4c3469aa053cd67d05e6e81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:25:27.370749 21692 raft_consensus.cc:729] T 110333c1527142368ff6b0c0cf351a04 P a86d7365b4c3469aa053cd67d05e6e81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a86d7365b4c3469aa053cd67d05e6e81, State: Initialized, Role: FOLLOWER
I20260810 15:25:27.370927 21692 consensus_queue.cc:260] T 110333c1527142368ff6b0c0cf351a04 P a86d7365b4c3469aa053cd67d05e6e81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98e620e717bf43f79ca704b81843aa1e" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 44591 } } peers { permanent_uuid: "1b841e65466449f880787c5210fb44c1" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 34007 } } peers { permanent_uuid: "a86d7365b4c3469aa053cd67d05e6e81" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 35173 } }
I20260810 15:25:27.371068 21692 ts_tablet_manager.cc:1428] T 110333c1527142368ff6b0c0cf351a04 P a86d7365b4c3469aa053cd67d05e6e81: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260810 15:25:27.371165 21693 tablet_bootstrap.cc:492] T 110333c1527142368ff6b0c0cf351a04 P 98e620e717bf43f79ca704b81843aa1e: Bootstrap starting.
I20260810 15:25:27.371184 21701 tablet_replica.cc:439] T 110333c1527142368ff6b0c0cf351a04 P a86d7365b4c3469aa053cd67d05e6e81: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98e620e717bf43f79ca704b81843aa1e" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 44591 } } peers { permanent_uuid: "1b841e65466449f880787c5210fb44c1" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 34007 } } peers { permanent_uuid: "a86d7365b4c3469aa053cd67d05e6e81" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 35173 } } }
I20260810 15:25:27.371260 21701 tablet_replica.cc:442] T 110333c1527142368ff6b0c0cf351a04 P a86d7365b4c3469aa053cd67d05e6e81: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 15:25:27.371608 21693 tablet_bootstrap.cc:654] T 110333c1527142368ff6b0c0cf351a04 P 98e620e717bf43f79ca704b81843aa1e: Neither blocks nor log segments found. Creating new log.
I20260810 15:25:27.372395 21693 tablet_bootstrap.cc:492] T 110333c1527142368ff6b0c0cf351a04 P 98e620e717bf43f79ca704b81843aa1e: No bootstrap required, opened a new log
I20260810 15:25:27.372462 21693 ts_tablet_manager.cc:1397] T 110333c1527142368ff6b0c0cf351a04 P 98e620e717bf43f79ca704b81843aa1e: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260810 15:25:27.372630 21693 raft_consensus.cc:348] T 110333c1527142368ff6b0c0cf351a04 P 98e620e717bf43f79ca704b81843aa1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98e620e717bf43f79ca704b81843aa1e" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 44591 } } peers { permanent_uuid: "1b841e65466449f880787c5210fb44c1" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 34007 } } peers { permanent_uuid: "a86d7365b4c3469aa053cd67d05e6e81" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 35173 } }
I20260810 15:25:27.372717 21693 raft_consensus.cc:374] T 110333c1527142368ff6b0c0cf351a04 P 98e620e717bf43f79ca704b81843aa1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:25:27.372743 21693 raft_consensus.cc:729] T 110333c1527142368ff6b0c0cf351a04 P 98e620e717bf43f79ca704b81843aa1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98e620e717bf43f79ca704b81843aa1e, State: Initialized, Role: FOLLOWER
I20260810 15:25:27.372798 21693 consensus_queue.cc:260] T 110333c1527142368ff6b0c0cf351a04 P 98e620e717bf43f79ca704b81843aa1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98e620e717bf43f79ca704b81843aa1e" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 44591 } } peers { permanent_uuid: "1b841e65466449f880787c5210fb44c1" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 34007 } } peers { permanent_uuid: "a86d7365b4c3469aa053cd67d05e6e81" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 35173 } }
I20260810 15:25:27.372910 21693 ts_tablet_manager.cc:1428] T 110333c1527142368ff6b0c0cf351a04 P 98e620e717bf43f79ca704b81843aa1e: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260810 15:25:27.372951 21700 tablet_replica.cc:439] T 110333c1527142368ff6b0c0cf351a04 P 98e620e717bf43f79ca704b81843aa1e: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98e620e717bf43f79ca704b81843aa1e" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 44591 } } peers { permanent_uuid: "1b841e65466449f880787c5210fb44c1" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 34007 } } peers { permanent_uuid: "a86d7365b4c3469aa053cd67d05e6e81" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 35173 } } }
I20260810 15:25:27.373075 21700 tablet_replica.cc:442] T 110333c1527142368ff6b0c0cf351a04 P 98e620e717bf43f79ca704b81843aa1e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 15:25:27.387298 21700 raft_consensus.cc:482] T 110333c1527142368ff6b0c0cf351a04 P 98e620e717bf43f79ca704b81843aa1e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 15:25:27.387393 21700 raft_consensus.cc:504] T 110333c1527142368ff6b0c0cf351a04 P 98e620e717bf43f79ca704b81843aa1e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98e620e717bf43f79ca704b81843aa1e" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 44591 } } peers { permanent_uuid: "1b841e65466449f880787c5210fb44c1" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 34007 } } peers { permanent_uuid: "a86d7365b4c3469aa053cd67d05e6e81" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 35173 } }
I20260810 15:25:27.387542 21700 leader_election.cc:288] T 110333c1527142368ff6b0c0cf351a04 P 98e620e717bf43f79ca704b81843aa1e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1b841e65466449f880787c5210fb44c1 (127.18.68.130:34007), a86d7365b4c3469aa053cd67d05e6e81 (127.18.68.131:35173)
I20260810 15:25:27.387701 21269 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "110333c1527142368ff6b0c0cf351a04" candidate_uuid: "98e620e717bf43f79ca704b81843aa1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b841e65466449f880787c5210fb44c1" is_pre_election: true
I20260810 15:25:27.387817 21269 raft_consensus.cc:2454] T 110333c1527142368ff6b0c0cf351a04 P 1b841e65466449f880787c5210fb44c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98e620e717bf43f79ca704b81843aa1e in term 0.
I20260810 15:25:27.387806 21565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "110333c1527142368ff6b0c0cf351a04" candidate_uuid: "98e620e717bf43f79ca704b81843aa1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a86d7365b4c3469aa053cd67d05e6e81" is_pre_election: true
I20260810 15:25:27.387893 21565 raft_consensus.cc:2454] T 110333c1527142368ff6b0c0cf351a04 P a86d7365b4c3469aa053cd67d05e6e81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98e620e717bf43f79ca704b81843aa1e in term 0.
I20260810 15:25:27.387966 20891 leader_election.cc:302] T 110333c1527142368ff6b0c0cf351a04 P 98e620e717bf43f79ca704b81843aa1e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b841e65466449f880787c5210fb44c1, 98e620e717bf43f79ca704b81843aa1e; no voters:
I20260810 15:25:27.388051 21700 raft_consensus.cc:2781] T 110333c1527142368ff6b0c0cf351a04 P 98e620e717bf43f79ca704b81843aa1e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 15:25:27.388087 21700 raft_consensus.cc:482] T 110333c1527142368ff6b0c0cf351a04 P 98e620e717bf43f79ca704b81843aa1e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 15:25:27.388129 21700 raft_consensus.cc:3037] T 110333c1527142368ff6b0c0cf351a04 P 98e620e717bf43f79ca704b81843aa1e [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:25:27.388839 21700 raft_consensus.cc:504] T 110333c1527142368ff6b0c0cf351a04 P 98e620e717bf43f79ca704b81843aa1e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98e620e717bf43f79ca704b81843aa1e" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 44591 } } peers { permanent_uuid: "1b841e65466449f880787c5210fb44c1" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 34007 } } peers { permanent_uuid: "a86d7365b4c3469aa053cd67d05e6e81" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 35173 } }
I20260810 15:25:27.388972 21700 leader_election.cc:288] T 110333c1527142368ff6b0c0cf351a04 P 98e620e717bf43f79ca704b81843aa1e [CANDIDATE]: Term 1 election: Requested vote from peers 1b841e65466449f880787c5210fb44c1 (127.18.68.130:34007), a86d7365b4c3469aa053cd67d05e6e81 (127.18.68.131:35173)
I20260810 15:25:27.389108 21269 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "110333c1527142368ff6b0c0cf351a04" candidate_uuid: "98e620e717bf43f79ca704b81843aa1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b841e65466449f880787c5210fb44c1"
I20260810 15:25:27.389215 21269 raft_consensus.cc:3037] T 110333c1527142368ff6b0c0cf351a04 P 1b841e65466449f880787c5210fb44c1 [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:25:27.389200 21565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "110333c1527142368ff6b0c0cf351a04" candidate_uuid: "98e620e717bf43f79ca704b81843aa1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a86d7365b4c3469aa053cd67d05e6e81"
I20260810 15:25:27.389302 21565 raft_consensus.cc:3037] T 110333c1527142368ff6b0c0cf351a04 P a86d7365b4c3469aa053cd67d05e6e81 [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:25:27.389864 21269 raft_consensus.cc:2454] T 110333c1527142368ff6b0c0cf351a04 P 1b841e65466449f880787c5210fb44c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98e620e717bf43f79ca704b81843aa1e in term 1.
I20260810 15:25:27.390043 20891 leader_election.cc:302] T 110333c1527142368ff6b0c0cf351a04 P 98e620e717bf43f79ca704b81843aa1e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b841e65466449f880787c5210fb44c1, 98e620e717bf43f79ca704b81843aa1e; no voters:
I20260810 15:25:27.390190 21700 raft_consensus.cc:2781] T 110333c1527142368ff6b0c0cf351a04 P 98e620e717bf43f79ca704b81843aa1e [term 1 FOLLOWER]: Leader election won for term 1
I20260810 15:25:27.390262 21565 raft_consensus.cc:2454] T 110333c1527142368ff6b0c0cf351a04 P a86d7365b4c3469aa053cd67d05e6e81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98e620e717bf43f79ca704b81843aa1e in term 1.
I20260810 15:25:27.390295 21700 raft_consensus.cc:686] T 110333c1527142368ff6b0c0cf351a04 P 98e620e717bf43f79ca704b81843aa1e [term 1 LEADER]: Becoming Leader. State: Replica: 98e620e717bf43f79ca704b81843aa1e, State: Running, Role: LEADER
I20260810 15:25:27.390348 21700 consensus_queue.cc:237] T 110333c1527142368ff6b0c0cf351a04 P 98e620e717bf43f79ca704b81843aa1e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98e620e717bf43f79ca704b81843aa1e" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 44591 } } peers { permanent_uuid: "1b841e65466449f880787c5210fb44c1" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 34007 } } peers { permanent_uuid: "a86d7365b4c3469aa053cd67d05e6e81" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 35173 } }
I20260810 15:25:27.390618 21700 tablet_replica.cc:439] T 110333c1527142368ff6b0c0cf351a04 P 98e620e717bf43f79ca704b81843aa1e: TxnStatusTablet state changed. Reason: New leader 98e620e717bf43f79ca704b81843aa1e. Latest consensus state: current_term: 1 leader_uuid: "98e620e717bf43f79ca704b81843aa1e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98e620e717bf43f79ca704b81843aa1e" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 44591 } } peers { permanent_uuid: "1b841e65466449f880787c5210fb44c1" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 34007 } } peers { permanent_uuid: "a86d7365b4c3469aa053cd67d05e6e81" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 35173 } } }
I20260810 15:25:27.390708 21700 tablet_replica.cc:442] T 110333c1527142368ff6b0c0cf351a04 P 98e620e717bf43f79ca704b81843aa1e: This TxnStatusTablet replica's current role is: LEADER
I20260810 15:25:27.390921 21760 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260810 15:25:27.391146 21760 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260810 15:25:27.391139 20723 catalog_manager.cc:5495] T 110333c1527142368ff6b0c0cf351a04 P 98e620e717bf43f79ca704b81843aa1e reported cstate change: term changed from 0 to 1, leader changed from <none> to 98e620e717bf43f79ca704b81843aa1e (127.18.68.129). New cstate: current_term: 1 leader_uuid: "98e620e717bf43f79ca704b81843aa1e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98e620e717bf43f79ca704b81843aa1e" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 44591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1b841e65466449f880787c5210fb44c1" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 34007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a86d7365b4c3469aa053cd67d05e6e81" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 35173 } health_report { overall_health: UNKNOWN } } }
I20260810 15:25:27.404690 21753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:27.400897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.129:44591 (local address 127.0.0.1:36606)
0810 15:25:27.400973 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:27.400989 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:27.401067 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:27.401332 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:27.401333 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:27.401334 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 15:25:27.401385 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:27.401388 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:27.402536 (+ 1148us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:27.402537 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:27.403489 (+ 952us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:27.403492 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:27.404062 (+ 570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:27.404063 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:27.404144 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:27.404162 (+ 18us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 15:25:27.404482 (+ 320us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 15:25:27.404491 (+ 9us) client_negotiation.cc:769] Sending connection context
0810 15:25:27.404553 (+ 62us) client_negotiation.cc:240] Negotiation successful
0810 15:25:27.404606 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28}
I20260810 15:25:27.404703 21680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:27.400802 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36606 (local address 127.18.68.129:44591)
0810 15:25:27.400852 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:27.400854 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:27.401036 (+ 182us) server_negotiation.cc:407] Connection header received
0810 15:25:27.401172 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:27.401174 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:27.401195 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:27.401240 (+ 45us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 15:25:27.401482 (+ 242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:27.402383 (+ 901us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:27.403569 (+ 1186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:27.403969 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:27.404053 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:27.404271 (+ 218us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 15:25:27.404403 (+ 132us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 15:25:27.404486 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:27.404558 (+ 72us) server_negotiation.cc:299] Negotiation successful
0810 15:25:27.404585 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260810 15:25:27.405954 21269 raft_consensus.cc:1261] T 110333c1527142368ff6b0c0cf351a04 P 1b841e65466449f880787c5210fb44c1 [term 1 FOLLOWER]: Refusing update from remote peer 98e620e717bf43f79ca704b81843aa1e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 15:25:27.406038 21565 raft_consensus.cc:1261] T 110333c1527142368ff6b0c0cf351a04 P a86d7365b4c3469aa053cd67d05e6e81 [term 1 FOLLOWER]: Refusing update from remote peer 98e620e717bf43f79ca704b81843aa1e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 15:25:27.406239 21700 consensus_queue.cc:1035] T 110333c1527142368ff6b0c0cf351a04 P 98e620e717bf43f79ca704b81843aa1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b841e65466449f880787c5210fb44c1" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 34007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 15:25:27.406395 21743 consensus_queue.cc:1035] T 110333c1527142368ff6b0c0cf351a04 P 98e620e717bf43f79ca704b81843aa1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a86d7365b4c3469aa053cd67d05e6e81" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 35173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 15:25:27.406957 21698 tablet_replica.cc:439] T 110333c1527142368ff6b0c0cf351a04 P 1b841e65466449f880787c5210fb44c1: TxnStatusTablet state changed. Reason: New leader 98e620e717bf43f79ca704b81843aa1e. Latest consensus state: current_term: 1 leader_uuid: "98e620e717bf43f79ca704b81843aa1e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98e620e717bf43f79ca704b81843aa1e" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 44591 } } peers { permanent_uuid: "1b841e65466449f880787c5210fb44c1" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 34007 } } peers { permanent_uuid: "a86d7365b4c3469aa053cd67d05e6e81" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 35173 } } }
I20260810 15:25:27.407064 21698 tablet_replica.cc:442] T 110333c1527142368ff6b0c0cf351a04 P 1b841e65466449f880787c5210fb44c1: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 15:25:27.407734 21701 tablet_replica.cc:439] T 110333c1527142368ff6b0c0cf351a04 P a86d7365b4c3469aa053cd67d05e6e81: TxnStatusTablet state changed. Reason: New leader 98e620e717bf43f79ca704b81843aa1e. Latest consensus state: current_term: 1 leader_uuid: "98e620e717bf43f79ca704b81843aa1e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98e620e717bf43f79ca704b81843aa1e" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 44591 } } peers { permanent_uuid: "1b841e65466449f880787c5210fb44c1" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 34007 } } peers { permanent_uuid: "a86d7365b4c3469aa053cd67d05e6e81" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 35173 } } }
I20260810 15:25:27.407836 21701 tablet_replica.cc:442] T 110333c1527142368ff6b0c0cf351a04 P a86d7365b4c3469aa053cd67d05e6e81: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 15:25:27.408962 21700 tablet_replica.cc:439] T 110333c1527142368ff6b0c0cf351a04 P 98e620e717bf43f79ca704b81843aa1e: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "98e620e717bf43f79ca704b81843aa1e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98e620e717bf43f79ca704b81843aa1e" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 44591 } } peers { permanent_uuid: "1b841e65466449f880787c5210fb44c1" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 34007 } } peers { permanent_uuid: "a86d7365b4c3469aa053cd67d05e6e81" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 35173 } } }
I20260810 15:25:27.409063 21700 tablet_replica.cc:442] T 110333c1527142368ff6b0c0cf351a04 P 98e620e717bf43f79ca704b81843aa1e: This TxnStatusTablet replica's current role is: LEADER
I20260810 15:25:27.409138 21712 mvcc.cc:205] Tried to move back new op lower bound from 7316994160252731392 to 7316994160191275008. Current Snapshot: MvccSnapshot[applied={T|T < 7316994160252731392}]
I20260810 15:25:27.409240 21701 tablet_replica.cc:439] T 110333c1527142368ff6b0c0cf351a04 P a86d7365b4c3469aa053cd67d05e6e81: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "98e620e717bf43f79ca704b81843aa1e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98e620e717bf43f79ca704b81843aa1e" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 44591 } } peers { permanent_uuid: "1b841e65466449f880787c5210fb44c1" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 34007 } } peers { permanent_uuid: "a86d7365b4c3469aa053cd67d05e6e81" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 35173 } } }
I20260810 15:25:27.409307 21701 tablet_replica.cc:442] T 110333c1527142368ff6b0c0cf351a04 P a86d7365b4c3469aa053cd67d05e6e81: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 15:25:27.410885 21700 tablet_replica.cc:439] T 110333c1527142368ff6b0c0cf351a04 P 98e620e717bf43f79ca704b81843aa1e: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "98e620e717bf43f79ca704b81843aa1e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98e620e717bf43f79ca704b81843aa1e" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 44591 } } peers { permanent_uuid: "1b841e65466449f880787c5210fb44c1" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 34007 } } peers { permanent_uuid: "a86d7365b4c3469aa053cd67d05e6e81" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 35173 } } }
I20260810 15:25:27.410972 21700 tablet_replica.cc:442] T 110333c1527142368ff6b0c0cf351a04 P 98e620e717bf43f79ca704b81843aa1e: This TxnStatusTablet replica's current role is: LEADER
I20260810 15:25:27.411341 21698 tablet_replica.cc:439] T 110333c1527142368ff6b0c0cf351a04 P 1b841e65466449f880787c5210fb44c1: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "98e620e717bf43f79ca704b81843aa1e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98e620e717bf43f79ca704b81843aa1e" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 44591 } } peers { permanent_uuid: "1b841e65466449f880787c5210fb44c1" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 34007 } } peers { permanent_uuid: "a86d7365b4c3469aa053cd67d05e6e81" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 35173 } } }
I20260810 15:25:27.411423 21713 mvcc.cc:205] Tried to move back new op lower bound from 7316994160252731392 to 7316994160191275008. Current Snapshot: MvccSnapshot[applied={T|T < 7316994160252731392}]
I20260810 15:25:27.411428 21698 tablet_replica.cc:442] T 110333c1527142368ff6b0c0cf351a04 P 1b841e65466449f880787c5210fb44c1: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 15:25:27.414588 21680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:27.411540 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36618 (local address 127.18.68.129:44591)
0810 15:25:27.411575 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:27.411577 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:27.411584 (+ 7us) server_negotiation.cc:407] Connection header received
0810 15:25:27.411605 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:27.411606 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:27.411615 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:27.411664 (+ 49us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 15:25:27.411952 (+ 288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:27.412671 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:27.413782 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:27.414103 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:27.414180 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:27.414340 (+ 160us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 15:25:27.414374 (+ 34us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 15:25:27.414430 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:27.414504 (+ 74us) server_negotiation.cc:299] Negotiation successful
0810 15:25:27.414523 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260810 15:25:27.420815 21680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:27.417567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.129:40521 (local address 127.18.68.129:44591)
0810 15:25:27.417600 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:27.417602 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:27.417797 (+ 195us) server_negotiation.cc:407] Connection header received
0810 15:25:27.417851 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:27.417852 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:27.417862 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:27.417921 (+ 59us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 15:25:27.418052 (+ 131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:27.418800 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:27.419990 (+ 1190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:27.420288 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:27.420362 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:27.420557 (+ 195us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 15:25:27.420588 (+ 31us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 15:25:27.420643 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:27.420698 (+ 55us) server_negotiation.cc:299] Negotiation successful
0810 15:25:27.420718 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260810 15:25:27.421080 21772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:27.417515 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.129:44591 (local address 127.18.68.129:40521)
0810 15:25:27.417717 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:27.417729 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:27.417801 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:27.417923 (+ 122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:27.417923 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:27.417925 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 15:25:27.417990 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:27.417991 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:27.418894 (+ 903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:27.418895 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:27.419896 (+ 1001us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:27.419898 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:27.420376 (+ 478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:27.420378 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:27.420451 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:27.420468 (+ 17us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 15:25:27.420651 (+ 183us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 15:25:27.420652 (+ 1us) client_negotiation.cc:769] Sending connection context
0810 15:25:27.420697 (+ 45us) client_negotiation.cc:240] Negotiation successful
0810 15:25:27.420741 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":85,"threads_started":1}
W20260810 15:25:27.422780 21649 tablet.cc:2369] T 5b58f70ba75f48e4808736e29d43c4cb P a86d7365b4c3469aa053cd67d05e6e81: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 15:25:27.423528 21564 raft_consensus.cc:1261] T 5b58f70ba75f48e4808736e29d43c4cb P a86d7365b4c3469aa053cd67d05e6e81 [term 1 FOLLOWER]: Refusing update from remote peer 98e620e717bf43f79ca704b81843aa1e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 15:25:27.423771 21743 consensus_queue.cc:1035] T 5b58f70ba75f48e4808736e29d43c4cb P 98e620e717bf43f79ca704b81843aa1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a86d7365b4c3469aa053cd67d05e6e81" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 35173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 15:25:27.423822 21269 raft_consensus.cc:1261] T 5b58f70ba75f48e4808736e29d43c4cb P 1b841e65466449f880787c5210fb44c1 [term 1 FOLLOWER]: Refusing update from remote peer 98e620e717bf43f79ca704b81843aa1e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 15:25:27.423988 21743 consensus_queue.cc:1035] T 5b58f70ba75f48e4808736e29d43c4cb P 98e620e717bf43f79ca704b81843aa1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b841e65466449f880787c5210fb44c1" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 34007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 15:25:27.440435 20723 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40478:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 15:25:27.440541 20723 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40478:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 15:25:27.441227 20723 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 60a3742891de4b53a6d1da73e2e9de00: Sending DeleteTablet for 3 replicas of tablet 5b58f70ba75f48e4808736e29d43c4cb
I20260810 15:25:27.441475 21529 tablet_service.cc:1514] Processing DeleteTablet for tablet 5b58f70ba75f48e4808736e29d43c4cb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 15:25:27 UTC) from {username='kudu', principal='kudu/127.18.68.190@KRBTEST.COM'} at 127.0.0.1:47996
I20260810 15:25:27.441495 20991 tablet_service.cc:1514] Processing DeleteTablet for tablet 5b58f70ba75f48e4808736e29d43c4cb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 15:25:27 UTC) from {username='kudu', principal='kudu/127.18.68.190@KRBTEST.COM'} at 127.0.0.1:36592
I20260810 15:25:27.441578 21731 tablet_replica.cc:330] T 5b58f70ba75f48e4808736e29d43c4cb P 98e620e717bf43f79ca704b81843aa1e: stopping tablet replica
I20260810 15:25:27.441578 21734 tablet_replica.cc:330] T 5b58f70ba75f48e4808736e29d43c4cb P a86d7365b4c3469aa053cd67d05e6e81: stopping tablet replica
I20260810 15:25:27.441625 21731 raft_consensus.cc:2229] T 5b58f70ba75f48e4808736e29d43c4cb P 98e620e717bf43f79ca704b81843aa1e [term 1 LEADER]: Raft consensus shutting down.
I20260810 15:25:27.441632 21734 raft_consensus.cc:2229] T 5b58f70ba75f48e4808736e29d43c4cb P a86d7365b4c3469aa053cd67d05e6e81 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 15:25:27.441679 21734 raft_consensus.cc:2258] T 5b58f70ba75f48e4808736e29d43c4cb P a86d7365b4c3469aa053cd67d05e6e81 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 15:25:27.441711 21731 raft_consensus.cc:2258] T 5b58f70ba75f48e4808736e29d43c4cb P 98e620e717bf43f79ca704b81843aa1e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 15:25:27.442003 21731 ts_tablet_manager.cc:1905] T 5b58f70ba75f48e4808736e29d43c4cb P 98e620e717bf43f79ca704b81843aa1e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 15:25:27.443657 21731 ts_tablet_manager.cc:1918] T 5b58f70ba75f48e4808736e29d43c4cb P 98e620e717bf43f79ca704b81843aa1e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 15:25:27.443725 21731 log.cc:1196] T 5b58f70ba75f48e4808736e29d43c4cb P 98e620e717bf43f79ca704b81843aa1e: Deleting WAL directory at /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/minicluster-data/ts-0/wal/wals/5b58f70ba75f48e4808736e29d43c4cb
I20260810 15:25:27.443711 21232 tablet_service.cc:1514] Processing DeleteTablet for tablet 5b58f70ba75f48e4808736e29d43c4cb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 15:25:27 UTC) from {username='kudu', principal='kudu/127.18.68.190@KRBTEST.COM'} at 127.0.0.1:52204
I20260810 15:25:27.443827 21735 tablet_replica.cc:330] T 5b58f70ba75f48e4808736e29d43c4cb P 1b841e65466449f880787c5210fb44c1: stopping tablet replica
I20260810 15:25:27.443890 21735 raft_consensus.cc:2229] T 5b58f70ba75f48e4808736e29d43c4cb P 1b841e65466449f880787c5210fb44c1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 15:25:27.443957 21735 raft_consensus.cc:2258] T 5b58f70ba75f48e4808736e29d43c4cb P 1b841e65466449f880787c5210fb44c1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 15:25:27.443985 21731 ts_tablet_manager.cc:1939] T 5b58f70ba75f48e4808736e29d43c4cb P 98e620e717bf43f79ca704b81843aa1e: Deleting consensus metadata
I20260810 15:25:27.444295 20701 catalog_manager.cc:4841] TS 98e620e717bf43f79ca704b81843aa1e (127.18.68.129:44591): tablet 5b58f70ba75f48e4808736e29d43c4cb (table test-table [id=15e3cac899a24fbd9654150d9185d615]) successfully deleted
I20260810 15:25:27.444362 21735 ts_tablet_manager.cc:1905] T 5b58f70ba75f48e4808736e29d43c4cb P 1b841e65466449f880787c5210fb44c1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 15:25:27.444579 21734 ts_tablet_manager.cc:1905] T 5b58f70ba75f48e4808736e29d43c4cb P a86d7365b4c3469aa053cd67d05e6e81: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 15:25:27.445935 21735 ts_tablet_manager.cc:1918] T 5b58f70ba75f48e4808736e29d43c4cb P 1b841e65466449f880787c5210fb44c1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 15:25:27.445977 21735 log.cc:1196] T 5b58f70ba75f48e4808736e29d43c4cb P 1b841e65466449f880787c5210fb44c1: Deleting WAL directory at /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/minicluster-data/ts-1/wal/wals/5b58f70ba75f48e4808736e29d43c4cb
I20260810 15:25:27.446172 21734 ts_tablet_manager.cc:1918] T 5b58f70ba75f48e4808736e29d43c4cb P a86d7365b4c3469aa053cd67d05e6e81: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 15:25:27.446245 21734 log.cc:1196] T 5b58f70ba75f48e4808736e29d43c4cb P a86d7365b4c3469aa053cd67d05e6e81: Deleting WAL directory at /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786375520124696-18706-0/minicluster-data/ts-2/wal/wals/5b58f70ba75f48e4808736e29d43c4cb
I20260810 15:25:27.446264 21735 ts_tablet_manager.cc:1939] T 5b58f70ba75f48e4808736e29d43c4cb P 1b841e65466449f880787c5210fb44c1: Deleting consensus metadata
I20260810 15:25:27.446475 21734 ts_tablet_manager.cc:1939] T 5b58f70ba75f48e4808736e29d43c4cb P a86d7365b4c3469aa053cd67d05e6e81: Deleting consensus metadata
I20260810 15:25:27.446610 20701 catalog_manager.cc:4841] TS 1b841e65466449f880787c5210fb44c1 (127.18.68.130:34007): tablet 5b58f70ba75f48e4808736e29d43c4cb (table test-table [id=15e3cac899a24fbd9654150d9185d615]) successfully deleted
I20260810 15:25:27.446759 20702 catalog_manager.cc:4841] TS a86d7365b4c3469aa053cd67d05e6e81 (127.18.68.131:35173): tablet 5b58f70ba75f48e4808736e29d43c4cb (table test-table [id=15e3cac899a24fbd9654150d9185d615]) successfully deleted
Aug 10 15:25:27 dist-test-slave-2p8l krb5kdc[20646](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375527, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.18.68.129@KRBTEST.COM
I20260810 15:25:27.453514 21680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:27.442668 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36624 (local address 127.18.68.129:44591)
0810 15:25:27.443574 (+ 906us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:27.443576 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:27.443784 (+ 208us) server_negotiation.cc:407] Connection header received
0810 15:25:27.444242 (+ 458us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:27.444243 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:27.444254 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:27.444287 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:27.445089 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:27.445788 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:27.446946 (+ 1158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:27.447280 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:27.447356 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:27.450273 (+ 2917us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:27.450282 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:27.450283 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:27.450291 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:27.452267 (+ 1976us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:27.452606 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:27.452611 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:27.452611 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:27.452694 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:27.452898 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:27.452899 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:27.452899 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:27.453083 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:27.453273 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:27.453317 (+ 44us) server_negotiation.cc:299] Negotiation successful
0810 15:25:27.453405 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":885}
W20260810 15:25:27.453821 21105 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36624
I20260810 15:25:27.460779 20825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:27.454807 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40510 (local address 127.18.68.190:46101)
0810 15:25:27.454857 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:27.454859 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:27.454869 (+ 10us) server_negotiation.cc:407] Connection header received
0810 15:25:27.454931 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:27.454932 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:27.454942 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:27.454997 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:27.455489 (+ 492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:27.455963 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:27.456649 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:27.456860 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:27.456945 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:27.458251 (+ 1306us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:27.458253 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:27.458253 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:27.458261 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:27.459592 (+ 1331us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:27.459970 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:27.459971 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:27.459971 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:27.460038 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:27.460252 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:27.460253 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:27.460254 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:27.460367 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:27.460468 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:27.460598 (+ 130us) server_negotiation.cc:299] Negotiation successful
0810 15:25:27.460679 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
W20260810 15:25:27.460990 20723 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40510
I20260810 15:25:27.461597 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 20863
I20260810 15:25:27.473253 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 21140
I20260810 15:25:27.484858 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 21407
I20260810 15:25:27.499635 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 20670
2026-08-10T15:25:27Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (2481 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 15:25:27 dist-test-slave-2p8l krb5kdc[21793](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 15:25:27 dist-test-slave-2p8l krb5kdc[21793](info): set up 2 sockets
Aug 10 15:25:27 dist-test-slave-2p8l krb5kdc[21793](info): commencing operation
krb5kdc: starting...
W20260810 15:25:28.806968 18706 mini_kdc.cc:121] Time spent starting KDC: real 1.279s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/krb5kdc/test-user.keytab.
Aug 10 15:25:28 dist-test-slave-2p8l krb5kdc[21793](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375528, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T15:25:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T15:25:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.68.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.68.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.68.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab.
Entry for principal kudu/127.18.68.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab.
I20260810 15:25:28.933154 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.190:41667
--webserver_interface=127.18.68.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab
--principal=kudu/127.18.68.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:44199
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.68.190:41667
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:25:29.016314 21814 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:25:29.016543 21814 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:25:29.016566 21814 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:25:29.017693 21814 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 15:25:29.017735 21814 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260810 15:25:29.017748 21814 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:25:29.017761 21814 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:25:29.017773 21814 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 15:25:29.017786 21814 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 15:25:29.019245 21814 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:44199
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.68.190:41667
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab
--principal=kudu/127.18.68.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.190:41667
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.68.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21814
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:25:29.019454 21814 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:25:29.019629 21814 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:25:29.024758 21830 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:29.024827 21825 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:29.024832 21826 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:25:29.024895 21814 server_base.cc:1034] running on GCE node
I20260810 15:25:29.025233 21814 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:25:29.025545 21814 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:25:29.026736 21814 hybrid_clock.cc:648] HybridClock initialized: now 1786375529026661 us; error 86 us; skew 500 ppm
Aug 10 15:25:29 dist-test-slave-2p8l krb5kdc[21793](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375529, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:25:29.029603 21814 init.cc:377] Logged in from keytab as kudu/127.18.68.190@KRBTEST.COM (short username kudu)
I20260810 15:25:29.030220 21814 webserver.cc:460] Webserver started at http://127.18.68.190:43859/ using document root <none> and password file <none>
I20260810 15:25:29.030459 21814 fs_manager.cc:359] Metadata directory not provided
I20260810 15:25:29.030529 21814 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:25:29.030679 21814 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:25:29.031777 21814 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/minicluster-data/master-0/data/instance:
uuid: "511c7f22094c4364b143e11cf834e945"
format_stamp: "Formatted at 2026-08-10 15:25:29 on dist-test-slave-2p8l"
server_key: "55f08480b1a0ccba5f640ade37931be4"
server_key_iv: "4b61c14f25faa41f4db279c35b26e4dd"
server_key_version: "encryptionkey@0"
I20260810 15:25:29.032176 21814 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/minicluster-data/master-0/wal/instance:
uuid: "511c7f22094c4364b143e11cf834e945"
format_stamp: "Formatted at 2026-08-10 15:25:29 on dist-test-slave-2p8l"
server_key: "55f08480b1a0ccba5f640ade37931be4"
server_key_iv: "4b61c14f25faa41f4db279c35b26e4dd"
server_key_version: "encryptionkey@0"
I20260810 15:25:29.033573 21814 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 15:25:29.034456 21841 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:29.034632 21814 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260810 15:25:29.034775 21814 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/minicluster-data/master-0/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/minicluster-data/master-0/wal
uuid: "511c7f22094c4364b143e11cf834e945"
format_stamp: "Formatted at 2026-08-10 15:25:29 on dist-test-slave-2p8l"
server_key: "55f08480b1a0ccba5f640ade37931be4"
server_key_iv: "4b61c14f25faa41f4db279c35b26e4dd"
server_key_version: "encryptionkey@0"
I20260810 15:25:29.034855 21814 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:25:29.056629 21814 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:25:29.059185 21814 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:25:29.059356 21814 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:25:29.064922 21814 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.190:41667
I20260810 15:25:29.064989 21949 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.190:41667 every 8 connection(s)
I20260810 15:25:29.065327 21814 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
I20260810 15:25:29.066012 21950 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:25:29.068385 21950 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 511c7f22094c4364b143e11cf834e945: Bootstrap starting.
I20260810 15:25:29.068953 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 21814
I20260810 15:25:29.068974 21950 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 511c7f22094c4364b143e11cf834e945: Neither blocks nor log segments found. Creating new log.
I20260810 15:25:29.069061 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/minicluster-data/master-0/wal/instance
I20260810 15:25:29.069245 18706 external_mini_cluster.cc:1428] Setting key 7fdaaeaa9b8ae690754e20f41db931ce
I20260810 15:25:29.069301 21950 log.cc:824] T 00000000000000000000000000000000 P 511c7f22094c4364b143e11cf834e945: Log is configured to *not* fsync() on all Append() calls
I20260810 15:25:29.070262 21950 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 511c7f22094c4364b143e11cf834e945: No bootstrap required, opened a new log
I20260810 15:25:29.072530 21950 raft_consensus.cc:348] T 00000000000000000000000000000000 P 511c7f22094c4364b143e11cf834e945 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "511c7f22094c4364b143e11cf834e945" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 41667 } }
I20260810 15:25:29.072707 21950 raft_consensus.cc:374] T 00000000000000000000000000000000 P 511c7f22094c4364b143e11cf834e945 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:25:29.072745 21950 raft_consensus.cc:729] T 00000000000000000000000000000000 P 511c7f22094c4364b143e11cf834e945 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 511c7f22094c4364b143e11cf834e945, State: Initialized, Role: FOLLOWER
I20260810 15:25:29.072870 21950 consensus_queue.cc:260] T 00000000000000000000000000000000 P 511c7f22094c4364b143e11cf834e945 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "511c7f22094c4364b143e11cf834e945" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 41667 } }
I20260810 15:25:29.072939 21950 raft_consensus.cc:388] T 00000000000000000000000000000000 P 511c7f22094c4364b143e11cf834e945 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 15:25:29.072969 21950 raft_consensus.cc:482] T 00000000000000000000000000000000 P 511c7f22094c4364b143e11cf834e945 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 15:25:29.073016 21950 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 511c7f22094c4364b143e11cf834e945 [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:25:29.073710 21950 raft_consensus.cc:504] T 00000000000000000000000000000000 P 511c7f22094c4364b143e11cf834e945 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "511c7f22094c4364b143e11cf834e945" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 41667 } }
I20260810 15:25:29.073803 21950 leader_election.cc:302] T 00000000000000000000000000000000 P 511c7f22094c4364b143e11cf834e945 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 511c7f22094c4364b143e11cf834e945; no voters:
I20260810 15:25:29.074025 21950 leader_election.cc:288] T 00000000000000000000000000000000 P 511c7f22094c4364b143e11cf834e945 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 15:25:29.074100 21956 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 511c7f22094c4364b143e11cf834e945 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 15:25:29.074261 21956 raft_consensus.cc:686] T 00000000000000000000000000000000 P 511c7f22094c4364b143e11cf834e945 [term 1 LEADER]: Becoming Leader. State: Replica: 511c7f22094c4364b143e11cf834e945, State: Running, Role: LEADER
I20260810 15:25:29.074363 21950 sys_catalog.cc:564] T 00000000000000000000000000000000 P 511c7f22094c4364b143e11cf834e945 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 15:25:29.074350 21956 consensus_queue.cc:237] T 00000000000000000000000000000000 P 511c7f22094c4364b143e11cf834e945 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "511c7f22094c4364b143e11cf834e945" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 41667 } }
I20260810 15:25:29.074720 21959 sys_catalog.cc:455] T 00000000000000000000000000000000 P 511c7f22094c4364b143e11cf834e945 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 511c7f22094c4364b143e11cf834e945. Latest consensus state: current_term: 1 leader_uuid: "511c7f22094c4364b143e11cf834e945" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "511c7f22094c4364b143e11cf834e945" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 41667 } } }
I20260810 15:25:29.074823 21959 sys_catalog.cc:458] T 00000000000000000000000000000000 P 511c7f22094c4364b143e11cf834e945 [sys.catalog]: This master's current role is: LEADER
I20260810 15:25:29.075444 21965 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 15:25:29.076190 21965 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 15:25:29.076217 21960 sys_catalog.cc:455] T 00000000000000000000000000000000 P 511c7f22094c4364b143e11cf834e945 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "511c7f22094c4364b143e11cf834e945" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "511c7f22094c4364b143e11cf834e945" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 41667 } } }
I20260810 15:25:29.077854 21960 sys_catalog.cc:458] T 00000000000000000000000000000000 P 511c7f22094c4364b143e11cf834e945 [sys.catalog]: This master's current role is: LEADER
I20260810 15:25:29.078039 21965 catalog_manager.cc:1347] Generated new cluster ID: 6692cd8ed9f84168b46bc9446269df23
I20260810 15:25:29.078130 21965 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 10 15:25:29 dist-test-slave-2p8l krb5kdc[21793](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375528, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
I20260810 15:25:29.082517 21955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:29.069804 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58306 (local address 127.18.68.190:41667)
0810 15:25:29.069995 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:29.070004 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:29.070039 (+ 35us) server_negotiation.cc:407] Connection header received
0810 15:25:29.070683 (+ 644us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:29.070692 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:29.070757 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:29.070913 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:29.071545 (+ 632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:29.073466 (+ 1921us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:29.074605 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:29.075364 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:29.075483 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:29.078714 (+ 3231us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:29.078718 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:29.078718 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:29.078731 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:29.080504 (+ 1773us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:29.080905 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:29.080909 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:29.080909 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:29.081003 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:29.081231 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:29.081232 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:29.081233 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:29.081498 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:29.082191 (+ 693us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:29.082258 (+ 67us) server_negotiation.cc:299] Negotiation successful
0810 15:25:29.082369 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":89,"threads_started":1}
I20260810 15:25:29.094261 21965 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 15:25:29.094892 21965 catalog_manager.cc:1504] Loading token signing keys...
I20260810 15:25:29.119890 21965 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 511c7f22094c4364b143e11cf834e945: Generated new TSK 0
I20260810 15:25:29.120347 21965 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.18.68.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.68.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.68.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.129.keytab.
Entry for principal kudu/127.18.68.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.129.keytab.
I20260810 15:25:29.158813 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.68.129:0
--local_ip_for_outbound_sockets=127.18.68.129
--webserver_interface=127.18.68.129
--webserver_port=0
--tserver_master_addrs=127.18.68.190:41667
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.129.keytab
--principal=kudu/127.18.68.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:44199
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:25:29.259209 21997 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:25:29.259426 21997 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:25:29.259451 21997 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:25:29.260519 21997 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:25:29.260556 21997 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:25:29.260576 21997 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260810 15:25:29.260588 21997 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 15:25:29.260605 21997 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.68.129
I20260810 15:25:29.262034 21997 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:44199
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.129.keytab
--principal=kudu/127.18.68.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.68.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.68.129
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.18.68.190:41667
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21997
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.68.129
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:25:29.262256 21997 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:25:29.262435 21997 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:25:29.267568 22008 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:29.267544 22015 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:29.267554 22011 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:25:29.267918 21997 server_base.cc:1034] running on GCE node
I20260810 15:25:29.268167 21997 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:25:29.268437 21997 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:25:29.269605 21997 hybrid_clock.cc:648] HybridClock initialized: now 1786375529269599 us; error 39 us; skew 500 ppm
Aug 10 15:25:29 dist-test-slave-2p8l krb5kdc[21793](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375529, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:25:29.272253 21997 init.cc:377] Logged in from keytab as kudu/127.18.68.129@KRBTEST.COM (short username kudu)
I20260810 15:25:29.272782 21997 webserver.cc:460] Webserver started at http://127.18.68.129:44645/ using document root <none> and password file <none>
I20260810 15:25:29.273016 21997 fs_manager.cc:359] Metadata directory not provided
I20260810 15:25:29.273085 21997 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:25:29.273224 21997 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:25:29.274372 21997 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/minicluster-data/ts-0/data/instance:
uuid: "e934fc72e9bf430895b18ddfddac2c7d"
format_stamp: "Formatted at 2026-08-10 15:25:29 on dist-test-slave-2p8l"
server_key: "9ba9fa553bcd16bfe915b3c106aa64a1"
server_key_iv: "46787835fd674333a05534971e23c0e5"
server_key_version: "encryptionkey@0"
I20260810 15:25:29.274744 21997 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/minicluster-data/ts-0/wal/instance:
uuid: "e934fc72e9bf430895b18ddfddac2c7d"
format_stamp: "Formatted at 2026-08-10 15:25:29 on dist-test-slave-2p8l"
server_key: "9ba9fa553bcd16bfe915b3c106aa64a1"
server_key_iv: "46787835fd674333a05534971e23c0e5"
server_key_version: "encryptionkey@0"
I20260810 15:25:29.276357 21997 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:25:29.277215 22025 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:29.277424 21997 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:25:29.277525 21997 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/minicluster-data/ts-0/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/minicluster-data/ts-0/wal
uuid: "e934fc72e9bf430895b18ddfddac2c7d"
format_stamp: "Formatted at 2026-08-10 15:25:29 on dist-test-slave-2p8l"
server_key: "9ba9fa553bcd16bfe915b3c106aa64a1"
server_key_iv: "46787835fd674333a05534971e23c0e5"
server_key_version: "encryptionkey@0"
I20260810 15:25:29.277609 21997 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:25:29.303169 21997 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:25:29.305532 21997 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:25:29.305759 21997 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:25:29.306509 21997 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 15:25:29.306565 21997 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:29.306613 21997 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 15:25:29.306627 21997 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 10 15:25:29 dist-test-slave-2p8l krb5kdc[21793](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375529, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.129@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
I20260810 15:25:29.315506 21997 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.129:35749
I20260810 15:25:29.315605 22233 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.129:35749 every 8 connection(s)
I20260810 15:25:29.315924 21997 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/minicluster-data/ts-0/data/info.pb
I20260810 15:25:29.318418 21955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:29.306880 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.129:39791 (local address 127.18.68.190:41667)
0810 15:25:29.306929 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:29.306932 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:29.307316 (+ 384us) server_negotiation.cc:407] Connection header received
0810 15:25:29.308189 (+ 873us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:29.308191 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:29.308203 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:29.308268 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:29.309262 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:29.309774 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:29.311539 (+ 1765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:29.311872 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:29.311982 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:29.315373 (+ 3391us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:29.315375 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:29.315375 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:29.315384 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:29.317098 (+ 1714us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:29.317490 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:29.317491 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:29.317491 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:29.317544 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:29.317772 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:29.317773 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:29.317773 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:29.317884 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:29.317945 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:29.318281 (+ 336us) server_negotiation.cc:299] Negotiation successful
0810 15:25:29.318352 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260810 15:25:29.318583 22035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:29.306879 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:41667 (local address 127.18.68.129:39791)
0810 15:25:29.307119 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:29.307188 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:29.308006 (+ 818us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:29.308374 (+ 368us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:29.308379 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:29.308802 (+ 423us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:25:29.309144 (+ 342us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:29.309151 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:29.309888 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:29.309890 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:29.311422 (+ 1532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:29.311426 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:29.312064 (+ 638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:29.312066 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:29.312243 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:29.313080 (+ 837us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:25:29.313093 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:25:29.315248 (+ 2155us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:25:29.317196 (+ 1948us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:29.317202 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:29.317204 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:29.317420 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:29.317613 (+ 193us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:29.317614 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:29.317614 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:29.317713 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:29.317941 (+ 228us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:25:29.317946 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:25:29.318123 (+ 177us) client_negotiation.cc:769] Sending connection context
0810 15:25:29.318249 (+ 126us) client_negotiation.cc:240] Negotiation successful
0810 15:25:29.318377 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":130,"threads_started":1}
I20260810 15:25:29.319137 22234 heartbeater.cc:347] Connected to a master server at 127.18.68.190:41667
I20260810 15:25:29.319226 22234 heartbeater.cc:464] Registering TS with master...
I20260810 15:25:29.319413 22234 heartbeater.cc:511] Master 127.18.68.190:41667 requested a full tablet report, sending...
I20260810 15:25:29.319972 21867 ts_manager.cc:194] Registered new tserver with Master: e934fc72e9bf430895b18ddfddac2c7d (127.18.68.129:35749)
I20260810 15:25:29.320906 21867 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.68.129@KRBTEST.COM'} at 127.18.68.129:39791
I20260810 15:25:29.325843 21955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:29.320330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.129:53933 (local address 127.18.68.190:41667)
0810 15:25:29.320372 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:29.320373 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:29.320441 (+ 68us) server_negotiation.cc:407] Connection header received
0810 15:25:29.320508 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:29.320509 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:29.320516 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:29.320558 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:29.320939 (+ 381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:29.321534 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:29.322329 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:29.322504 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:29.322558 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:29.323469 (+ 911us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:29.323470 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:29.323470 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:29.323475 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:29.324882 (+ 1407us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:29.325213 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:29.325214 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:29.325214 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:29.325265 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:29.325435 (+ 170us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:29.325436 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:29.325436 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:29.325529 (+ 93us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:29.325580 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:29.325707 (+ 127us) server_negotiation.cc:299] Negotiation successful
0810 15:25:29.325784 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260810 15:25:29.325896 22244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:29.320236 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:41667 (local address 127.18.68.129:53933)
0810 15:25:29.320381 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:29.320393 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:29.320454 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:29.320573 (+ 119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:29.320573 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:29.320804 (+ 231us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:25:29.320867 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:29.320869 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:29.321634 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:29.321635 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:29.322260 (+ 625us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:29.322263 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:29.322569 (+ 306us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:29.322570 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:29.322657 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:29.323106 (+ 449us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:25:29.323111 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:25:29.323395 (+ 284us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:25:29.324973 (+ 1578us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:29.324974 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:29.324974 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:29.325143 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:29.325328 (+ 185us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:29.325328 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:29.325328 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:29.325380 (+ 52us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:29.325579 (+ 199us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:25:29.325579 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:25:29.325621 (+ 42us) client_negotiation.cc:769] Sending connection context
0810 15:25:29.325672 (+ 51us) client_negotiation.cc:240] Negotiation successful
0810 15:25:29.325749 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":87,"threads_started":1}
I20260810 15:25:29.325986 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 21997
I20260810 15:25:29.326122 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/minicluster-data/ts-0/wal/instance
I20260810 15:25:29.326334 18706 external_mini_cluster.cc:1428] Setting key b183d07f11e73c95c33f99eb2c804e8b
WARNING: no policy specified for kudu/127.18.68.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.68.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.68.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.130.keytab.
Entry for principal kudu/127.18.68.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.130.keytab.
I20260810 15:25:29.353659 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.68.130:0
--local_ip_for_outbound_sockets=127.18.68.130
--webserver_interface=127.18.68.130
--webserver_port=0
--tserver_master_addrs=127.18.68.190:41667
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.130.keytab
--principal=kudu/127.18.68.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:44199
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:25:29.439561 22251 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:25:29.439805 22251 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:25:29.439845 22251 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:25:29.440989 22251 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:25:29.441057 22251 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:25:29.441089 22251 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260810 15:25:29.441118 22251 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 15:25:29.441159 22251 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.68.130
I20260810 15:25:29.442692 22251 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:44199
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.130.keytab
--principal=kudu/127.18.68.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.68.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.68.130
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.18.68.190:41667
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22251
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.68.130
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:25:29.442974 22251 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:25:29.443233 22251 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:25:29.448472 22269 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:29.448500 22260 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:25:29.448626 22251 server_base.cc:1034] running on GCE node
W20260810 15:25:29.448499 22259 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:25:29.448917 22251 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:25:29.449172 22251 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:25:29.450318 22251 hybrid_clock.cc:648] HybridClock initialized: now 1786375529450301 us; error 39 us; skew 500 ppm
Aug 10 15:25:29 dist-test-slave-2p8l krb5kdc[21793](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375529, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:25:29.452854 22251 init.cc:377] Logged in from keytab as kudu/127.18.68.130@KRBTEST.COM (short username kudu)
I20260810 15:25:29.453315 22251 webserver.cc:460] Webserver started at http://127.18.68.130:35991/ using document root <none> and password file <none>
I20260810 15:25:29.453542 22251 fs_manager.cc:359] Metadata directory not provided
I20260810 15:25:29.453588 22251 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:25:29.453732 22251 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:25:29.454903 22251 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/minicluster-data/ts-1/data/instance:
uuid: "0be5c2fe77b24afb982c3c286718a28a"
format_stamp: "Formatted at 2026-08-10 15:25:29 on dist-test-slave-2p8l"
server_key: "0f8ab71610559508681132f0eacd6bac"
server_key_iv: "c7b71fdced802ca68cf076fe3a57ee27"
server_key_version: "encryptionkey@0"
I20260810 15:25:29.455282 22251 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/minicluster-data/ts-1/wal/instance:
uuid: "0be5c2fe77b24afb982c3c286718a28a"
format_stamp: "Formatted at 2026-08-10 15:25:29 on dist-test-slave-2p8l"
server_key: "0f8ab71610559508681132f0eacd6bac"
server_key_iv: "c7b71fdced802ca68cf076fe3a57ee27"
server_key_version: "encryptionkey@0"
I20260810 15:25:29.456674 22251 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 15:25:29.457430 22283 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:29.457623 22251 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:25:29.457736 22251 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/minicluster-data/ts-1/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/minicluster-data/ts-1/wal
uuid: "0be5c2fe77b24afb982c3c286718a28a"
format_stamp: "Formatted at 2026-08-10 15:25:29 on dist-test-slave-2p8l"
server_key: "0f8ab71610559508681132f0eacd6bac"
server_key_iv: "c7b71fdced802ca68cf076fe3a57ee27"
server_key_version: "encryptionkey@0"
I20260810 15:25:29.457814 22251 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:25:29.466159 22251 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:25:29.468092 22251 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:25:29.468255 22251 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:25:29.468858 22251 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 15:25:29.468909 22251 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:29.468940 22251 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 15:25:29.468956 22251 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 10 15:25:29 dist-test-slave-2p8l krb5kdc[21793](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375529, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.130@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
I20260810 15:25:29.476898 22251 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.130:43129
I20260810 15:25:29.477065 22489 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.130:43129 every 8 connection(s)
I20260810 15:25:29.477336 22251 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/minicluster-data/ts-1/data/info.pb
I20260810 15:25:29.479115 21955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:29.469289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.130:33387 (local address 127.18.68.190:41667)
0810 15:25:29.469346 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:29.469349 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:29.469609 (+ 260us) server_negotiation.cc:407] Connection header received
0810 15:25:29.470110 (+ 501us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:29.470112 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:29.470128 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:29.470210 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:29.470867 (+ 657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:29.471383 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:29.472436 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:29.472634 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:29.472722 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:29.476068 (+ 3346us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:29.476070 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:29.476070 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:29.476080 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:29.477954 (+ 1874us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:29.478376 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:29.478377 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:29.478378 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:29.478430 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:29.478632 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:29.478632 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:29.478632 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:29.478748 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:29.478795 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:29.478995 (+ 200us) server_negotiation.cc:299] Negotiation successful
0810 15:25:29.479052 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260810 15:25:29.479311 22299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:29.469288 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:41667 (local address 127.18.68.130:33387)
0810 15:25:29.469462 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:29.469502 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:29.470003 (+ 501us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:29.470285 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:29.470288 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:29.470514 (+ 226us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:25:29.470763 (+ 249us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:29.470768 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:29.471493 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:29.471499 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:29.472338 (+ 839us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:29.472341 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:29.472738 (+ 397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:29.472739 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:29.472876 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:29.473434 (+ 558us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:25:29.473442 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:25:29.475953 (+ 2511us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:25:29.478037 (+ 2084us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:29.478043 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:29.478044 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:29.478307 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:29.478476 (+ 169us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:29.478477 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:29.478477 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:29.478573 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:29.478787 (+ 214us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:25:29.478790 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:25:29.478901 (+ 111us) client_negotiation.cc:769] Sending connection context
0810 15:25:29.478975 (+ 74us) client_negotiation.cc:240] Negotiation successful
0810 15:25:29.479103 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":106,"threads_started":1}
I20260810 15:25:29.479516 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 22251
I20260810 15:25:29.479617 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/minicluster-data/ts-1/wal/instance
I20260810 15:25:29.479826 18706 external_mini_cluster.cc:1428] Setting key 25a09d3c3a7fbf22423b18dac0e74186
I20260810 15:25:29.479867 22493 heartbeater.cc:347] Connected to a master server at 127.18.68.190:41667
I20260810 15:25:29.481369 22493 heartbeater.cc:464] Registering TS with master...
I20260810 15:25:29.481557 22493 heartbeater.cc:511] Master 127.18.68.190:41667 requested a full tablet report, sending...
I20260810 15:25:29.481949 21870 ts_manager.cc:194] Registered new tserver with Master: 0be5c2fe77b24afb982c3c286718a28a (127.18.68.130:43129)
I20260810 15:25:29.482493 21870 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.68.130@KRBTEST.COM'} at 127.18.68.130:33387
I20260810 15:25:29.488271 21955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:29.481206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.130:33413 (local address 127.18.68.190:41667)
0810 15:25:29.481252 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:29.481254 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:29.481860 (+ 606us) server_negotiation.cc:407] Connection header received
0810 15:25:29.481927 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:29.481928 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:29.481939 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:29.481990 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:29.482536 (+ 546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:29.483126 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:29.483936 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:29.484148 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:29.484219 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:29.485333 (+ 1114us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:29.485334 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:29.485335 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:29.485341 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:29.487067 (+ 1726us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:29.487492 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:29.487493 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:29.487493 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:29.487549 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:29.487778 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:29.487778 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:29.487779 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:29.487916 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:29.487972 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:29.488148 (+ 176us) server_negotiation.cc:299] Negotiation successful
0810 15:25:29.488209 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260810 15:25:29.488384 22506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:29.481259 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:41667 (local address 127.18.68.130:33413)
0810 15:25:29.481772 (+ 513us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:29.481802 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:29.481873 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:29.482137 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:29.482138 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:29.482361 (+ 223us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:25:29.482440 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:29.482442 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:29.483230 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:29.483231 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:29.483830 (+ 599us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:29.483832 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:29.484235 (+ 403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:29.484236 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:29.484330 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:29.484791 (+ 461us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:25:29.484797 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:25:29.485238 (+ 441us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:25:29.487158 (+ 1920us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:29.487159 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:29.487160 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:29.487394 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:29.487630 (+ 236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:29.487630 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:29.487631 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:29.487708 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:29.487988 (+ 280us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:25:29.487989 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:25:29.488047 (+ 58us) client_negotiation.cc:769] Sending connection context
0810 15:25:29.488132 (+ 85us) client_negotiation.cc:240] Negotiation successful
0810 15:25:29.488259 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":485,"thread_start_us":84,"threads_started":1}
WARNING: no policy specified for kudu/127.18.68.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.68.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.68.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.131.keytab.
Entry for principal kudu/127.18.68.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.131.keytab.
I20260810 15:25:29.509238 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.68.131:0
--local_ip_for_outbound_sockets=127.18.68.131
--webserver_interface=127.18.68.131
--webserver_port=0
--tserver_master_addrs=127.18.68.190:41667
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.131.keytab
--principal=kudu/127.18.68.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:44199
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:25:29.594854 22510 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:25:29.595078 22510 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:25:29.595108 22510 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:25:29.596266 22510 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:25:29.596310 22510 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:25:29.596331 22510 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260810 15:25:29.596344 22510 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 15:25:29.596361 22510 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.68.131
I20260810 15:25:29.597894 22510 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:44199
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.131.keytab
--principal=kudu/127.18.68.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.68.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.68.131
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.18.68.190:41667
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22510
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.68.131
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:25:29.598196 22510 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:25:29.598408 22510 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:25:29.603895 22519 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:29.603895 22525 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:29.603938 22522 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:25:29.604193 22510 server_base.cc:1034] running on GCE node
I20260810 15:25:29.604460 22510 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:25:29.604786 22510 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:25:29.605986 22510 hybrid_clock.cc:648] HybridClock initialized: now 1786375529605960 us; error 44 us; skew 500 ppm
Aug 10 15:25:29 dist-test-slave-2p8l krb5kdc[21793](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375529, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:25:29.608848 22510 init.cc:377] Logged in from keytab as kudu/127.18.68.131@KRBTEST.COM (short username kudu)
I20260810 15:25:29.609308 22510 webserver.cc:460] Webserver started at http://127.18.68.131:39107/ using document root <none> and password file <none>
I20260810 15:25:29.609511 22510 fs_manager.cc:359] Metadata directory not provided
I20260810 15:25:29.609555 22510 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:25:29.609648 22510 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:25:29.610754 22510 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/minicluster-data/ts-2/data/instance:
uuid: "a6e8360424fb444eb7d9a1ee55c824e1"
format_stamp: "Formatted at 2026-08-10 15:25:29 on dist-test-slave-2p8l"
server_key: "1fbc906988d2f61880c44b4eb40a40ce"
server_key_iv: "207cdcfed47cc84c4d283fc477da4634"
server_key_version: "encryptionkey@0"
I20260810 15:25:29.611071 22510 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/minicluster-data/ts-2/wal/instance:
uuid: "a6e8360424fb444eb7d9a1ee55c824e1"
format_stamp: "Formatted at 2026-08-10 15:25:29 on dist-test-slave-2p8l"
server_key: "1fbc906988d2f61880c44b4eb40a40ce"
server_key_iv: "207cdcfed47cc84c4d283fc477da4634"
server_key_version: "encryptionkey@0"
I20260810 15:25:29.612470 22510 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 15:25:29.613278 22536 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:29.613484 22510 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:25:29.613575 22510 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/minicluster-data/ts-2/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/minicluster-data/ts-2/wal
uuid: "a6e8360424fb444eb7d9a1ee55c824e1"
format_stamp: "Formatted at 2026-08-10 15:25:29 on dist-test-slave-2p8l"
server_key: "1fbc906988d2f61880c44b4eb40a40ce"
server_key_iv: "207cdcfed47cc84c4d283fc477da4634"
server_key_version: "encryptionkey@0"
I20260810 15:25:29.613643 22510 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:25:29.635807 22510 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:25:29.638406 22510 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:25:29.638527 22510 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:25:29.639092 22510 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 15:25:29.639156 22510 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:29.639180 22510 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 15:25:29.639194 22510 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:29.646591 22510 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.131:37443
I20260810 15:25:29.646675 22742 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.131:37443 every 8 connection(s)
Aug 10 15:25:29 dist-test-slave-2p8l krb5kdc[21793](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375529, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.131@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
I20260810 15:25:29.647055 22510 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/minicluster-data/ts-2/data/info.pb
I20260810 15:25:29.650053 21955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:29.639760 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.131:36575 (local address 127.18.68.190:41667)
0810 15:25:29.639820 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:29.639823 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:29.640072 (+ 249us) server_negotiation.cc:407] Connection header received
0810 15:25:29.640643 (+ 571us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:29.640644 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:29.640660 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:29.640744 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:29.641690 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:29.642571 (+ 881us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:29.644190 (+ 1619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:29.644532 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:29.644622 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:29.647430 (+ 2808us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:29.647432 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:29.647432 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:29.647439 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:29.648538 (+ 1099us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:29.648953 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:29.648954 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:29.648954 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:29.649017 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:29.649372 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:29.649373 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:29.649373 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:29.649485 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:29.649546 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:29.649885 (+ 339us) server_negotiation.cc:299] Negotiation successful
0810 15:25:29.649972 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260810 15:25:29.650247 22550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:29.639766 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:41667 (local address 127.18.68.131:36575)
0810 15:25:29.639944 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:29.639981 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:29.640494 (+ 513us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:29.640829 (+ 335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:29.640834 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:29.641206 (+ 372us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:25:29.641499 (+ 293us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:29.641505 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:29.642681 (+ 1176us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:29.642682 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:29.644083 (+ 1401us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:29.644087 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:29.644670 (+ 583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:29.644671 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:29.644812 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:29.645406 (+ 594us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:25:29.645416 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:25:29.647317 (+ 1901us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:25:29.648627 (+ 1310us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:29.648634 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:29.648635 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:29.648858 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:29.649135 (+ 277us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:29.649136 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:29.649137 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:29.649256 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:29.649571 (+ 315us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:25:29.649577 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:25:29.649716 (+ 139us) client_negotiation.cc:769] Sending connection context
0810 15:25:29.649810 (+ 94us) client_negotiation.cc:240] Negotiation successful
0810 15:25:29.649931 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":103,"threads_started":1}
I20260810 15:25:29.650712 22744 heartbeater.cc:347] Connected to a master server at 127.18.68.190:41667
I20260810 15:25:29.650815 22744 heartbeater.cc:464] Registering TS with master...
I20260810 15:25:29.650995 22744 heartbeater.cc:511] Master 127.18.68.190:41667 requested a full tablet report, sending...
I20260810 15:25:29.651412 21870 ts_manager.cc:194] Registered new tserver with Master: a6e8360424fb444eb7d9a1ee55c824e1 (127.18.68.131:37443)
I20260810 15:25:29.651922 21870 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.68.131@KRBTEST.COM'} at 127.18.68.131:36575
I20260810 15:25:29.655392 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 22510
I20260810 15:25:29.655491 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/minicluster-data/ts-2/wal/instance
I20260810 15:25:29.655687 18706 external_mini_cluster.cc:1428] Setting key 3596ba43a2f8dc32aaee61649e206ae4
I20260810 15:25:29.656484 18706 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 15:25:29.657524 21955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:29.651873 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.131:59749 (local address 127.18.68.190:41667)
0810 15:25:29.651908 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:29.651910 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:29.652092 (+ 182us) server_negotiation.cc:407] Connection header received
0810 15:25:29.652173 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:29.652173 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:29.652181 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:29.652223 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:29.652609 (+ 386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:29.653105 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:29.653759 (+ 654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:29.653932 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:29.653985 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:29.654882 (+ 897us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:29.654883 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:29.654884 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:29.654889 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:29.656330 (+ 1441us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:29.656745 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:29.656746 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:29.656746 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:29.656807 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:29.657010 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:29.657011 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:29.657012 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:29.657128 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:29.657207 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:29.657371 (+ 164us) server_negotiation.cc:299] Negotiation successful
0810 15:25:29.657438 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260810 15:25:29.657534 22754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:29.651810 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:41667 (local address 127.18.68.131:59749)
0810 15:25:29.652031 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:29.652042 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:29.652103 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:29.652228 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:29.652229 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:29.652478 (+ 249us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:25:29.652528 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:29.652529 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:29.653193 (+ 664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:29.653194 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:29.653694 (+ 500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:29.653695 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:29.653998 (+ 303us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:29.653999 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:29.654054 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:29.654526 (+ 472us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:25:29.654531 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:25:29.654808 (+ 277us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:25:29.656435 (+ 1627us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:29.656435 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:29.656436 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:29.656654 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:29.656878 (+ 224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:29.656879 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:29.656879 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:29.656946 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:29.657200 (+ 254us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:25:29.657201 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:25:29.657247 (+ 46us) client_negotiation.cc:769] Sending connection context
0810 15:25:29.657332 (+ 85us) client_negotiation.cc:240] Negotiation successful
0810 15:25:29.657438 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":148,"threads_started":1}
Aug 10 15:25:29 dist-test-slave-2p8l krb5kdc[21793](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375529, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 10 15:25:29 dist-test-slave-2p8l krb5kdc[21793](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375529, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
I20260810 15:25:29.682171 21955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:29.674474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58312 (local address 127.18.68.190:41667)
0810 15:25:29.674548 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:29.674550 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:29.674561 (+ 11us) server_negotiation.cc:407] Connection header received
0810 15:25:29.674589 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:29.674590 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:29.674607 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:29.674674 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:29.675369 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:29.675863 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:29.676712 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:29.676907 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:29.676985 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:29.679351 (+ 2366us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:29.679352 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:29.679353 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:29.679362 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:29.680945 (+ 1583us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:29.681319 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:29.681320 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:29.681321 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:29.681380 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:29.681611 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:29.681612 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:29.681613 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:29.681725 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:29.681828 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:29.681958 (+ 130us) server_negotiation.cc:299] Negotiation successful
0810 15:25:29.682038 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260810 15:25:29.683955 21870 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58312:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 15:25:29.685549 21870 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 15:25:29.692414 22787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:29.687937 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.129:35749 (local address 127.0.0.1:44844)
0810 15:25:29.688133 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:29.688182 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:29.688254 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:29.688786 (+ 532us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:29.688789 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:29.688792 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:25:29.688873 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:29.688874 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:29.690264 (+ 1390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:29.690265 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:29.691389 (+ 1124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:29.691391 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:29.692103 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:29.692104 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:29.692187 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:29.692200 (+ 13us) client_negotiation.cc:769] Sending connection context
0810 15:25:29.692269 (+ 69us) client_negotiation.cc:240] Negotiation successful
0810 15:25:29.692324 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"mutex_wait_us":45,"thread_start_us":52,"threads_started":1}
I20260810 15:25:29.692480 22789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:29.687937 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.131:37443 (local address 127.0.0.1:46374)
0810 15:25:29.688541 (+ 604us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:29.688551 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:29.688656 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:29.688835 (+ 179us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:29.688836 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:29.688837 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:25:29.688873 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:29.688874 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:29.690301 (+ 1427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:29.690302 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:29.691258 (+ 956us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:29.691260 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:29.692224 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:29.692225 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:29.692285 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:29.692288 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 15:25:29.692347 (+ 59us) client_negotiation.cc:240] Negotiation successful
0810 15:25:29.692377 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":585,"mutex_wait_us":2,"spinlock_wait_cycles":768,"thread_start_us":111,"threads_started":1}
I20260810 15:25:29.692519 22795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:29.688345 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46374 (local address 127.18.68.131:37443)
0810 15:25:29.688555 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:29.688559 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:29.688662 (+ 103us) server_negotiation.cc:407] Connection header received
0810 15:25:29.688718 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:29.688720 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:29.688738 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:29.688952 (+ 214us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:25:29.689019 (+ 67us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:29.690196 (+ 1177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:29.691349 (+ 1153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:29.692094 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:29.692222 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:29.692287 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:29.692364 (+ 77us) server_negotiation.cc:299] Negotiation successful
0810 15:25:29.692405 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":170,"thread_start_us":105,"threads_started":1}
I20260810 15:25:29.692811 22788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:29.688073 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44844 (local address 127.18.68.129:35749)
0810 15:25:29.688536 (+ 463us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:29.688541 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:29.688555 (+ 14us) server_negotiation.cc:407] Connection header received
0810 15:25:29.688598 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:29.688600 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:29.688654 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:29.688956 (+ 302us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:25:29.689023 (+ 67us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:29.690177 (+ 1154us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:29.691481 (+ 1304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:29.691993 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:29.692091 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:29.692166 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:29.692665 (+ 499us) server_negotiation.cc:299] Negotiation successful
0810 15:25:29.692709 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":418,"thread_start_us":100,"threads_started":1}
I20260810 15:25:29.693132 22793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:29.688309 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46564 (local address 127.18.68.130:43129)
0810 15:25:29.688490 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:29.688496 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:29.688878 (+ 382us) server_negotiation.cc:407] Connection header received
0810 15:25:29.688929 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:29.688932 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:29.688947 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:29.689026 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:25:29.689149 (+ 123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:29.689846 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:29.691461 (+ 1615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:29.692179 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:29.692240 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:29.692288 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:29.692993 (+ 705us) server_negotiation.cc:299] Negotiation successful
0810 15:25:29.693040 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":144,"thread_start_us":92,"threads_started":1}
I20260810 15:25:29.693339 22782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:29.688193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.130:43129 (local address 127.0.0.1:46564)
0810 15:25:29.688734 (+ 541us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:29.688743 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:29.688787 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:29.689035 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:29.689035 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:29.689038 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:25:29.689082 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:29.689084 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:29.689941 (+ 857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:29.689942 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:29.691367 (+ 1425us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:29.691370 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:29.692323 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:29.692325 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:29.692391 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:29.692396 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 15:25:29.692448 (+ 52us) client_negotiation.cc:240] Negotiation successful
0810 15:25:29.693266 (+ 818us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":531,"mutex_wait_us":3,"thread_start_us":74,"threads_started":1}
I20260810 15:25:29.693295 22622 tablet_service.cc:1467] Processing CreateTablet for tablet 1af9ae9b381e480b85d2efd8c58d453b (DEFAULT_TABLE table=test-table [id=2171c311dcc34bc6a9aca8d2a5218919]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 15:25:29.693475 22107 tablet_service.cc:1467] Processing CreateTablet for tablet 1af9ae9b381e480b85d2efd8c58d453b (DEFAULT_TABLE table=test-table [id=2171c311dcc34bc6a9aca8d2a5218919]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 15:25:29.693753 22622 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1af9ae9b381e480b85d2efd8c58d453b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:25:29.693878 22107 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1af9ae9b381e480b85d2efd8c58d453b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:25:29.696514 22796 tablet_bootstrap.cc:492] T 1af9ae9b381e480b85d2efd8c58d453b P a6e8360424fb444eb7d9a1ee55c824e1: Bootstrap starting.
I20260810 15:25:29.697328 22798 tablet_bootstrap.cc:492] T 1af9ae9b381e480b85d2efd8c58d453b P e934fc72e9bf430895b18ddfddac2c7d: Bootstrap starting.
I20260810 15:25:29.697283 22361 tablet_service.cc:1467] Processing CreateTablet for tablet 1af9ae9b381e480b85d2efd8c58d453b (DEFAULT_TABLE table=test-table [id=2171c311dcc34bc6a9aca8d2a5218919]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 15:25:29.697589 22796 tablet_bootstrap.cc:654] T 1af9ae9b381e480b85d2efd8c58d453b P a6e8360424fb444eb7d9a1ee55c824e1: Neither blocks nor log segments found. Creating new log.
I20260810 15:25:29.697661 22361 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1af9ae9b381e480b85d2efd8c58d453b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:25:29.697835 22796 log.cc:824] T 1af9ae9b381e480b85d2efd8c58d453b P a6e8360424fb444eb7d9a1ee55c824e1: Log is configured to *not* fsync() on all Append() calls
I20260810 15:25:29.697975 22798 tablet_bootstrap.cc:654] T 1af9ae9b381e480b85d2efd8c58d453b P e934fc72e9bf430895b18ddfddac2c7d: Neither blocks nor log segments found. Creating new log.
I20260810 15:25:29.698336 22798 log.cc:824] T 1af9ae9b381e480b85d2efd8c58d453b P e934fc72e9bf430895b18ddfddac2c7d: Log is configured to *not* fsync() on all Append() calls
I20260810 15:25:29.698570 22796 tablet_bootstrap.cc:492] T 1af9ae9b381e480b85d2efd8c58d453b P a6e8360424fb444eb7d9a1ee55c824e1: No bootstrap required, opened a new log
I20260810 15:25:29.698645 22796 ts_tablet_manager.cc:1397] T 1af9ae9b381e480b85d2efd8c58d453b P a6e8360424fb444eb7d9a1ee55c824e1: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 15:25:29.699157 22798 tablet_bootstrap.cc:492] T 1af9ae9b381e480b85d2efd8c58d453b P e934fc72e9bf430895b18ddfddac2c7d: No bootstrap required, opened a new log
I20260810 15:25:29.699219 22798 ts_tablet_manager.cc:1397] T 1af9ae9b381e480b85d2efd8c58d453b P e934fc72e9bf430895b18ddfddac2c7d: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260810 15:25:29.700028 22796 raft_consensus.cc:348] T 1af9ae9b381e480b85d2efd8c58d453b P a6e8360424fb444eb7d9a1ee55c824e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6e8360424fb444eb7d9a1ee55c824e1" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37443 } } peers { permanent_uuid: "e934fc72e9bf430895b18ddfddac2c7d" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35749 } } peers { permanent_uuid: "0be5c2fe77b24afb982c3c286718a28a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 43129 } }
I20260810 15:25:29.700147 22796 raft_consensus.cc:374] T 1af9ae9b381e480b85d2efd8c58d453b P a6e8360424fb444eb7d9a1ee55c824e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:25:29.700168 22796 raft_consensus.cc:729] T 1af9ae9b381e480b85d2efd8c58d453b P a6e8360424fb444eb7d9a1ee55c824e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6e8360424fb444eb7d9a1ee55c824e1, State: Initialized, Role: FOLLOWER
I20260810 15:25:29.700284 22796 consensus_queue.cc:260] T 1af9ae9b381e480b85d2efd8c58d453b P a6e8360424fb444eb7d9a1ee55c824e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6e8360424fb444eb7d9a1ee55c824e1" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37443 } } peers { permanent_uuid: "e934fc72e9bf430895b18ddfddac2c7d" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35749 } } peers { permanent_uuid: "0be5c2fe77b24afb982c3c286718a28a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 43129 } }
I20260810 15:25:29.700559 22796 ts_tablet_manager.cc:1428] T 1af9ae9b381e480b85d2efd8c58d453b P a6e8360424fb444eb7d9a1ee55c824e1: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 15:25:29.700592 22744 heartbeater.cc:503] Master 127.18.68.190:41667 was elected leader, sending a full tablet report...
I20260810 15:25:29.701335 22798 raft_consensus.cc:348] T 1af9ae9b381e480b85d2efd8c58d453b P e934fc72e9bf430895b18ddfddac2c7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6e8360424fb444eb7d9a1ee55c824e1" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37443 } } peers { permanent_uuid: "e934fc72e9bf430895b18ddfddac2c7d" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35749 } } peers { permanent_uuid: "0be5c2fe77b24afb982c3c286718a28a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 43129 } }
I20260810 15:25:29.701488 22798 raft_consensus.cc:374] T 1af9ae9b381e480b85d2efd8c58d453b P e934fc72e9bf430895b18ddfddac2c7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:25:29.701517 22798 raft_consensus.cc:729] T 1af9ae9b381e480b85d2efd8c58d453b P e934fc72e9bf430895b18ddfddac2c7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e934fc72e9bf430895b18ddfddac2c7d, State: Initialized, Role: FOLLOWER
I20260810 15:25:29.701502 22807 tablet_bootstrap.cc:492] T 1af9ae9b381e480b85d2efd8c58d453b P 0be5c2fe77b24afb982c3c286718a28a: Bootstrap starting.
I20260810 15:25:29.701624 22798 consensus_queue.cc:260] T 1af9ae9b381e480b85d2efd8c58d453b P e934fc72e9bf430895b18ddfddac2c7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6e8360424fb444eb7d9a1ee55c824e1" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37443 } } peers { permanent_uuid: "e934fc72e9bf430895b18ddfddac2c7d" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35749 } } peers { permanent_uuid: "0be5c2fe77b24afb982c3c286718a28a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 43129 } }
I20260810 15:25:29.701932 22798 ts_tablet_manager.cc:1428] T 1af9ae9b381e480b85d2efd8c58d453b P e934fc72e9bf430895b18ddfddac2c7d: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260810 15:25:29.702032 22234 heartbeater.cc:503] Master 127.18.68.190:41667 was elected leader, sending a full tablet report...
I20260810 15:25:29.702266 22807 tablet_bootstrap.cc:654] T 1af9ae9b381e480b85d2efd8c58d453b P 0be5c2fe77b24afb982c3c286718a28a: Neither blocks nor log segments found. Creating new log.
I20260810 15:25:29.702639 22807 log.cc:824] T 1af9ae9b381e480b85d2efd8c58d453b P 0be5c2fe77b24afb982c3c286718a28a: Log is configured to *not* fsync() on all Append() calls
I20260810 15:25:29.703341 22807 tablet_bootstrap.cc:492] T 1af9ae9b381e480b85d2efd8c58d453b P 0be5c2fe77b24afb982c3c286718a28a: No bootstrap required, opened a new log
I20260810 15:25:29.703397 22807 ts_tablet_manager.cc:1397] T 1af9ae9b381e480b85d2efd8c58d453b P 0be5c2fe77b24afb982c3c286718a28a: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 15:25:29.704946 22807 raft_consensus.cc:348] T 1af9ae9b381e480b85d2efd8c58d453b P 0be5c2fe77b24afb982c3c286718a28a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6e8360424fb444eb7d9a1ee55c824e1" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37443 } } peers { permanent_uuid: "e934fc72e9bf430895b18ddfddac2c7d" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35749 } } peers { permanent_uuid: "0be5c2fe77b24afb982c3c286718a28a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 43129 } }
I20260810 15:25:29.705065 22807 raft_consensus.cc:374] T 1af9ae9b381e480b85d2efd8c58d453b P 0be5c2fe77b24afb982c3c286718a28a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:25:29.705087 22807 raft_consensus.cc:729] T 1af9ae9b381e480b85d2efd8c58d453b P 0be5c2fe77b24afb982c3c286718a28a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0be5c2fe77b24afb982c3c286718a28a, State: Initialized, Role: FOLLOWER
I20260810 15:25:29.705219 22807 consensus_queue.cc:260] T 1af9ae9b381e480b85d2efd8c58d453b P 0be5c2fe77b24afb982c3c286718a28a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6e8360424fb444eb7d9a1ee55c824e1" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37443 } } peers { permanent_uuid: "e934fc72e9bf430895b18ddfddac2c7d" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35749 } } peers { permanent_uuid: "0be5c2fe77b24afb982c3c286718a28a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 43129 } }
I20260810 15:25:29.705523 22807 ts_tablet_manager.cc:1428] T 1af9ae9b381e480b85d2efd8c58d453b P 0be5c2fe77b24afb982c3c286718a28a: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 15:25:29.705595 22493 heartbeater.cc:503] Master 127.18.68.190:41667 was elected leader, sending a full tablet report...
W20260810 15:25:29.728022 22496 tablet.cc:2369] T 1af9ae9b381e480b85d2efd8c58d453b P 0be5c2fe77b24afb982c3c286718a28a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 15:25:29.817078 22237 tablet.cc:2369] T 1af9ae9b381e480b85d2efd8c58d453b P e934fc72e9bf430895b18ddfddac2c7d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 15:25:29.855008 22804 raft_consensus.cc:482] T 1af9ae9b381e480b85d2efd8c58d453b P a6e8360424fb444eb7d9a1ee55c824e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 15:25:29.855170 22804 raft_consensus.cc:504] T 1af9ae9b381e480b85d2efd8c58d453b P a6e8360424fb444eb7d9a1ee55c824e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6e8360424fb444eb7d9a1ee55c824e1" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37443 } } peers { permanent_uuid: "e934fc72e9bf430895b18ddfddac2c7d" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35749 } } peers { permanent_uuid: "0be5c2fe77b24afb982c3c286718a28a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 43129 } }
I20260810 15:25:29.855500 22804 leader_election.cc:288] T 1af9ae9b381e480b85d2efd8c58d453b P a6e8360424fb444eb7d9a1ee55c824e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e934fc72e9bf430895b18ddfddac2c7d (127.18.68.129:35749), 0be5c2fe77b24afb982c3c286718a28a (127.18.68.130:43129)
I20260810 15:25:29.856245 22809 raft_consensus.cc:482] T 1af9ae9b381e480b85d2efd8c58d453b P e934fc72e9bf430895b18ddfddac2c7d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 15:25:29.856407 22809 raft_consensus.cc:504] T 1af9ae9b381e480b85d2efd8c58d453b P e934fc72e9bf430895b18ddfddac2c7d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6e8360424fb444eb7d9a1ee55c824e1" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37443 } } peers { permanent_uuid: "e934fc72e9bf430895b18ddfddac2c7d" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35749 } } peers { permanent_uuid: "0be5c2fe77b24afb982c3c286718a28a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 43129 } }
I20260810 15:25:29.856805 22809 leader_election.cc:288] T 1af9ae9b381e480b85d2efd8c58d453b P e934fc72e9bf430895b18ddfddac2c7d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a6e8360424fb444eb7d9a1ee55c824e1 (127.18.68.131:37443), 0be5c2fe77b24afb982c3c286718a28a (127.18.68.130:43129)
I20260810 15:25:29.859503 22550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:29.855782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.130:43129 (local address 127.18.68.131:54455)
0810 15:25:29.855864 (+ 82us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:29.855878 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:29.855960 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:29.856227 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:29.856234 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:29.856236 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:25:29.856318 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:29.856321 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:29.857270 (+ 949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:29.857271 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:29.858520 (+ 1249us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:29.858523 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:29.859180 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:29.859181 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:29.859278 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:29.859282 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 15:25:29.859355 (+ 73us) client_negotiation.cc:240] Negotiation successful
0810 15:25:29.859396 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53}
I20260810 15:25:29.859614 22788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:29.855883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.131:58893 (local address 127.18.68.129:35749)
0810 15:25:29.855967 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:29.855970 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:29.856242 (+ 272us) server_negotiation.cc:407] Connection header received
0810 15:25:29.856343 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:29.856345 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:29.856355 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:29.856411 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:25:29.856656 (+ 245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:29.857322 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:29.858672 (+ 1350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:29.859245 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:29.859319 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:29.859327 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:29.859497 (+ 170us) server_negotiation.cc:299] Negotiation successful
0810 15:25:29.859546 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":32,"server-negotiator.queue_time_us":49}
I20260810 15:25:29.860118 22793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:29.855881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.131:54455 (local address 127.18.68.130:43129)
0810 15:25:29.856021 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:29.856024 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:29.856058 (+ 34us) server_negotiation.cc:407] Connection header received
0810 15:25:29.856099 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:29.856100 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:29.856111 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:29.856206 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:25:29.856410 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:29.857166 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:29.858635 (+ 1469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:29.859074 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:29.859180 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:29.859189 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:29.860026 (+ 837us) server_negotiation.cc:299] Negotiation successful
0810 15:25:29.860070 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":116}
I20260810 15:25:29.860353 22812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:29.855782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.129:35749 (local address 127.18.68.131:58893)
0810 15:25:29.856173 (+ 391us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:29.856185 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:29.856267 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:29.856466 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:29.856467 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:29.856469 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:25:29.856548 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:29.856550 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:29.857469 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:29.857470 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:29.858582 (+ 1112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:29.858584 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:29.859330 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:29.859331 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:29.859408 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:29.859411 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 15:25:29.859732 (+ 321us) client_negotiation.cc:240] Negotiation successful
0810 15:25:29.860258 (+ 526us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":370,"mutex_wait_us":617,"thread_start_us":142,"threads_started":1}
I20260810 15:25:29.860793 22795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:29.856980 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.129:35651 (local address 127.18.68.131:37443)
0810 15:25:29.857020 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:29.857022 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:29.857135 (+ 113us) server_negotiation.cc:407] Connection header received
0810 15:25:29.857236 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:29.857237 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:29.857246 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:29.857295 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:25:29.857527 (+ 232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:29.858291 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:29.859652 (+ 1361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:29.860212 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:29.860255 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:29.860261 (+ 6us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:29.860684 (+ 423us) server_negotiation.cc:299] Negotiation successful
0810 15:25:29.860729 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260810 15:25:29.860719 22146 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1af9ae9b381e480b85d2efd8c58d453b" candidate_uuid: "a6e8360424fb444eb7d9a1ee55c824e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e934fc72e9bf430895b18ddfddac2c7d" is_pre_election: true
I20260810 15:25:29.860831 22813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:29.856943 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.131:37443 (local address 127.18.68.129:35651)
0810 15:25:29.857075 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:29.857086 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:29.857162 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:29.857365 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:29.857366 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:29.857368 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:25:29.857439 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:29.857441 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:29.858382 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:29.858382 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:29.859542 (+ 1160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:29.859544 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:29.860507 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:29.860508 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:29.860580 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:29.860584 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 15:25:29.860672 (+ 88us) client_negotiation.cc:240] Negotiation successful
0810 15:25:29.860716 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":52,"threads_started":1}
I20260810 15:25:29.860881 22146 raft_consensus.cc:2454] T 1af9ae9b381e480b85d2efd8c58d453b P e934fc72e9bf430895b18ddfddac2c7d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6e8360424fb444eb7d9a1ee55c824e1 in term 0.
I20260810 15:25:29.860556 22403 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1af9ae9b381e480b85d2efd8c58d453b" candidate_uuid: "a6e8360424fb444eb7d9a1ee55c824e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0be5c2fe77b24afb982c3c286718a28a" is_pre_election: true
I20260810 15:25:29.861143 22403 raft_consensus.cc:2454] T 1af9ae9b381e480b85d2efd8c58d453b P 0be5c2fe77b24afb982c3c286718a28a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6e8360424fb444eb7d9a1ee55c824e1 in term 0.
I20260810 15:25:29.861150 22539 leader_election.cc:302] T 1af9ae9b381e480b85d2efd8c58d453b P a6e8360424fb444eb7d9a1ee55c824e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a6e8360424fb444eb7d9a1ee55c824e1, e934fc72e9bf430895b18ddfddac2c7d; no voters:
I20260810 15:25:29.861299 22804 raft_consensus.cc:2781] T 1af9ae9b381e480b85d2efd8c58d453b P a6e8360424fb444eb7d9a1ee55c824e1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 15:25:29.861366 22804 raft_consensus.cc:482] T 1af9ae9b381e480b85d2efd8c58d453b P a6e8360424fb444eb7d9a1ee55c824e1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 15:25:29.861390 22804 raft_consensus.cc:3037] T 1af9ae9b381e480b85d2efd8c58d453b P a6e8360424fb444eb7d9a1ee55c824e1 [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:25:29.861455 22663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1af9ae9b381e480b85d2efd8c58d453b" candidate_uuid: "e934fc72e9bf430895b18ddfddac2c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6e8360424fb444eb7d9a1ee55c824e1" is_pre_election: true
I20260810 15:25:29.861943 22815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:29.857142 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.130:43129 (local address 127.18.68.129:38229)
0810 15:25:29.857524 (+ 382us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:29.857535 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:29.857602 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:29.857773 (+ 171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:29.857774 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:29.857775 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:25:29.857828 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:29.857829 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:29.858704 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:29.858705 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:29.860304 (+ 1599us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:29.860307 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:29.861638 (+ 1331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:29.861639 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:29.861758 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:29.861762 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 15:25:29.861821 (+ 59us) client_negotiation.cc:240] Negotiation successful
0810 15:25:29.861873 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":370,"thread_start_us":71,"threads_started":1}
I20260810 15:25:29.861980 22818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:29.857304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.129:38229 (local address 127.18.68.130:43129)
0810 15:25:29.857470 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:29.857472 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:29.857580 (+ 108us) server_negotiation.cc:407] Connection header received
0810 15:25:29.857667 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:29.857668 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:29.857676 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:29.857718 (+ 42us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:25:29.857896 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:29.858612 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:29.860381 (+ 1769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:29.861542 (+ 1161us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:29.861626 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:29.861634 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:29.861843 (+ 209us) server_negotiation.cc:299] Negotiation successful
0810 15:25:29.861886 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":105,"threads_started":1}
I20260810 15:25:29.862202 22403 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1af9ae9b381e480b85d2efd8c58d453b" candidate_uuid: "e934fc72e9bf430895b18ddfddac2c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0be5c2fe77b24afb982c3c286718a28a" is_pre_election: true
I20260810 15:25:29.862285 22403 raft_consensus.cc:2454] T 1af9ae9b381e480b85d2efd8c58d453b P 0be5c2fe77b24afb982c3c286718a28a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e934fc72e9bf430895b18ddfddac2c7d in term 0.
I20260810 15:25:29.862479 22804 raft_consensus.cc:504] T 1af9ae9b381e480b85d2efd8c58d453b P a6e8360424fb444eb7d9a1ee55c824e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6e8360424fb444eb7d9a1ee55c824e1" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37443 } } peers { permanent_uuid: "e934fc72e9bf430895b18ddfddac2c7d" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35749 } } peers { permanent_uuid: "0be5c2fe77b24afb982c3c286718a28a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 43129 } }
I20260810 15:25:29.862485 22027 leader_election.cc:302] T 1af9ae9b381e480b85d2efd8c58d453b P e934fc72e9bf430895b18ddfddac2c7d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0be5c2fe77b24afb982c3c286718a28a, e934fc72e9bf430895b18ddfddac2c7d; no voters:
I20260810 15:25:29.862663 22804 leader_election.cc:288] T 1af9ae9b381e480b85d2efd8c58d453b P a6e8360424fb444eb7d9a1ee55c824e1 [CANDIDATE]: Term 1 election: Requested vote from peers e934fc72e9bf430895b18ddfddac2c7d (127.18.68.129:35749), 0be5c2fe77b24afb982c3c286718a28a (127.18.68.130:43129)
I20260810 15:25:29.862648 22809 raft_consensus.cc:2781] T 1af9ae9b381e480b85d2efd8c58d453b P e934fc72e9bf430895b18ddfddac2c7d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 15:25:29.862715 22809 raft_consensus.cc:482] T 1af9ae9b381e480b85d2efd8c58d453b P e934fc72e9bf430895b18ddfddac2c7d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 15:25:29.862742 22809 raft_consensus.cc:3037] T 1af9ae9b381e480b85d2efd8c58d453b P e934fc72e9bf430895b18ddfddac2c7d [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:25:29.862790 22146 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1af9ae9b381e480b85d2efd8c58d453b" candidate_uuid: "a6e8360424fb444eb7d9a1ee55c824e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e934fc72e9bf430895b18ddfddac2c7d"
I20260810 15:25:29.862825 22403 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1af9ae9b381e480b85d2efd8c58d453b" candidate_uuid: "a6e8360424fb444eb7d9a1ee55c824e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0be5c2fe77b24afb982c3c286718a28a"
I20260810 15:25:29.862896 22403 raft_consensus.cc:3037] T 1af9ae9b381e480b85d2efd8c58d453b P 0be5c2fe77b24afb982c3c286718a28a [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:25:29.863543 22809 raft_consensus.cc:504] T 1af9ae9b381e480b85d2efd8c58d453b P e934fc72e9bf430895b18ddfddac2c7d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6e8360424fb444eb7d9a1ee55c824e1" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37443 } } peers { permanent_uuid: "e934fc72e9bf430895b18ddfddac2c7d" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35749 } } peers { permanent_uuid: "0be5c2fe77b24afb982c3c286718a28a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 43129 } }
I20260810 15:25:29.863708 22809 leader_election.cc:288] T 1af9ae9b381e480b85d2efd8c58d453b P e934fc72e9bf430895b18ddfddac2c7d [CANDIDATE]: Term 1 election: Requested vote from peers a6e8360424fb444eb7d9a1ee55c824e1 (127.18.68.131:37443), 0be5c2fe77b24afb982c3c286718a28a (127.18.68.130:43129)
I20260810 15:25:29.863729 22146 raft_consensus.cc:2379] T 1af9ae9b381e480b85d2efd8c58d453b P e934fc72e9bf430895b18ddfddac2c7d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a6e8360424fb444eb7d9a1ee55c824e1 in current term 1: Already voted for candidate e934fc72e9bf430895b18ddfddac2c7d in this term.
I20260810 15:25:29.863802 22663 raft_consensus.cc:2379] T 1af9ae9b381e480b85d2efd8c58d453b P a6e8360424fb444eb7d9a1ee55c824e1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e934fc72e9bf430895b18ddfddac2c7d in current term 1: Already voted for candidate a6e8360424fb444eb7d9a1ee55c824e1 in this term.
I20260810 15:25:29.863886 22662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1af9ae9b381e480b85d2efd8c58d453b" candidate_uuid: "e934fc72e9bf430895b18ddfddac2c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6e8360424fb444eb7d9a1ee55c824e1"
I20260810 15:25:29.864007 22403 raft_consensus.cc:2454] T 1af9ae9b381e480b85d2efd8c58d453b P 0be5c2fe77b24afb982c3c286718a28a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6e8360424fb444eb7d9a1ee55c824e1 in term 1.
I20260810 15:25:29.864146 22402 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1af9ae9b381e480b85d2efd8c58d453b" candidate_uuid: "e934fc72e9bf430895b18ddfddac2c7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0be5c2fe77b24afb982c3c286718a28a"
I20260810 15:25:29.864246 22402 raft_consensus.cc:2379] T 1af9ae9b381e480b85d2efd8c58d453b P 0be5c2fe77b24afb982c3c286718a28a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e934fc72e9bf430895b18ddfddac2c7d in current term 1: Already voted for candidate a6e8360424fb444eb7d9a1ee55c824e1 in this term.
I20260810 15:25:29.864441 22027 leader_election.cc:302] T 1af9ae9b381e480b85d2efd8c58d453b P e934fc72e9bf430895b18ddfddac2c7d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e934fc72e9bf430895b18ddfddac2c7d; no voters: 0be5c2fe77b24afb982c3c286718a28a, a6e8360424fb444eb7d9a1ee55c824e1
I20260810 15:25:29.864470 22538 leader_election.cc:302] T 1af9ae9b381e480b85d2efd8c58d453b P a6e8360424fb444eb7d9a1ee55c824e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0be5c2fe77b24afb982c3c286718a28a, a6e8360424fb444eb7d9a1ee55c824e1; no voters: e934fc72e9bf430895b18ddfddac2c7d
I20260810 15:25:29.864547 22809 raft_consensus.cc:2726] T 1af9ae9b381e480b85d2efd8c58d453b P e934fc72e9bf430895b18ddfddac2c7d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260810 15:25:29.864603 22804 raft_consensus.cc:2781] T 1af9ae9b381e480b85d2efd8c58d453b P a6e8360424fb444eb7d9a1ee55c824e1 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 15:25:29.864770 22804 raft_consensus.cc:686] T 1af9ae9b381e480b85d2efd8c58d453b P a6e8360424fb444eb7d9a1ee55c824e1 [term 1 LEADER]: Becoming Leader. State: Replica: a6e8360424fb444eb7d9a1ee55c824e1, State: Running, Role: LEADER
I20260810 15:25:29.864867 22804 consensus_queue.cc:237] T 1af9ae9b381e480b85d2efd8c58d453b P a6e8360424fb444eb7d9a1ee55c824e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6e8360424fb444eb7d9a1ee55c824e1" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37443 } } peers { permanent_uuid: "e934fc72e9bf430895b18ddfddac2c7d" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35749 } } peers { permanent_uuid: "0be5c2fe77b24afb982c3c286718a28a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 43129 } }
I20260810 15:25:29.865751 21870 catalog_manager.cc:5495] T 1af9ae9b381e480b85d2efd8c58d453b P a6e8360424fb444eb7d9a1ee55c824e1 reported cstate change: term changed from 0 to 1, leader changed from <none> to a6e8360424fb444eb7d9a1ee55c824e1 (127.18.68.131). New cstate: current_term: 1 leader_uuid: "a6e8360424fb444eb7d9a1ee55c824e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6e8360424fb444eb7d9a1ee55c824e1" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e934fc72e9bf430895b18ddfddac2c7d" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0be5c2fe77b24afb982c3c286718a28a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 43129 } health_report { overall_health: UNKNOWN } } }
W20260810 15:25:29.897820 22745 tablet.cc:2369] T 1af9ae9b381e480b85d2efd8c58d453b P a6e8360424fb444eb7d9a1ee55c824e1: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 10 15:25:29 dist-test-slave-2p8l krb5kdc[21793](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375529, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.190@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
I20260810 15:25:29.905776 22830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:29.898866 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:41667 (local address 127.0.0.1:58316)
0810 15:25:29.899042 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:29.899056 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:29.899126 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:29.899274 (+ 148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:29.899275 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:29.899572 (+ 297us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:25:29.899622 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:29.899624 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:29.900243 (+ 619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:29.900244 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:29.900761 (+ 517us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:29.900763 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:29.901077 (+ 314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:29.901078 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:29.901118 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:29.901648 (+ 530us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:25:29.901653 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:25:29.903048 (+ 1395us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:25:29.904670 (+ 1622us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:29.904677 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:29.904679 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:29.904868 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:29.905098 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:29.905099 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:29.905100 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:29.905183 (+ 83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:29.905443 (+ 260us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:25:29.905451 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:25:29.905499 (+ 48us) client_negotiation.cc:769] Sending connection context
0810 15:25:29.905573 (+ 74us) client_negotiation.cc:240] Negotiation successful
0810 15:25:29.905682 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":108,"threads_started":1}
I20260810 15:25:29.905833 21955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:29.898952 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58316 (local address 127.18.68.190:41667)
0810 15:25:29.899026 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:29.899028 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:29.899131 (+ 103us) server_negotiation.cc:407] Connection header received
0810 15:25:29.899179 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:29.899180 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:29.899189 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:29.899266 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:29.899693 (+ 427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:29.900173 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:29.900836 (+ 663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:29.901011 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:29.901063 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:29.903141 (+ 2078us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:29.903142 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:29.903143 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:29.903149 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:29.904591 (+ 1442us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:29.904932 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:29.904932 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:29.904933 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:29.904984 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:29.905273 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:29.905273 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:29.905274 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:29.905373 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:29.905424 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:29.905601 (+ 177us) server_negotiation.cc:299] Negotiation successful
0810 15:25:29.905741 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":75,"server-negotiator.queue_time_us":43}
I20260810 15:25:29.907972 21870 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.18.68.190@KRBTEST.COM'} at 127.0.0.1:58316:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260810 15:25:29.908160 21870 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 15:25:29.909750 22107 tablet_service.cc:1467] Processing CreateTablet for tablet 8e1162322626452eb335db415fdf72c9 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=7214dbe51b7c492c9d0c4779c28d44a0]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 15:25:29.909749 22361 tablet_service.cc:1467] Processing CreateTablet for tablet 8e1162322626452eb335db415fdf72c9 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=7214dbe51b7c492c9d0c4779c28d44a0]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 15:25:29.909780 22622 tablet_service.cc:1467] Processing CreateTablet for tablet 8e1162322626452eb335db415fdf72c9 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=7214dbe51b7c492c9d0c4779c28d44a0]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 15:25:29.909934 22361 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8e1162322626452eb335db415fdf72c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:25:29.909934 22107 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8e1162322626452eb335db415fdf72c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:25:29.909965 22622 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8e1162322626452eb335db415fdf72c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:25:29.911497 22798 tablet_bootstrap.cc:492] T 8e1162322626452eb335db415fdf72c9 P e934fc72e9bf430895b18ddfddac2c7d: Bootstrap starting.
I20260810 15:25:29.911533 22796 tablet_bootstrap.cc:492] T 8e1162322626452eb335db415fdf72c9 P a6e8360424fb444eb7d9a1ee55c824e1: Bootstrap starting.
I20260810 15:25:29.911995 22796 tablet_bootstrap.cc:654] T 8e1162322626452eb335db415fdf72c9 P a6e8360424fb444eb7d9a1ee55c824e1: Neither blocks nor log segments found. Creating new log.
I20260810 15:25:29.912006 22798 tablet_bootstrap.cc:654] T 8e1162322626452eb335db415fdf72c9 P e934fc72e9bf430895b18ddfddac2c7d: Neither blocks nor log segments found. Creating new log.
I20260810 15:25:29.912622 22807 tablet_bootstrap.cc:492] T 8e1162322626452eb335db415fdf72c9 P 0be5c2fe77b24afb982c3c286718a28a: Bootstrap starting.
I20260810 15:25:29.912787 22796 tablet_bootstrap.cc:492] T 8e1162322626452eb335db415fdf72c9 P a6e8360424fb444eb7d9a1ee55c824e1: No bootstrap required, opened a new log
I20260810 15:25:29.912849 22796 ts_tablet_manager.cc:1397] T 8e1162322626452eb335db415fdf72c9 P a6e8360424fb444eb7d9a1ee55c824e1: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260810 15:25:29.913069 22807 tablet_bootstrap.cc:654] T 8e1162322626452eb335db415fdf72c9 P 0be5c2fe77b24afb982c3c286718a28a: Neither blocks nor log segments found. Creating new log.
I20260810 15:25:29.913023 22796 raft_consensus.cc:348] T 8e1162322626452eb335db415fdf72c9 P a6e8360424fb444eb7d9a1ee55c824e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e934fc72e9bf430895b18ddfddac2c7d" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35749 } } peers { permanent_uuid: "0be5c2fe77b24afb982c3c286718a28a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 43129 } } peers { permanent_uuid: "a6e8360424fb444eb7d9a1ee55c824e1" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37443 } }
I20260810 15:25:29.913110 22796 raft_consensus.cc:374] T 8e1162322626452eb335db415fdf72c9 P a6e8360424fb444eb7d9a1ee55c824e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:25:29.913133 22796 raft_consensus.cc:729] T 8e1162322626452eb335db415fdf72c9 P a6e8360424fb444eb7d9a1ee55c824e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6e8360424fb444eb7d9a1ee55c824e1, State: Initialized, Role: FOLLOWER
I20260810 15:25:29.913196 22796 consensus_queue.cc:260] T 8e1162322626452eb335db415fdf72c9 P a6e8360424fb444eb7d9a1ee55c824e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e934fc72e9bf430895b18ddfddac2c7d" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35749 } } peers { permanent_uuid: "0be5c2fe77b24afb982c3c286718a28a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 43129 } } peers { permanent_uuid: "a6e8360424fb444eb7d9a1ee55c824e1" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37443 } }
I20260810 15:25:29.913327 22796 ts_tablet_manager.cc:1428] T 8e1162322626452eb335db415fdf72c9 P a6e8360424fb444eb7d9a1ee55c824e1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:29.913383 22798 tablet_bootstrap.cc:492] T 8e1162322626452eb335db415fdf72c9 P e934fc72e9bf430895b18ddfddac2c7d: No bootstrap required, opened a new log
I20260810 15:25:29.913439 22798 ts_tablet_manager.cc:1397] T 8e1162322626452eb335db415fdf72c9 P e934fc72e9bf430895b18ddfddac2c7d: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260810 15:25:29.913695 22798 raft_consensus.cc:348] T 8e1162322626452eb335db415fdf72c9 P e934fc72e9bf430895b18ddfddac2c7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e934fc72e9bf430895b18ddfddac2c7d" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35749 } } peers { permanent_uuid: "0be5c2fe77b24afb982c3c286718a28a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 43129 } } peers { permanent_uuid: "a6e8360424fb444eb7d9a1ee55c824e1" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37443 } }
I20260810 15:25:29.913784 22798 raft_consensus.cc:374] T 8e1162322626452eb335db415fdf72c9 P e934fc72e9bf430895b18ddfddac2c7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:25:29.913805 22798 raft_consensus.cc:729] T 8e1162322626452eb335db415fdf72c9 P e934fc72e9bf430895b18ddfddac2c7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e934fc72e9bf430895b18ddfddac2c7d, State: Initialized, Role: FOLLOWER
I20260810 15:25:29.913610 22804 tablet_replica.cc:439] T 8e1162322626452eb335db415fdf72c9 P a6e8360424fb444eb7d9a1ee55c824e1: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e934fc72e9bf430895b18ddfddac2c7d" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35749 } } peers { permanent_uuid: "0be5c2fe77b24afb982c3c286718a28a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 43129 } } peers { permanent_uuid: "a6e8360424fb444eb7d9a1ee55c824e1" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37443 } } }
I20260810 15:25:29.913880 22804 tablet_replica.cc:442] T 8e1162322626452eb335db415fdf72c9 P a6e8360424fb444eb7d9a1ee55c824e1: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 15:25:29.913892 22798 consensus_queue.cc:260] T 8e1162322626452eb335db415fdf72c9 P e934fc72e9bf430895b18ddfddac2c7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e934fc72e9bf430895b18ddfddac2c7d" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35749 } } peers { permanent_uuid: "0be5c2fe77b24afb982c3c286718a28a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 43129 } } peers { permanent_uuid: "a6e8360424fb444eb7d9a1ee55c824e1" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37443 } }
I20260810 15:25:29.914009 22798 ts_tablet_manager.cc:1428] T 8e1162322626452eb335db415fdf72c9 P e934fc72e9bf430895b18ddfddac2c7d: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260810 15:25:29.914077 22809 tablet_replica.cc:439] T 8e1162322626452eb335db415fdf72c9 P e934fc72e9bf430895b18ddfddac2c7d: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e934fc72e9bf430895b18ddfddac2c7d" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35749 } } peers { permanent_uuid: "0be5c2fe77b24afb982c3c286718a28a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 43129 } } peers { permanent_uuid: "a6e8360424fb444eb7d9a1ee55c824e1" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37443 } } }
I20260810 15:25:29.914201 22809 tablet_replica.cc:442] T 8e1162322626452eb335db415fdf72c9 P e934fc72e9bf430895b18ddfddac2c7d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 15:25:29.914750 22807 tablet_bootstrap.cc:492] T 8e1162322626452eb335db415fdf72c9 P 0be5c2fe77b24afb982c3c286718a28a: No bootstrap required, opened a new log
I20260810 15:25:29.914819 22807 ts_tablet_manager.cc:1397] T 8e1162322626452eb335db415fdf72c9 P 0be5c2fe77b24afb982c3c286718a28a: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 15:25:29.915031 22807 raft_consensus.cc:348] T 8e1162322626452eb335db415fdf72c9 P 0be5c2fe77b24afb982c3c286718a28a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e934fc72e9bf430895b18ddfddac2c7d" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35749 } } peers { permanent_uuid: "0be5c2fe77b24afb982c3c286718a28a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 43129 } } peers { permanent_uuid: "a6e8360424fb444eb7d9a1ee55c824e1" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37443 } }
I20260810 15:25:29.915122 22807 raft_consensus.cc:374] T 8e1162322626452eb335db415fdf72c9 P 0be5c2fe77b24afb982c3c286718a28a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:25:29.915148 22807 raft_consensus.cc:729] T 8e1162322626452eb335db415fdf72c9 P 0be5c2fe77b24afb982c3c286718a28a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0be5c2fe77b24afb982c3c286718a28a, State: Initialized, Role: FOLLOWER
I20260810 15:25:29.915199 22807 consensus_queue.cc:260] T 8e1162322626452eb335db415fdf72c9 P 0be5c2fe77b24afb982c3c286718a28a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e934fc72e9bf430895b18ddfddac2c7d" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35749 } } peers { permanent_uuid: "0be5c2fe77b24afb982c3c286718a28a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 43129 } } peers { permanent_uuid: "a6e8360424fb444eb7d9a1ee55c824e1" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37443 } }
I20260810 15:25:29.915304 22807 ts_tablet_manager.cc:1428] T 8e1162322626452eb335db415fdf72c9 P 0be5c2fe77b24afb982c3c286718a28a: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:29.915409 22811 tablet_replica.cc:439] T 8e1162322626452eb335db415fdf72c9 P 0be5c2fe77b24afb982c3c286718a28a: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e934fc72e9bf430895b18ddfddac2c7d" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35749 } } peers { permanent_uuid: "0be5c2fe77b24afb982c3c286718a28a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 43129 } } peers { permanent_uuid: "a6e8360424fb444eb7d9a1ee55c824e1" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37443 } } }
I20260810 15:25:29.915536 22811 tablet_replica.cc:442] T 8e1162322626452eb335db415fdf72c9 P 0be5c2fe77b24afb982c3c286718a28a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 15:25:30.059783 22804 raft_consensus.cc:482] T 8e1162322626452eb335db415fdf72c9 P a6e8360424fb444eb7d9a1ee55c824e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 15:25:30.059887 22804 raft_consensus.cc:504] T 8e1162322626452eb335db415fdf72c9 P a6e8360424fb444eb7d9a1ee55c824e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e934fc72e9bf430895b18ddfddac2c7d" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35749 } } peers { permanent_uuid: "0be5c2fe77b24afb982c3c286718a28a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 43129 } } peers { permanent_uuid: "a6e8360424fb444eb7d9a1ee55c824e1" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37443 } }
I20260810 15:25:30.060187 22804 leader_election.cc:288] T 8e1162322626452eb335db415fdf72c9 P a6e8360424fb444eb7d9a1ee55c824e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e934fc72e9bf430895b18ddfddac2c7d (127.18.68.129:35749), 0be5c2fe77b24afb982c3c286718a28a (127.18.68.130:43129)
I20260810 15:25:30.060339 22146 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e1162322626452eb335db415fdf72c9" candidate_uuid: "a6e8360424fb444eb7d9a1ee55c824e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e934fc72e9bf430895b18ddfddac2c7d" is_pre_election: true
I20260810 15:25:30.060487 22146 raft_consensus.cc:2454] T 8e1162322626452eb335db415fdf72c9 P e934fc72e9bf430895b18ddfddac2c7d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6e8360424fb444eb7d9a1ee55c824e1 in term 0.
I20260810 15:25:30.060447 22402 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e1162322626452eb335db415fdf72c9" candidate_uuid: "a6e8360424fb444eb7d9a1ee55c824e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0be5c2fe77b24afb982c3c286718a28a" is_pre_election: true
I20260810 15:25:30.060567 22402 raft_consensus.cc:2454] T 8e1162322626452eb335db415fdf72c9 P 0be5c2fe77b24afb982c3c286718a28a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6e8360424fb444eb7d9a1ee55c824e1 in term 0.
I20260810 15:25:30.060679 22539 leader_election.cc:302] T 8e1162322626452eb335db415fdf72c9 P a6e8360424fb444eb7d9a1ee55c824e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a6e8360424fb444eb7d9a1ee55c824e1, e934fc72e9bf430895b18ddfddac2c7d; no voters:
I20260810 15:25:30.060796 22804 raft_consensus.cc:2781] T 8e1162322626452eb335db415fdf72c9 P a6e8360424fb444eb7d9a1ee55c824e1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 15:25:30.060839 22804 raft_consensus.cc:482] T 8e1162322626452eb335db415fdf72c9 P a6e8360424fb444eb7d9a1ee55c824e1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 15:25:30.060860 22804 raft_consensus.cc:3037] T 8e1162322626452eb335db415fdf72c9 P a6e8360424fb444eb7d9a1ee55c824e1 [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:25:30.061614 22804 raft_consensus.cc:504] T 8e1162322626452eb335db415fdf72c9 P a6e8360424fb444eb7d9a1ee55c824e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e934fc72e9bf430895b18ddfddac2c7d" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35749 } } peers { permanent_uuid: "0be5c2fe77b24afb982c3c286718a28a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 43129 } } peers { permanent_uuid: "a6e8360424fb444eb7d9a1ee55c824e1" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37443 } }
I20260810 15:25:30.061829 22804 leader_election.cc:288] T 8e1162322626452eb335db415fdf72c9 P a6e8360424fb444eb7d9a1ee55c824e1 [CANDIDATE]: Term 1 election: Requested vote from peers e934fc72e9bf430895b18ddfddac2c7d (127.18.68.129:35749), 0be5c2fe77b24afb982c3c286718a28a (127.18.68.130:43129)
I20260810 15:25:30.061933 22146 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e1162322626452eb335db415fdf72c9" candidate_uuid: "a6e8360424fb444eb7d9a1ee55c824e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e934fc72e9bf430895b18ddfddac2c7d"
I20260810 15:25:30.061933 22402 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e1162322626452eb335db415fdf72c9" candidate_uuid: "a6e8360424fb444eb7d9a1ee55c824e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0be5c2fe77b24afb982c3c286718a28a"
I20260810 15:25:30.062027 22402 raft_consensus.cc:3037] T 8e1162322626452eb335db415fdf72c9 P 0be5c2fe77b24afb982c3c286718a28a [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:25:30.062027 22146 raft_consensus.cc:3037] T 8e1162322626452eb335db415fdf72c9 P e934fc72e9bf430895b18ddfddac2c7d [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:25:30.062944 22146 raft_consensus.cc:2454] T 8e1162322626452eb335db415fdf72c9 P e934fc72e9bf430895b18ddfddac2c7d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6e8360424fb444eb7d9a1ee55c824e1 in term 1.
I20260810 15:25:30.062944 22402 raft_consensus.cc:2454] T 8e1162322626452eb335db415fdf72c9 P 0be5c2fe77b24afb982c3c286718a28a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6e8360424fb444eb7d9a1ee55c824e1 in term 1.
I20260810 15:25:30.063134 22538 leader_election.cc:302] T 8e1162322626452eb335db415fdf72c9 P a6e8360424fb444eb7d9a1ee55c824e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0be5c2fe77b24afb982c3c286718a28a, a6e8360424fb444eb7d9a1ee55c824e1; no voters:
I20260810 15:25:30.063232 22804 raft_consensus.cc:2781] T 8e1162322626452eb335db415fdf72c9 P a6e8360424fb444eb7d9a1ee55c824e1 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 15:25:30.063284 22804 raft_consensus.cc:686] T 8e1162322626452eb335db415fdf72c9 P a6e8360424fb444eb7d9a1ee55c824e1 [term 1 LEADER]: Becoming Leader. State: Replica: a6e8360424fb444eb7d9a1ee55c824e1, State: Running, Role: LEADER
I20260810 15:25:30.063344 22804 consensus_queue.cc:237] T 8e1162322626452eb335db415fdf72c9 P a6e8360424fb444eb7d9a1ee55c824e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e934fc72e9bf430895b18ddfddac2c7d" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35749 } } peers { permanent_uuid: "0be5c2fe77b24afb982c3c286718a28a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 43129 } } peers { permanent_uuid: "a6e8360424fb444eb7d9a1ee55c824e1" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37443 } }
I20260810 15:25:30.064982 22819 tablet_replica.cc:439] T 8e1162322626452eb335db415fdf72c9 P a6e8360424fb444eb7d9a1ee55c824e1: TxnStatusTablet state changed. Reason: New leader a6e8360424fb444eb7d9a1ee55c824e1. Latest consensus state: current_term: 1 leader_uuid: "a6e8360424fb444eb7d9a1ee55c824e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e934fc72e9bf430895b18ddfddac2c7d" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35749 } } peers { permanent_uuid: "0be5c2fe77b24afb982c3c286718a28a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 43129 } } peers { permanent_uuid: "a6e8360424fb444eb7d9a1ee55c824e1" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37443 } } }
I20260810 15:25:30.065104 22819 tablet_replica.cc:442] T 8e1162322626452eb335db415fdf72c9 P a6e8360424fb444eb7d9a1ee55c824e1: This TxnStatusTablet replica's current role is: LEADER
I20260810 15:25:30.065322 22839 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260810 15:25:30.065351 21867 catalog_manager.cc:5495] T 8e1162322626452eb335db415fdf72c9 P a6e8360424fb444eb7d9a1ee55c824e1 reported cstate change: term changed from 0 to 1, leader changed from <none> to a6e8360424fb444eb7d9a1ee55c824e1 (127.18.68.131). New cstate: current_term: 1 leader_uuid: "a6e8360424fb444eb7d9a1ee55c824e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e934fc72e9bf430895b18ddfddac2c7d" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0be5c2fe77b24afb982c3c286718a28a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 43129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6e8360424fb444eb7d9a1ee55c824e1" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37443 } health_report { overall_health: HEALTHY } } }
I20260810 15:25:30.065487 22839 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260810 15:25:30.097337 22795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:30.094875 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46382 (local address 127.18.68.131:37443)
0810 15:25:30.094930 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:30.094932 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:30.094944 (+ 12us) server_negotiation.cc:407] Connection header received
0810 15:25:30.094986 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:30.094988 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:30.095015 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:30.095089 (+ 74us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 15:25:30.095209 (+ 120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:30.095721 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:30.096485 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:30.096687 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:30.096767 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:30.096982 (+ 215us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 15:25:30.097083 (+ 101us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 15:25:30.097183 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:30.097228 (+ 45us) server_negotiation.cc:299] Negotiation successful
0810 15:25:30.097251 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260810 15:25:30.097353 22830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:30.094764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.131:37443 (local address 127.0.0.1:46382)
0810 15:25:30.094847 (+ 83us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:30.094859 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:30.094910 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:30.095097 (+ 187us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:30.095098 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:30.095099 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 15:25:30.095151 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:30.095153 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:30.095813 (+ 660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:30.095815 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:30.096393 (+ 578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:30.096395 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:30.096767 (+ 372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:30.096769 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:30.096847 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:30.096870 (+ 23us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 15:25:30.097158 (+ 288us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 15:25:30.097169 (+ 11us) client_negotiation.cc:769] Sending connection context
0810 15:25:30.097216 (+ 47us) client_negotiation.cc:240] Negotiation successful
0810 15:25:30.097273 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43}
I20260810 15:25:30.099200 22146 raft_consensus.cc:1261] T 8e1162322626452eb335db415fdf72c9 P e934fc72e9bf430895b18ddfddac2c7d [term 1 FOLLOWER]: Refusing update from remote peer a6e8360424fb444eb7d9a1ee55c824e1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 15:25:30.099231 22402 raft_consensus.cc:1261] T 8e1162322626452eb335db415fdf72c9 P 0be5c2fe77b24afb982c3c286718a28a [term 1 FOLLOWER]: Refusing update from remote peer a6e8360424fb444eb7d9a1ee55c824e1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 15:25:30.099578 22819 consensus_queue.cc:1035] T 8e1162322626452eb335db415fdf72c9 P a6e8360424fb444eb7d9a1ee55c824e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e934fc72e9bf430895b18ddfddac2c7d" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 15:25:30.099761 22804 consensus_queue.cc:1035] T 8e1162322626452eb335db415fdf72c9 P a6e8360424fb444eb7d9a1ee55c824e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0be5c2fe77b24afb982c3c286718a28a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 43129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 15:25:30.101099 22811 tablet_replica.cc:439] T 8e1162322626452eb335db415fdf72c9 P 0be5c2fe77b24afb982c3c286718a28a: TxnStatusTablet state changed. Reason: New leader a6e8360424fb444eb7d9a1ee55c824e1. Latest consensus state: current_term: 1 leader_uuid: "a6e8360424fb444eb7d9a1ee55c824e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e934fc72e9bf430895b18ddfddac2c7d" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35749 } } peers { permanent_uuid: "0be5c2fe77b24afb982c3c286718a28a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 43129 } } peers { permanent_uuid: "a6e8360424fb444eb7d9a1ee55c824e1" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37443 } } }
I20260810 15:25:30.101193 22811 tablet_replica.cc:442] T 8e1162322626452eb335db415fdf72c9 P 0be5c2fe77b24afb982c3c286718a28a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 15:25:30.101123 22809 tablet_replica.cc:439] T 8e1162322626452eb335db415fdf72c9 P e934fc72e9bf430895b18ddfddac2c7d: TxnStatusTablet state changed. Reason: New leader a6e8360424fb444eb7d9a1ee55c824e1. Latest consensus state: current_term: 1 leader_uuid: "a6e8360424fb444eb7d9a1ee55c824e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e934fc72e9bf430895b18ddfddac2c7d" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35749 } } peers { permanent_uuid: "0be5c2fe77b24afb982c3c286718a28a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 43129 } } peers { permanent_uuid: "a6e8360424fb444eb7d9a1ee55c824e1" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37443 } } }
I20260810 15:25:30.101226 22809 tablet_replica.cc:442] T 8e1162322626452eb335db415fdf72c9 P e934fc72e9bf430895b18ddfddac2c7d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 15:25:30.102380 22819 tablet_replica.cc:439] T 8e1162322626452eb335db415fdf72c9 P a6e8360424fb444eb7d9a1ee55c824e1: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a6e8360424fb444eb7d9a1ee55c824e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e934fc72e9bf430895b18ddfddac2c7d" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35749 } } peers { permanent_uuid: "0be5c2fe77b24afb982c3c286718a28a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 43129 } } peers { permanent_uuid: "a6e8360424fb444eb7d9a1ee55c824e1" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37443 } } }
I20260810 15:25:30.102469 22819 tablet_replica.cc:442] T 8e1162322626452eb335db415fdf72c9 P a6e8360424fb444eb7d9a1ee55c824e1: This TxnStatusTablet replica's current role is: LEADER
I20260810 15:25:30.102514 22819 tablet_replica.cc:439] T 8e1162322626452eb335db415fdf72c9 P a6e8360424fb444eb7d9a1ee55c824e1: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a6e8360424fb444eb7d9a1ee55c824e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e934fc72e9bf430895b18ddfddac2c7d" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35749 } } peers { permanent_uuid: "0be5c2fe77b24afb982c3c286718a28a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 43129 } } peers { permanent_uuid: "a6e8360424fb444eb7d9a1ee55c824e1" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37443 } } }
I20260810 15:25:30.102560 22819 tablet_replica.cc:442] T 8e1162322626452eb335db415fdf72c9 P a6e8360424fb444eb7d9a1ee55c824e1: This TxnStatusTablet replica's current role is: LEADER
I20260810 15:25:30.103119 22809 tablet_replica.cc:439] T 8e1162322626452eb335db415fdf72c9 P e934fc72e9bf430895b18ddfddac2c7d: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a6e8360424fb444eb7d9a1ee55c824e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e934fc72e9bf430895b18ddfddac2c7d" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35749 } } peers { permanent_uuid: "0be5c2fe77b24afb982c3c286718a28a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 43129 } } peers { permanent_uuid: "a6e8360424fb444eb7d9a1ee55c824e1" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37443 } } }
I20260810 15:25:30.103120 22846 mvcc.cc:205] Tried to move back new op lower bound from 7316994171283685376 to 7316994171139878912. Current Snapshot: MvccSnapshot[applied={T|T < 7316994171283685376}]
I20260810 15:25:30.103237 22809 tablet_replica.cc:442] T 8e1162322626452eb335db415fdf72c9 P e934fc72e9bf430895b18ddfddac2c7d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 15:25:30.103286 22845 mvcc.cc:205] Tried to move back new op lower bound from 7316994171283685376 to 7316994171139878912. Current Snapshot: MvccSnapshot[applied={T|T < 7316994171283685376}]
I20260810 15:25:30.103376 22811 tablet_replica.cc:439] T 8e1162322626452eb335db415fdf72c9 P 0be5c2fe77b24afb982c3c286718a28a: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a6e8360424fb444eb7d9a1ee55c824e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e934fc72e9bf430895b18ddfddac2c7d" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35749 } } peers { permanent_uuid: "0be5c2fe77b24afb982c3c286718a28a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 43129 } } peers { permanent_uuid: "a6e8360424fb444eb7d9a1ee55c824e1" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37443 } } }
I20260810 15:25:30.103446 22811 tablet_replica.cc:442] T 8e1162322626452eb335db415fdf72c9 P 0be5c2fe77b24afb982c3c286718a28a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 15:25:30.107654 22795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:30.105295 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46386 (local address 127.18.68.131:37443)
0810 15:25:30.105338 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:30.105340 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:30.105350 (+ 10us) server_negotiation.cc:407] Connection header received
0810 15:25:30.105402 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:30.105403 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:30.105414 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:30.105456 (+ 42us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 15:25:30.105642 (+ 186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:30.106161 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:30.106928 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:30.107133 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:30.107218 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:30.107409 (+ 191us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 15:25:30.107442 (+ 33us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 15:25:30.107493 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:30.107561 (+ 68us) server_negotiation.cc:299] Negotiation successful
0810 15:25:30.107580 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260810 15:25:30.112512 22795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:30.110077 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.131:35537 (local address 127.18.68.131:37443)
0810 15:25:30.110109 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:30.110111 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:30.110120 (+ 9us) server_negotiation.cc:407] Connection header received
0810 15:25:30.110189 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:30.110190 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:30.110197 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:30.110235 (+ 38us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 15:25:30.110391 (+ 156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:30.110799 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:30.111873 (+ 1074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:30.112039 (+ 166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:30.112088 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:30.112298 (+ 210us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 15:25:30.112321 (+ 23us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 15:25:30.112354 (+ 33us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:30.112432 (+ 78us) server_negotiation.cc:299] Negotiation successful
0810 15:25:30.112450 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":14}
I20260810 15:25:30.112600 22754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:30.109979 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.131:37443 (local address 127.18.68.131:35537)
0810 15:25:30.110044 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:30.110055 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:30.110136 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:30.110259 (+ 123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:30.110259 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:30.110261 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 15:25:30.110330 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:30.110331 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:30.110868 (+ 537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:30.110869 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:30.111790 (+ 921us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:30.111793 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:30.112109 (+ 316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:30.112110 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:30.112183 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:30.112199 (+ 16us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 15:25:30.112377 (+ 178us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 15:25:30.112379 (+ 2us) client_negotiation.cc:769] Sending connection context
0810 15:25:30.112430 (+ 51us) client_negotiation.cc:240] Negotiation successful
0810 15:25:30.112475 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":23,"mutex_wait_us":1}
I20260810 15:25:30.114737 22402 raft_consensus.cc:1261] T 1af9ae9b381e480b85d2efd8c58d453b P 0be5c2fe77b24afb982c3c286718a28a [term 1 FOLLOWER]: Refusing update from remote peer a6e8360424fb444eb7d9a1ee55c824e1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 15:25:30.114768 22146 raft_consensus.cc:1261] T 1af9ae9b381e480b85d2efd8c58d453b P e934fc72e9bf430895b18ddfddac2c7d [term 1 FOLLOWER]: Refusing update from remote peer a6e8360424fb444eb7d9a1ee55c824e1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 15:25:30.114956 22819 consensus_queue.cc:1035] T 1af9ae9b381e480b85d2efd8c58d453b P a6e8360424fb444eb7d9a1ee55c824e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e934fc72e9bf430895b18ddfddac2c7d" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 15:25:30.115062 22804 consensus_queue.cc:1035] T 1af9ae9b381e480b85d2efd8c58d453b P a6e8360424fb444eb7d9a1ee55c824e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0be5c2fe77b24afb982c3c286718a28a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 43129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 15:25:30.116588 22844 mvcc.cc:205] Tried to move back new op lower bound from 7316994171348389888 to 7316994170327138304. Current Snapshot: MvccSnapshot[applied={T|T < 7316994171348389888}]
I20260810 15:25:30.129253 21870 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58312:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 15:25:30.129369 21870 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58312:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 15:25:30.130125 21870 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 511c7f22094c4364b143e11cf834e945: Sending DeleteTablet for 3 replicas of tablet 1af9ae9b381e480b85d2efd8c58d453b
I20260810 15:25:30.130471 22361 tablet_service.cc:1514] Processing DeleteTablet for tablet 1af9ae9b381e480b85d2efd8c58d453b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 15:25:30 UTC) from {username='kudu', principal='kudu/127.18.68.190@KRBTEST.COM'} at 127.0.0.1:46564
I20260810 15:25:30.130446 22107 tablet_service.cc:1514] Processing DeleteTablet for tablet 1af9ae9b381e480b85d2efd8c58d453b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 15:25:30 UTC) from {username='kudu', principal='kudu/127.18.68.190@KRBTEST.COM'} at 127.0.0.1:44844
I20260810 15:25:30.130720 22880 tablet_replica.cc:330] T 1af9ae9b381e480b85d2efd8c58d453b P e934fc72e9bf430895b18ddfddac2c7d: stopping tablet replica
I20260810 15:25:30.130739 22620 tablet_service.cc:1514] Processing DeleteTablet for tablet 1af9ae9b381e480b85d2efd8c58d453b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 15:25:30 UTC) from {username='kudu', principal='kudu/127.18.68.190@KRBTEST.COM'} at 127.0.0.1:46374
I20260810 15:25:30.130832 22880 raft_consensus.cc:2229] T 1af9ae9b381e480b85d2efd8c58d453b P e934fc72e9bf430895b18ddfddac2c7d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 15:25:30.130889 22880 raft_consensus.cc:2258] T 1af9ae9b381e480b85d2efd8c58d453b P e934fc72e9bf430895b18ddfddac2c7d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 15:25:30.131042 22878 tablet_replica.cc:330] T 1af9ae9b381e480b85d2efd8c58d453b P 0be5c2fe77b24afb982c3c286718a28a: stopping tablet replica
I20260810 15:25:30.131146 22878 raft_consensus.cc:2229] T 1af9ae9b381e480b85d2efd8c58d453b P 0be5c2fe77b24afb982c3c286718a28a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 15:25:30.131207 22878 raft_consensus.cc:2258] T 1af9ae9b381e480b85d2efd8c58d453b P 0be5c2fe77b24afb982c3c286718a28a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 15:25:30.131156 22881 tablet_replica.cc:330] T 1af9ae9b381e480b85d2efd8c58d453b P a6e8360424fb444eb7d9a1ee55c824e1: stopping tablet replica
I20260810 15:25:30.131212 21870 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58312:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 15:25:30.131367 21870 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 15:25:30.131488 22881 raft_consensus.cc:2229] T 1af9ae9b381e480b85d2efd8c58d453b P a6e8360424fb444eb7d9a1ee55c824e1 [term 1 LEADER]: Raft consensus shutting down.
I20260810 15:25:30.131829 22881 raft_consensus.cc:2258] T 1af9ae9b381e480b85d2efd8c58d453b P a6e8360424fb444eb7d9a1ee55c824e1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 15:25:30.131898 22880 ts_tablet_manager.cc:1905] T 1af9ae9b381e480b85d2efd8c58d453b P e934fc72e9bf430895b18ddfddac2c7d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 15:25:30.132536 22107 tablet_service.cc:1467] Processing CreateTablet for tablet c2aa5ac381824c78bfffd0340a2eaa28 (DEFAULT_TABLE table=test-table [id=9ff9732e50fc4d1699ed425f217d675c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 15:25:30.132637 22620 tablet_service.cc:1467] Processing CreateTablet for tablet c2aa5ac381824c78bfffd0340a2eaa28 (DEFAULT_TABLE table=test-table [id=9ff9732e50fc4d1699ed425f217d675c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 15:25:30.132668 22107 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c2aa5ac381824c78bfffd0340a2eaa28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:25:30.132751 22620 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c2aa5ac381824c78bfffd0340a2eaa28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:25:30.133759 22880 ts_tablet_manager.cc:1918] T 1af9ae9b381e480b85d2efd8c58d453b P e934fc72e9bf430895b18ddfddac2c7d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 15:25:30.133827 22880 log.cc:1196] T 1af9ae9b381e480b85d2efd8c58d453b P e934fc72e9bf430895b18ddfddac2c7d: Deleting WAL directory at /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/minicluster-data/ts-0/wal/wals/1af9ae9b381e480b85d2efd8c58d453b
I20260810 15:25:30.134120 22798 tablet_bootstrap.cc:492] T c2aa5ac381824c78bfffd0340a2eaa28 P e934fc72e9bf430895b18ddfddac2c7d: Bootstrap starting.
I20260810 15:25:30.134156 22880 ts_tablet_manager.cc:1939] T 1af9ae9b381e480b85d2efd8c58d453b P e934fc72e9bf430895b18ddfddac2c7d: Deleting consensus metadata
I20260810 15:25:30.134301 22796 tablet_bootstrap.cc:492] T c2aa5ac381824c78bfffd0340a2eaa28 P a6e8360424fb444eb7d9a1ee55c824e1: Bootstrap starting.
I20260810 15:25:30.134533 22798 tablet_bootstrap.cc:654] T c2aa5ac381824c78bfffd0340a2eaa28 P e934fc72e9bf430895b18ddfddac2c7d: Neither blocks nor log segments found. Creating new log.
I20260810 15:25:30.134693 22796 tablet_bootstrap.cc:654] T c2aa5ac381824c78bfffd0340a2eaa28 P a6e8360424fb444eb7d9a1ee55c824e1: Neither blocks nor log segments found. Creating new log.
I20260810 15:25:30.134889 22361 tablet_service.cc:1467] Processing CreateTablet for tablet c2aa5ac381824c78bfffd0340a2eaa28 (DEFAULT_TABLE table=test-table [id=9ff9732e50fc4d1699ed425f217d675c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 15:25:30.135020 22361 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c2aa5ac381824c78bfffd0340a2eaa28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:25:30.135186 22798 tablet_bootstrap.cc:492] T c2aa5ac381824c78bfffd0340a2eaa28 P e934fc72e9bf430895b18ddfddac2c7d: No bootstrap required, opened a new log
I20260810 15:25:30.135224 22798 ts_tablet_manager.cc:1397] T c2aa5ac381824c78bfffd0340a2eaa28 P e934fc72e9bf430895b18ddfddac2c7d: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260810 15:25:30.135365 22798 raft_consensus.cc:348] T c2aa5ac381824c78bfffd0340a2eaa28 P e934fc72e9bf430895b18ddfddac2c7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e934fc72e9bf430895b18ddfddac2c7d" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35749 } } peers { permanent_uuid: "0be5c2fe77b24afb982c3c286718a28a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 43129 } } peers { permanent_uuid: "a6e8360424fb444eb7d9a1ee55c824e1" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37443 } }
I20260810 15:25:30.135421 22798 raft_consensus.cc:374] T c2aa5ac381824c78bfffd0340a2eaa28 P e934fc72e9bf430895b18ddfddac2c7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:25:30.135438 22798 raft_consensus.cc:729] T c2aa5ac381824c78bfffd0340a2eaa28 P e934fc72e9bf430895b18ddfddac2c7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e934fc72e9bf430895b18ddfddac2c7d, State: Initialized, Role: FOLLOWER
I20260810 15:25:30.135464 22798 consensus_queue.cc:260] T c2aa5ac381824c78bfffd0340a2eaa28 P e934fc72e9bf430895b18ddfddac2c7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e934fc72e9bf430895b18ddfddac2c7d" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35749 } } peers { permanent_uuid: "0be5c2fe77b24afb982c3c286718a28a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 43129 } } peers { permanent_uuid: "a6e8360424fb444eb7d9a1ee55c824e1" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37443 } }
I20260810 15:25:30.135546 22798 ts_tablet_manager.cc:1428] T c2aa5ac381824c78bfffd0340a2eaa28 P e934fc72e9bf430895b18ddfddac2c7d: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:30.136368 22807 tablet_bootstrap.cc:492] T c2aa5ac381824c78bfffd0340a2eaa28 P 0be5c2fe77b24afb982c3c286718a28a: Bootstrap starting.
I20260810 15:25:30.136740 22878 ts_tablet_manager.cc:1905] T 1af9ae9b381e480b85d2efd8c58d453b P 0be5c2fe77b24afb982c3c286718a28a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 15:25:30.136775 22807 tablet_bootstrap.cc:654] T c2aa5ac381824c78bfffd0340a2eaa28 P 0be5c2fe77b24afb982c3c286718a28a: Neither blocks nor log segments found. Creating new log.
I20260810 15:25:30.137064 21845 catalog_manager.cc:4841] TS e934fc72e9bf430895b18ddfddac2c7d (127.18.68.129:35749): tablet 1af9ae9b381e480b85d2efd8c58d453b (table test-table [id=2171c311dcc34bc6a9aca8d2a5218919]) successfully deleted
I20260810 15:25:30.137230 22881 ts_tablet_manager.cc:1905] T 1af9ae9b381e480b85d2efd8c58d453b P a6e8360424fb444eb7d9a1ee55c824e1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 15:25:30.137826 22807 tablet_bootstrap.cc:492] T c2aa5ac381824c78bfffd0340a2eaa28 P 0be5c2fe77b24afb982c3c286718a28a: No bootstrap required, opened a new log
I20260810 15:25:30.137882 22807 ts_tablet_manager.cc:1397] T c2aa5ac381824c78bfffd0340a2eaa28 P 0be5c2fe77b24afb982c3c286718a28a: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 15:25:30.138038 22807 raft_consensus.cc:348] T c2aa5ac381824c78bfffd0340a2eaa28 P 0be5c2fe77b24afb982c3c286718a28a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e934fc72e9bf430895b18ddfddac2c7d" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35749 } } peers { permanent_uuid: "0be5c2fe77b24afb982c3c286718a28a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 43129 } } peers { permanent_uuid: "a6e8360424fb444eb7d9a1ee55c824e1" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37443 } }
I20260810 15:25:30.138181 22807 raft_consensus.cc:374] T c2aa5ac381824c78bfffd0340a2eaa28 P 0be5c2fe77b24afb982c3c286718a28a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:25:30.138206 22807 raft_consensus.cc:729] T c2aa5ac381824c78bfffd0340a2eaa28 P 0be5c2fe77b24afb982c3c286718a28a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0be5c2fe77b24afb982c3c286718a28a, State: Initialized, Role: FOLLOWER
I20260810 15:25:30.138253 22807 consensus_queue.cc:260] T c2aa5ac381824c78bfffd0340a2eaa28 P 0be5c2fe77b24afb982c3c286718a28a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e934fc72e9bf430895b18ddfddac2c7d" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35749 } } peers { permanent_uuid: "0be5c2fe77b24afb982c3c286718a28a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 43129 } } peers { permanent_uuid: "a6e8360424fb444eb7d9a1ee55c824e1" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37443 } }
I20260810 15:25:30.138304 22878 ts_tablet_manager.cc:1918] T 1af9ae9b381e480b85d2efd8c58d453b P 0be5c2fe77b24afb982c3c286718a28a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 15:25:30.138355 22807 ts_tablet_manager.cc:1428] T c2aa5ac381824c78bfffd0340a2eaa28 P 0be5c2fe77b24afb982c3c286718a28a: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260810 15:25:30.138376 22878 log.cc:1196] T 1af9ae9b381e480b85d2efd8c58d453b P 0be5c2fe77b24afb982c3c286718a28a: Deleting WAL directory at /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/minicluster-data/ts-1/wal/wals/1af9ae9b381e480b85d2efd8c58d453b
I20260810 15:25:30.138653 22878 ts_tablet_manager.cc:1939] T 1af9ae9b381e480b85d2efd8c58d453b P 0be5c2fe77b24afb982c3c286718a28a: Deleting consensus metadata
I20260810 15:25:30.139114 21844 catalog_manager.cc:4841] TS 0be5c2fe77b24afb982c3c286718a28a (127.18.68.130:43129): tablet 1af9ae9b381e480b85d2efd8c58d453b (table test-table [id=2171c311dcc34bc6a9aca8d2a5218919]) successfully deleted
I20260810 15:25:30.139410 22881 ts_tablet_manager.cc:1918] T 1af9ae9b381e480b85d2efd8c58d453b P a6e8360424fb444eb7d9a1ee55c824e1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 15:25:30.139487 22881 log.cc:1196] T 1af9ae9b381e480b85d2efd8c58d453b P a6e8360424fb444eb7d9a1ee55c824e1: Deleting WAL directory at /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/minicluster-data/ts-2/wal/wals/1af9ae9b381e480b85d2efd8c58d453b
I20260810 15:25:30.139762 22881 ts_tablet_manager.cc:1939] T 1af9ae9b381e480b85d2efd8c58d453b P a6e8360424fb444eb7d9a1ee55c824e1: Deleting consensus metadata
I20260810 15:25:30.140126 21844 catalog_manager.cc:4841] TS a6e8360424fb444eb7d9a1ee55c824e1 (127.18.68.131:37443): tablet 1af9ae9b381e480b85d2efd8c58d453b (table test-table [id=2171c311dcc34bc6a9aca8d2a5218919]) successfully deleted
I20260810 15:25:30.142483 22796 tablet_bootstrap.cc:492] T c2aa5ac381824c78bfffd0340a2eaa28 P a6e8360424fb444eb7d9a1ee55c824e1: No bootstrap required, opened a new log
I20260810 15:25:30.142544 22796 ts_tablet_manager.cc:1397] T c2aa5ac381824c78bfffd0340a2eaa28 P a6e8360424fb444eb7d9a1ee55c824e1: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.000s
I20260810 15:25:30.142652 22796 raft_consensus.cc:348] T c2aa5ac381824c78bfffd0340a2eaa28 P a6e8360424fb444eb7d9a1ee55c824e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e934fc72e9bf430895b18ddfddac2c7d" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35749 } } peers { permanent_uuid: "0be5c2fe77b24afb982c3c286718a28a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 43129 } } peers { permanent_uuid: "a6e8360424fb444eb7d9a1ee55c824e1" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37443 } }
I20260810 15:25:30.142724 22796 raft_consensus.cc:374] T c2aa5ac381824c78bfffd0340a2eaa28 P a6e8360424fb444eb7d9a1ee55c824e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:25:30.142745 22796 raft_consensus.cc:729] T c2aa5ac381824c78bfffd0340a2eaa28 P a6e8360424fb444eb7d9a1ee55c824e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6e8360424fb444eb7d9a1ee55c824e1, State: Initialized, Role: FOLLOWER
I20260810 15:25:30.142786 22796 consensus_queue.cc:260] T c2aa5ac381824c78bfffd0340a2eaa28 P a6e8360424fb444eb7d9a1ee55c824e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e934fc72e9bf430895b18ddfddac2c7d" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35749 } } peers { permanent_uuid: "0be5c2fe77b24afb982c3c286718a28a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 43129 } } peers { permanent_uuid: "a6e8360424fb444eb7d9a1ee55c824e1" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37443 } }
I20260810 15:25:30.142877 22796 ts_tablet_manager.cc:1428] T c2aa5ac381824c78bfffd0340a2eaa28 P a6e8360424fb444eb7d9a1ee55c824e1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:30.289798 22811 raft_consensus.cc:482] T c2aa5ac381824c78bfffd0340a2eaa28 P 0be5c2fe77b24afb982c3c286718a28a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 15:25:30.289932 22811 raft_consensus.cc:504] T c2aa5ac381824c78bfffd0340a2eaa28 P 0be5c2fe77b24afb982c3c286718a28a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e934fc72e9bf430895b18ddfddac2c7d" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35749 } } peers { permanent_uuid: "0be5c2fe77b24afb982c3c286718a28a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 43129 } } peers { permanent_uuid: "a6e8360424fb444eb7d9a1ee55c824e1" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37443 } }
I20260810 15:25:30.290354 22811 leader_election.cc:288] T c2aa5ac381824c78bfffd0340a2eaa28 P 0be5c2fe77b24afb982c3c286718a28a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e934fc72e9bf430895b18ddfddac2c7d (127.18.68.129:35749), a6e8360424fb444eb7d9a1ee55c824e1 (127.18.68.131:37443)
I20260810 15:25:30.293753 22889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:30.290550 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.129:35749 (local address 127.18.68.130:53075)
0810 15:25:30.290765 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:30.290773 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:30.290849 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:30.291051 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:30.291053 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:30.291056 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:25:30.291126 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:30.291127 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:30.292028 (+ 901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:30.292029 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:30.292883 (+ 854us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:30.292885 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:30.293484 (+ 599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:30.293485 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:30.293557 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:30.293561 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 15:25:30.293617 (+ 56us) client_negotiation.cc:240] Negotiation successful
0810 15:25:30.293654 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":204,"mutex_wait_us":41,"thread_start_us":81,"threads_started":1}
I20260810 15:25:30.293766 22788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:30.290701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.130:53075 (local address 127.18.68.129:35749)
0810 15:25:30.290750 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:30.290752 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:30.290824 (+ 72us) server_negotiation.cc:407] Connection header received
0810 15:25:30.290926 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:30.290927 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:30.290940 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:30.291011 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:25:30.291249 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:30.291937 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:30.292978 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:30.293393 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:30.293469 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:30.293478 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:30.293649 (+ 171us) server_negotiation.cc:299] Negotiation successful
0810 15:25:30.293693 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260810 15:25:30.294129 22146 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2aa5ac381824c78bfffd0340a2eaa28" candidate_uuid: "0be5c2fe77b24afb982c3c286718a28a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e934fc72e9bf430895b18ddfddac2c7d" is_pre_election: true
I20260810 15:25:30.294231 22146 raft_consensus.cc:2454] T c2aa5ac381824c78bfffd0340a2eaa28 P e934fc72e9bf430895b18ddfddac2c7d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0be5c2fe77b24afb982c3c286718a28a in term 0.
I20260810 15:25:30.294299 22795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:30.290798 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.130:50709 (local address 127.18.68.131:37443)
0810 15:25:30.290840 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:30.290841 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:30.290851 (+ 10us) server_negotiation.cc:407] Connection header received
0810 15:25:30.290882 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:30.290883 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:30.290891 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:30.290976 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:25:30.291164 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:30.291921 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:30.293340 (+ 1419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:30.293841 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:30.293912 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:30.293921 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:30.294163 (+ 242us) server_negotiation.cc:299] Negotiation successful
0810 15:25:30.294208 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260810 15:25:30.294404 22288 leader_election.cc:302] T c2aa5ac381824c78bfffd0340a2eaa28 P 0be5c2fe77b24afb982c3c286718a28a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0be5c2fe77b24afb982c3c286718a28a, e934fc72e9bf430895b18ddfddac2c7d; no voters:
I20260810 15:25:30.294528 22890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:30.290549 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.131:37443 (local address 127.18.68.130:50709)
0810 15:25:30.290722 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:30.290735 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:30.290802 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:30.290992 (+ 190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:30.290993 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:30.290995 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:25:30.291082 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:30.291084 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:30.292060 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:30.292061 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:30.293235 (+ 1174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:30.293238 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:30.293986 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:30.293987 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:30.294075 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:30.294080 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 15:25:30.294385 (+ 305us) client_negotiation.cc:240] Negotiation successful
0810 15:25:30.294439 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":68,"threads_started":1}
I20260810 15:25:30.294562 22811 raft_consensus.cc:2781] T c2aa5ac381824c78bfffd0340a2eaa28 P 0be5c2fe77b24afb982c3c286718a28a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 15:25:30.294590 22811 raft_consensus.cc:482] T c2aa5ac381824c78bfffd0340a2eaa28 P 0be5c2fe77b24afb982c3c286718a28a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 15:25:30.294621 22811 raft_consensus.cc:3037] T c2aa5ac381824c78bfffd0340a2eaa28 P 0be5c2fe77b24afb982c3c286718a28a [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:25:30.295738 22811 raft_consensus.cc:504] T c2aa5ac381824c78bfffd0340a2eaa28 P 0be5c2fe77b24afb982c3c286718a28a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e934fc72e9bf430895b18ddfddac2c7d" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35749 } } peers { permanent_uuid: "0be5c2fe77b24afb982c3c286718a28a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 43129 } } peers { permanent_uuid: "a6e8360424fb444eb7d9a1ee55c824e1" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37443 } }
I20260810 15:25:30.295869 22811 leader_election.cc:288] T c2aa5ac381824c78bfffd0340a2eaa28 P 0be5c2fe77b24afb982c3c286718a28a [CANDIDATE]: Term 1 election: Requested vote from peers e934fc72e9bf430895b18ddfddac2c7d (127.18.68.129:35749), a6e8360424fb444eb7d9a1ee55c824e1 (127.18.68.131:37443)
I20260810 15:25:30.296036 22662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2aa5ac381824c78bfffd0340a2eaa28" candidate_uuid: "0be5c2fe77b24afb982c3c286718a28a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6e8360424fb444eb7d9a1ee55c824e1"
I20260810 15:25:30.296020 22663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2aa5ac381824c78bfffd0340a2eaa28" candidate_uuid: "0be5c2fe77b24afb982c3c286718a28a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6e8360424fb444eb7d9a1ee55c824e1" is_pre_election: true
I20260810 15:25:30.296128 22662 raft_consensus.cc:3037] T c2aa5ac381824c78bfffd0340a2eaa28 P a6e8360424fb444eb7d9a1ee55c824e1 [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:25:30.296113 22146 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2aa5ac381824c78bfffd0340a2eaa28" candidate_uuid: "0be5c2fe77b24afb982c3c286718a28a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e934fc72e9bf430895b18ddfddac2c7d"
I20260810 15:25:30.296177 22146 raft_consensus.cc:3037] T c2aa5ac381824c78bfffd0340a2eaa28 P e934fc72e9bf430895b18ddfddac2c7d [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:25:30.296865 22662 raft_consensus.cc:2454] T c2aa5ac381824c78bfffd0340a2eaa28 P a6e8360424fb444eb7d9a1ee55c824e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0be5c2fe77b24afb982c3c286718a28a in term 1.
I20260810 15:25:30.296922 22146 raft_consensus.cc:2454] T c2aa5ac381824c78bfffd0340a2eaa28 P e934fc72e9bf430895b18ddfddac2c7d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0be5c2fe77b24afb982c3c286718a28a in term 1.
I20260810 15:25:30.297066 22287 leader_election.cc:302] T c2aa5ac381824c78bfffd0340a2eaa28 P 0be5c2fe77b24afb982c3c286718a28a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0be5c2fe77b24afb982c3c286718a28a, a6e8360424fb444eb7d9a1ee55c824e1; no voters:
I20260810 15:25:30.297197 22811 raft_consensus.cc:2781] T c2aa5ac381824c78bfffd0340a2eaa28 P 0be5c2fe77b24afb982c3c286718a28a [term 1 FOLLOWER]: Leader election won for term 1
I20260810 15:25:30.297343 22811 raft_consensus.cc:686] T c2aa5ac381824c78bfffd0340a2eaa28 P 0be5c2fe77b24afb982c3c286718a28a [term 1 LEADER]: Becoming Leader. State: Replica: 0be5c2fe77b24afb982c3c286718a28a, State: Running, Role: LEADER
I20260810 15:25:30.297416 22811 consensus_queue.cc:237] T c2aa5ac381824c78bfffd0340a2eaa28 P 0be5c2fe77b24afb982c3c286718a28a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e934fc72e9bf430895b18ddfddac2c7d" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35749 } } peers { permanent_uuid: "0be5c2fe77b24afb982c3c286718a28a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 43129 } } peers { permanent_uuid: "a6e8360424fb444eb7d9a1ee55c824e1" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37443 } }
I20260810 15:25:30.298207 21867 catalog_manager.cc:5495] T c2aa5ac381824c78bfffd0340a2eaa28 P 0be5c2fe77b24afb982c3c286718a28a reported cstate change: term changed from 0 to 1, leader changed from <none> to 0be5c2fe77b24afb982c3c286718a28a (127.18.68.130). New cstate: current_term: 1 leader_uuid: "0be5c2fe77b24afb982c3c286718a28a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e934fc72e9bf430895b18ddfddac2c7d" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0be5c2fe77b24afb982c3c286718a28a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 43129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a6e8360424fb444eb7d9a1ee55c824e1" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37443 } health_report { overall_health: UNKNOWN } } }
I20260810 15:25:30.323407 22818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:30.320646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46568 (local address 127.18.68.130:43129)
0810 15:25:30.320693 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:30.320695 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:30.320705 (+ 10us) server_negotiation.cc:407] Connection header received
0810 15:25:30.320780 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:30.320781 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:30.320801 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:30.320887 (+ 86us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 15:25:30.320992 (+ 105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:30.321473 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:30.322326 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:30.322674 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:30.322741 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:30.323002 (+ 261us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 15:25:30.323171 (+ 169us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 15:25:30.323244 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:30.323302 (+ 58us) server_negotiation.cc:299] Negotiation successful
0810 15:25:30.323322 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260810 15:25:30.328392 22795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:30.325889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.130:58777 (local address 127.18.68.131:37443)
0810 15:25:30.325966 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:30.325968 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:30.326076 (+ 108us) server_negotiation.cc:407] Connection header received
0810 15:25:30.326197 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:30.326198 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:30.326208 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:30.326265 (+ 57us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 15:25:30.326417 (+ 152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:30.326874 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:30.327645 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:30.327839 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:30.327924 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:30.328150 (+ 226us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 15:25:30.328182 (+ 32us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 15:25:30.328236 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:30.328298 (+ 62us) server_negotiation.cc:299] Negotiation successful
0810 15:25:30.328320 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260810 15:25:30.328430 22904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:30.325792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.131:37443 (local address 127.18.68.130:58777)
0810 15:25:30.325996 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:30.326009 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:30.326124 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:30.326268 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:30.326269 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:30.326270 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 15:25:30.326341 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:30.326342 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:30.326979 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:30.326980 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:30.327535 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:30.327537 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:30.327949 (+ 412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:30.327950 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:30.328016 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:30.328047 (+ 31us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 15:25:30.328249 (+ 202us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 15:25:30.328251 (+ 2us) client_negotiation.cc:769] Sending connection context
0810 15:25:30.328295 (+ 44us) client_negotiation.cc:240] Negotiation successful
0810 15:25:30.328342 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":103,"threads_started":1}
I20260810 15:25:30.330583 22146 raft_consensus.cc:1261] T c2aa5ac381824c78bfffd0340a2eaa28 P e934fc72e9bf430895b18ddfddac2c7d [term 1 FOLLOWER]: Refusing update from remote peer 0be5c2fe77b24afb982c3c286718a28a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 15:25:30.330600 22662 raft_consensus.cc:1261] T c2aa5ac381824c78bfffd0340a2eaa28 P a6e8360424fb444eb7d9a1ee55c824e1 [term 1 FOLLOWER]: Refusing update from remote peer 0be5c2fe77b24afb982c3c286718a28a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 15:25:30.330840 22891 consensus_queue.cc:1035] T c2aa5ac381824c78bfffd0340a2eaa28 P 0be5c2fe77b24afb982c3c286718a28a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6e8360424fb444eb7d9a1ee55c824e1" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 15:25:30.330987 22811 consensus_queue.cc:1035] T c2aa5ac381824c78bfffd0340a2eaa28 P 0be5c2fe77b24afb982c3c286718a28a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e934fc72e9bf430895b18ddfddac2c7d" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 15:25:30.337936 22754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:30.335699 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.130:43129 (local address 127.18.68.131:53261)
0810 15:25:30.335758 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:30.335768 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:30.335807 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:30.335927 (+ 120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:30.335928 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:30.335929 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 15:25:30.335967 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:30.335968 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:30.336622 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:30.336623 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:30.337131 (+ 508us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:30.337133 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:30.337534 (+ 401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:30.337535 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:30.337594 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:30.337598 (+ 4us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 15:25:30.337797 (+ 199us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 15:25:30.337799 (+ 2us) client_negotiation.cc:769] Sending connection context
0810 15:25:30.337842 (+ 43us) client_negotiation.cc:240] Negotiation successful
0810 15:25:30.337884 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37}
I20260810 15:25:30.337940 22818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:30.335767 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.131:53261 (local address 127.18.68.130:43129)
0810 15:25:30.335807 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:30.335809 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:30.335817 (+ 8us) server_negotiation.cc:407] Connection header received
0810 15:25:30.335860 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:30.335861 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:30.335871 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:30.335924 (+ 53us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 15:25:30.336022 (+ 98us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:30.336552 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:30.337207 (+ 655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:30.337438 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:30.337522 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:30.337696 (+ 174us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 15:25:30.337728 (+ 32us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 15:25:30.337779 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:30.337844 (+ 65us) server_negotiation.cc:299] Negotiation successful
0810 15:25:30.337867 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
W20260810 15:25:30.338240 22845 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260810 15:25:31.858772 21867 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58312:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 15:25:31.858875 21867 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58312:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 15:25:31.859920 21867 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 511c7f22094c4364b143e11cf834e945: Sending DeleteTablet for 3 replicas of tablet c2aa5ac381824c78bfffd0340a2eaa28
I20260810 15:25:31.860234 22107 tablet_service.cc:1514] Processing DeleteTablet for tablet c2aa5ac381824c78bfffd0340a2eaa28 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 15:25:31 UTC) from {username='kudu', principal='kudu/127.18.68.190@KRBTEST.COM'} at 127.0.0.1:44844
I20260810 15:25:31.860322 22622 tablet_service.cc:1514] Processing DeleteTablet for tablet c2aa5ac381824c78bfffd0340a2eaa28 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 15:25:31 UTC) from {username='kudu', principal='kudu/127.18.68.190@KRBTEST.COM'} at 127.0.0.1:46374
I20260810 15:25:31.860380 22361 tablet_service.cc:1514] Processing DeleteTablet for tablet c2aa5ac381824c78bfffd0340a2eaa28 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 15:25:31 UTC) from {username='kudu', principal='kudu/127.18.68.190@KRBTEST.COM'} at 127.0.0.1:46564
I20260810 15:25:31.860872 22960 tablet_replica.cc:330] T c2aa5ac381824c78bfffd0340a2eaa28 P 0be5c2fe77b24afb982c3c286718a28a: stopping tablet replica
I20260810 15:25:31.860944 22960 raft_consensus.cc:2229] T c2aa5ac381824c78bfffd0340a2eaa28 P 0be5c2fe77b24afb982c3c286718a28a [term 1 LEADER]: Raft consensus shutting down.
I20260810 15:25:31.861035 22960 raft_consensus.cc:2258] T c2aa5ac381824c78bfffd0340a2eaa28 P 0be5c2fe77b24afb982c3c286718a28a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 15:25:31.861286 22960 ts_tablet_manager.cc:1905] T c2aa5ac381824c78bfffd0340a2eaa28 P 0be5c2fe77b24afb982c3c286718a28a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 15:25:31.863283 22960 ts_tablet_manager.cc:1918] T c2aa5ac381824c78bfffd0340a2eaa28 P 0be5c2fe77b24afb982c3c286718a28a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260810 15:25:31.863372 22960 log.cc:1196] T c2aa5ac381824c78bfffd0340a2eaa28 P 0be5c2fe77b24afb982c3c286718a28a: Deleting WAL directory at /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/minicluster-data/ts-1/wal/wals/c2aa5ac381824c78bfffd0340a2eaa28
I20260810 15:25:31.863644 22960 ts_tablet_manager.cc:1939] T c2aa5ac381824c78bfffd0340a2eaa28 P 0be5c2fe77b24afb982c3c286718a28a: Deleting consensus metadata
I20260810 15:25:31.863941 22959 tablet_replica.cc:330] T c2aa5ac381824c78bfffd0340a2eaa28 P a6e8360424fb444eb7d9a1ee55c824e1: stopping tablet replica
I20260810 15:25:31.863986 21844 catalog_manager.cc:4841] TS 0be5c2fe77b24afb982c3c286718a28a (127.18.68.130:43129): tablet c2aa5ac381824c78bfffd0340a2eaa28 (table test-table [id=9ff9732e50fc4d1699ed425f217d675c]) successfully deleted
I20260810 15:25:31.864025 22959 raft_consensus.cc:2229] T c2aa5ac381824c78bfffd0340a2eaa28 P a6e8360424fb444eb7d9a1ee55c824e1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 15:25:31.864081 22959 raft_consensus.cc:2258] T c2aa5ac381824c78bfffd0340a2eaa28 P a6e8360424fb444eb7d9a1ee55c824e1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 15:25:31.864205 22957 tablet_replica.cc:330] T c2aa5ac381824c78bfffd0340a2eaa28 P e934fc72e9bf430895b18ddfddac2c7d: stopping tablet replica
I20260810 15:25:31.864279 22957 raft_consensus.cc:2229] T c2aa5ac381824c78bfffd0340a2eaa28 P e934fc72e9bf430895b18ddfddac2c7d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 15:25:31.864328 22957 raft_consensus.cc:2258] T c2aa5ac381824c78bfffd0340a2eaa28 P e934fc72e9bf430895b18ddfddac2c7d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 15:25:31.864378 22959 ts_tablet_manager.cc:1905] T c2aa5ac381824c78bfffd0340a2eaa28 P a6e8360424fb444eb7d9a1ee55c824e1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 15:25:31.864573 22957 ts_tablet_manager.cc:1905] T c2aa5ac381824c78bfffd0340a2eaa28 P e934fc72e9bf430895b18ddfddac2c7d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 15:25:31.865801 22959 ts_tablet_manager.cc:1918] T c2aa5ac381824c78bfffd0340a2eaa28 P a6e8360424fb444eb7d9a1ee55c824e1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260810 15:25:31.865805 22957 ts_tablet_manager.cc:1918] T c2aa5ac381824c78bfffd0340a2eaa28 P e934fc72e9bf430895b18ddfddac2c7d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260810 15:25:31.865870 22959 log.cc:1196] T c2aa5ac381824c78bfffd0340a2eaa28 P a6e8360424fb444eb7d9a1ee55c824e1: Deleting WAL directory at /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/minicluster-data/ts-2/wal/wals/c2aa5ac381824c78bfffd0340a2eaa28
I20260810 15:25:31.865928 22957 log.cc:1196] T c2aa5ac381824c78bfffd0340a2eaa28 P e934fc72e9bf430895b18ddfddac2c7d: Deleting WAL directory at /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/minicluster-data/ts-0/wal/wals/c2aa5ac381824c78bfffd0340a2eaa28
I20260810 15:25:31.866151 22959 ts_tablet_manager.cc:1939] T c2aa5ac381824c78bfffd0340a2eaa28 P a6e8360424fb444eb7d9a1ee55c824e1: Deleting consensus metadata
I20260810 15:25:31.866209 22957 ts_tablet_manager.cc:1939] T c2aa5ac381824c78bfffd0340a2eaa28 P e934fc72e9bf430895b18ddfddac2c7d: Deleting consensus metadata
I20260810 15:25:31.866544 21844 catalog_manager.cc:4841] TS a6e8360424fb444eb7d9a1ee55c824e1 (127.18.68.131:37443): tablet c2aa5ac381824c78bfffd0340a2eaa28 (table test-table [id=9ff9732e50fc4d1699ed425f217d675c]) successfully deleted
I20260810 15:25:31.866562 21845 catalog_manager.cc:4841] TS e934fc72e9bf430895b18ddfddac2c7d (127.18.68.129:35749): tablet c2aa5ac381824c78bfffd0340a2eaa28 (table test-table [id=9ff9732e50fc4d1699ed425f217d675c]) successfully deleted
Aug 10 15:25:31 dist-test-slave-2p8l krb5kdc[21793](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375531, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 10 15:25:31 dist-test-slave-2p8l krb5kdc[21793](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375531, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
I20260810 15:25:31.889531 22979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:31.881804 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58324 (local address 127.18.68.190:41667)
0810 15:25:31.881953 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:31.881955 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:31.882110 (+ 155us) server_negotiation.cc:407] Connection header received
0810 15:25:31.882148 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:31.882149 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:31.882170 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:31.882239 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:31.882835 (+ 596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:31.883355 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:31.884138 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:31.884348 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:31.884413 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:31.886961 (+ 2548us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:31.886963 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:31.886963 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:31.886969 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:31.888429 (+ 1460us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:31.888797 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:31.888799 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:31.888799 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:31.888866 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:31.889074 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:31.889075 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:31.889076 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:31.889193 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:31.889281 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:31.889389 (+ 108us) server_negotiation.cc:299] Negotiation successful
0810 15:25:31.889458 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":116,"thread_start_us":92,"threads_started":1}
I20260810 15:25:31.891228 21867 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58324:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 15:25:31.891388 21867 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 15:25:31.892985 22107 tablet_service.cc:1467] Processing CreateTablet for tablet 6860556303eb41dcaa369dee813a49f6 (DEFAULT_TABLE table=test-table [id=953cf9b1d6e248d7856cd9c03a6affd9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 15:25:31.892987 22361 tablet_service.cc:1467] Processing CreateTablet for tablet 6860556303eb41dcaa369dee813a49f6 (DEFAULT_TABLE table=test-table [id=953cf9b1d6e248d7856cd9c03a6affd9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 15:25:31.892994 22622 tablet_service.cc:1467] Processing CreateTablet for tablet 6860556303eb41dcaa369dee813a49f6 (DEFAULT_TABLE table=test-table [id=953cf9b1d6e248d7856cd9c03a6affd9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 15:25:31.893148 22622 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6860556303eb41dcaa369dee813a49f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:25:31.893146 22361 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6860556303eb41dcaa369dee813a49f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:25:31.893160 22107 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6860556303eb41dcaa369dee813a49f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:25:31.894691 22985 tablet_bootstrap.cc:492] T 6860556303eb41dcaa369dee813a49f6 P a6e8360424fb444eb7d9a1ee55c824e1: Bootstrap starting.
I20260810 15:25:31.894706 22983 tablet_bootstrap.cc:492] T 6860556303eb41dcaa369dee813a49f6 P 0be5c2fe77b24afb982c3c286718a28a: Bootstrap starting.
I20260810 15:25:31.894822 22982 tablet_bootstrap.cc:492] T 6860556303eb41dcaa369dee813a49f6 P e934fc72e9bf430895b18ddfddac2c7d: Bootstrap starting.
I20260810 15:25:31.895112 22985 tablet_bootstrap.cc:654] T 6860556303eb41dcaa369dee813a49f6 P a6e8360424fb444eb7d9a1ee55c824e1: Neither blocks nor log segments found. Creating new log.
I20260810 15:25:31.895195 22982 tablet_bootstrap.cc:654] T 6860556303eb41dcaa369dee813a49f6 P e934fc72e9bf430895b18ddfddac2c7d: Neither blocks nor log segments found. Creating new log.
I20260810 15:25:31.895239 22983 tablet_bootstrap.cc:654] T 6860556303eb41dcaa369dee813a49f6 P 0be5c2fe77b24afb982c3c286718a28a: Neither blocks nor log segments found. Creating new log.
I20260810 15:25:31.895897 22985 tablet_bootstrap.cc:492] T 6860556303eb41dcaa369dee813a49f6 P a6e8360424fb444eb7d9a1ee55c824e1: No bootstrap required, opened a new log
I20260810 15:25:31.895943 22985 ts_tablet_manager.cc:1397] T 6860556303eb41dcaa369dee813a49f6 P a6e8360424fb444eb7d9a1ee55c824e1: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260810 15:25:31.895990 22982 tablet_bootstrap.cc:492] T 6860556303eb41dcaa369dee813a49f6 P e934fc72e9bf430895b18ddfddac2c7d: No bootstrap required, opened a new log
I20260810 15:25:31.896046 22982 ts_tablet_manager.cc:1397] T 6860556303eb41dcaa369dee813a49f6 P e934fc72e9bf430895b18ddfddac2c7d: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260810 15:25:31.896068 22985 raft_consensus.cc:348] T 6860556303eb41dcaa369dee813a49f6 P a6e8360424fb444eb7d9a1ee55c824e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e934fc72e9bf430895b18ddfddac2c7d" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35749 } } peers { permanent_uuid: "0be5c2fe77b24afb982c3c286718a28a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 43129 } } peers { permanent_uuid: "a6e8360424fb444eb7d9a1ee55c824e1" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37443 } }
I20260810 15:25:31.896188 22985 raft_consensus.cc:374] T 6860556303eb41dcaa369dee813a49f6 P a6e8360424fb444eb7d9a1ee55c824e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:25:31.896160 22982 raft_consensus.cc:348] T 6860556303eb41dcaa369dee813a49f6 P e934fc72e9bf430895b18ddfddac2c7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e934fc72e9bf430895b18ddfddac2c7d" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35749 } } peers { permanent_uuid: "0be5c2fe77b24afb982c3c286718a28a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 43129 } } peers { permanent_uuid: "a6e8360424fb444eb7d9a1ee55c824e1" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37443 } }
I20260810 15:25:31.896225 22985 raft_consensus.cc:729] T 6860556303eb41dcaa369dee813a49f6 P a6e8360424fb444eb7d9a1ee55c824e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6e8360424fb444eb7d9a1ee55c824e1, State: Initialized, Role: FOLLOWER
I20260810 15:25:31.896229 22982 raft_consensus.cc:374] T 6860556303eb41dcaa369dee813a49f6 P e934fc72e9bf430895b18ddfddac2c7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:25:31.896255 22982 raft_consensus.cc:729] T 6860556303eb41dcaa369dee813a49f6 P e934fc72e9bf430895b18ddfddac2c7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e934fc72e9bf430895b18ddfddac2c7d, State: Initialized, Role: FOLLOWER
I20260810 15:25:31.896278 22985 consensus_queue.cc:260] T 6860556303eb41dcaa369dee813a49f6 P a6e8360424fb444eb7d9a1ee55c824e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e934fc72e9bf430895b18ddfddac2c7d" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35749 } } peers { permanent_uuid: "0be5c2fe77b24afb982c3c286718a28a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 43129 } } peers { permanent_uuid: "a6e8360424fb444eb7d9a1ee55c824e1" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37443 } }
I20260810 15:25:31.896301 22982 consensus_queue.cc:260] T 6860556303eb41dcaa369dee813a49f6 P e934fc72e9bf430895b18ddfddac2c7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e934fc72e9bf430895b18ddfddac2c7d" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35749 } } peers { permanent_uuid: "0be5c2fe77b24afb982c3c286718a28a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 43129 } } peers { permanent_uuid: "a6e8360424fb444eb7d9a1ee55c824e1" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37443 } }
I20260810 15:25:31.896401 22985 ts_tablet_manager.cc:1428] T 6860556303eb41dcaa369dee813a49f6 P a6e8360424fb444eb7d9a1ee55c824e1: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260810 15:25:31.896479 22982 ts_tablet_manager.cc:1428] T 6860556303eb41dcaa369dee813a49f6 P e934fc72e9bf430895b18ddfddac2c7d: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260810 15:25:31.896720 22983 tablet_bootstrap.cc:492] T 6860556303eb41dcaa369dee813a49f6 P 0be5c2fe77b24afb982c3c286718a28a: No bootstrap required, opened a new log
I20260810 15:25:31.896777 22983 ts_tablet_manager.cc:1397] T 6860556303eb41dcaa369dee813a49f6 P 0be5c2fe77b24afb982c3c286718a28a: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 15:25:31.896889 22983 raft_consensus.cc:348] T 6860556303eb41dcaa369dee813a49f6 P 0be5c2fe77b24afb982c3c286718a28a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e934fc72e9bf430895b18ddfddac2c7d" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35749 } } peers { permanent_uuid: "0be5c2fe77b24afb982c3c286718a28a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 43129 } } peers { permanent_uuid: "a6e8360424fb444eb7d9a1ee55c824e1" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37443 } }
I20260810 15:25:31.896958 22983 raft_consensus.cc:374] T 6860556303eb41dcaa369dee813a49f6 P 0be5c2fe77b24afb982c3c286718a28a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:25:31.896979 22983 raft_consensus.cc:729] T 6860556303eb41dcaa369dee813a49f6 P 0be5c2fe77b24afb982c3c286718a28a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0be5c2fe77b24afb982c3c286718a28a, State: Initialized, Role: FOLLOWER
I20260810 15:25:31.897048 22983 consensus_queue.cc:260] T 6860556303eb41dcaa369dee813a49f6 P 0be5c2fe77b24afb982c3c286718a28a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e934fc72e9bf430895b18ddfddac2c7d" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35749 } } peers { permanent_uuid: "0be5c2fe77b24afb982c3c286718a28a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 43129 } } peers { permanent_uuid: "a6e8360424fb444eb7d9a1ee55c824e1" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37443 } }
I20260810 15:25:31.897151 22983 ts_tablet_manager.cc:1428] T 6860556303eb41dcaa369dee813a49f6 P 0be5c2fe77b24afb982c3c286718a28a: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:32.140535 22916 raft_consensus.cc:482] T 6860556303eb41dcaa369dee813a49f6 P a6e8360424fb444eb7d9a1ee55c824e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 15:25:32.140652 22916 raft_consensus.cc:504] T 6860556303eb41dcaa369dee813a49f6 P a6e8360424fb444eb7d9a1ee55c824e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e934fc72e9bf430895b18ddfddac2c7d" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35749 } } peers { permanent_uuid: "0be5c2fe77b24afb982c3c286718a28a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 43129 } } peers { permanent_uuid: "a6e8360424fb444eb7d9a1ee55c824e1" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37443 } }
I20260810 15:25:32.140847 22916 leader_election.cc:288] T 6860556303eb41dcaa369dee813a49f6 P a6e8360424fb444eb7d9a1ee55c824e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e934fc72e9bf430895b18ddfddac2c7d (127.18.68.129:35749), 0be5c2fe77b24afb982c3c286718a28a (127.18.68.130:43129)
I20260810 15:25:32.141145 22146 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6860556303eb41dcaa369dee813a49f6" candidate_uuid: "a6e8360424fb444eb7d9a1ee55c824e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e934fc72e9bf430895b18ddfddac2c7d" is_pre_election: true
I20260810 15:25:32.141140 22402 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6860556303eb41dcaa369dee813a49f6" candidate_uuid: "a6e8360424fb444eb7d9a1ee55c824e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0be5c2fe77b24afb982c3c286718a28a" is_pre_election: true
I20260810 15:25:32.141273 22402 raft_consensus.cc:2454] T 6860556303eb41dcaa369dee813a49f6 P 0be5c2fe77b24afb982c3c286718a28a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6e8360424fb444eb7d9a1ee55c824e1 in term 0.
I20260810 15:25:32.141273 22146 raft_consensus.cc:2454] T 6860556303eb41dcaa369dee813a49f6 P e934fc72e9bf430895b18ddfddac2c7d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6e8360424fb444eb7d9a1ee55c824e1 in term 0.
I20260810 15:25:32.141462 22538 leader_election.cc:302] T 6860556303eb41dcaa369dee813a49f6 P a6e8360424fb444eb7d9a1ee55c824e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0be5c2fe77b24afb982c3c286718a28a, a6e8360424fb444eb7d9a1ee55c824e1; no voters:
I20260810 15:25:32.141683 22916 raft_consensus.cc:2781] T 6860556303eb41dcaa369dee813a49f6 P a6e8360424fb444eb7d9a1ee55c824e1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 15:25:32.141744 22916 raft_consensus.cc:482] T 6860556303eb41dcaa369dee813a49f6 P a6e8360424fb444eb7d9a1ee55c824e1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 15:25:32.141762 22916 raft_consensus.cc:3037] T 6860556303eb41dcaa369dee813a49f6 P a6e8360424fb444eb7d9a1ee55c824e1 [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:25:32.142611 22916 raft_consensus.cc:504] T 6860556303eb41dcaa369dee813a49f6 P a6e8360424fb444eb7d9a1ee55c824e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e934fc72e9bf430895b18ddfddac2c7d" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35749 } } peers { permanent_uuid: "0be5c2fe77b24afb982c3c286718a28a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 43129 } } peers { permanent_uuid: "a6e8360424fb444eb7d9a1ee55c824e1" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37443 } }
I20260810 15:25:32.142779 22916 leader_election.cc:288] T 6860556303eb41dcaa369dee813a49f6 P a6e8360424fb444eb7d9a1ee55c824e1 [CANDIDATE]: Term 1 election: Requested vote from peers e934fc72e9bf430895b18ddfddac2c7d (127.18.68.129:35749), 0be5c2fe77b24afb982c3c286718a28a (127.18.68.130:43129)
I20260810 15:25:32.142935 22146 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6860556303eb41dcaa369dee813a49f6" candidate_uuid: "a6e8360424fb444eb7d9a1ee55c824e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e934fc72e9bf430895b18ddfddac2c7d"
I20260810 15:25:32.142973 22402 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6860556303eb41dcaa369dee813a49f6" candidate_uuid: "a6e8360424fb444eb7d9a1ee55c824e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0be5c2fe77b24afb982c3c286718a28a"
I20260810 15:25:32.143034 22146 raft_consensus.cc:3037] T 6860556303eb41dcaa369dee813a49f6 P e934fc72e9bf430895b18ddfddac2c7d [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:25:32.143045 22402 raft_consensus.cc:3037] T 6860556303eb41dcaa369dee813a49f6 P 0be5c2fe77b24afb982c3c286718a28a [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:25:32.143860 22402 raft_consensus.cc:2454] T 6860556303eb41dcaa369dee813a49f6 P 0be5c2fe77b24afb982c3c286718a28a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6e8360424fb444eb7d9a1ee55c824e1 in term 1.
I20260810 15:25:32.143860 22146 raft_consensus.cc:2454] T 6860556303eb41dcaa369dee813a49f6 P e934fc72e9bf430895b18ddfddac2c7d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6e8360424fb444eb7d9a1ee55c824e1 in term 1.
I20260810 15:25:32.144081 22538 leader_election.cc:302] T 6860556303eb41dcaa369dee813a49f6 P a6e8360424fb444eb7d9a1ee55c824e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0be5c2fe77b24afb982c3c286718a28a, a6e8360424fb444eb7d9a1ee55c824e1; no voters:
I20260810 15:25:32.144232 22916 raft_consensus.cc:2781] T 6860556303eb41dcaa369dee813a49f6 P a6e8360424fb444eb7d9a1ee55c824e1 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 15:25:32.144312 22916 raft_consensus.cc:686] T 6860556303eb41dcaa369dee813a49f6 P a6e8360424fb444eb7d9a1ee55c824e1 [term 1 LEADER]: Becoming Leader. State: Replica: a6e8360424fb444eb7d9a1ee55c824e1, State: Running, Role: LEADER
I20260810 15:25:32.144369 22916 consensus_queue.cc:237] T 6860556303eb41dcaa369dee813a49f6 P a6e8360424fb444eb7d9a1ee55c824e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e934fc72e9bf430895b18ddfddac2c7d" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35749 } } peers { permanent_uuid: "0be5c2fe77b24afb982c3c286718a28a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 43129 } } peers { permanent_uuid: "a6e8360424fb444eb7d9a1ee55c824e1" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37443 } }
I20260810 15:25:32.145138 21867 catalog_manager.cc:5495] T 6860556303eb41dcaa369dee813a49f6 P a6e8360424fb444eb7d9a1ee55c824e1 reported cstate change: term changed from 0 to 1, leader changed from <none> to a6e8360424fb444eb7d9a1ee55c824e1 (127.18.68.131). New cstate: current_term: 1 leader_uuid: "a6e8360424fb444eb7d9a1ee55c824e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e934fc72e9bf430895b18ddfddac2c7d" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0be5c2fe77b24afb982c3c286718a28a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 43129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6e8360424fb444eb7d9a1ee55c824e1" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37443 } health_report { overall_health: HEALTHY } } }
I20260810 15:25:32.183861 22994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:32.181253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46396 (local address 127.18.68.131:37443)
0810 15:25:32.181439 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:32.181440 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:32.181447 (+ 7us) server_negotiation.cc:407] Connection header received
0810 15:25:32.181465 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:32.181465 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:32.181475 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:32.181566 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 15:25:32.181710 (+ 144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:32.182296 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:32.183107 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:32.183329 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:32.183407 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:32.183567 (+ 160us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 15:25:32.183604 (+ 37us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 15:25:32.183677 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:32.183738 (+ 61us) server_negotiation.cc:299] Negotiation successful
0810 15:25:32.183764 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157,"thread_start_us":119,"threads_started":1}
I20260810 15:25:32.186923 22146 raft_consensus.cc:1261] T 6860556303eb41dcaa369dee813a49f6 P e934fc72e9bf430895b18ddfddac2c7d [term 1 FOLLOWER]: Refusing update from remote peer a6e8360424fb444eb7d9a1ee55c824e1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 15:25:32.187116 22402 raft_consensus.cc:1261] T 6860556303eb41dcaa369dee813a49f6 P 0be5c2fe77b24afb982c3c286718a28a [term 1 FOLLOWER]: Refusing update from remote peer a6e8360424fb444eb7d9a1ee55c824e1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 15:25:32.187281 22819 consensus_queue.cc:1035] T 6860556303eb41dcaa369dee813a49f6 P a6e8360424fb444eb7d9a1ee55c824e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e934fc72e9bf430895b18ddfddac2c7d" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 15:25:32.187379 22916 consensus_queue.cc:1035] T 6860556303eb41dcaa369dee813a49f6 P a6e8360424fb444eb7d9a1ee55c824e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0be5c2fe77b24afb982c3c286718a28a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 43129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 15:25:32.198000 21870 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58324:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 15:25:32.198156 21870 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58324:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 15:25:32.198822 21870 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 511c7f22094c4364b143e11cf834e945: Sending DeleteTablet for 3 replicas of tablet 6860556303eb41dcaa369dee813a49f6
I20260810 15:25:32.199110 22107 tablet_service.cc:1514] Processing DeleteTablet for tablet 6860556303eb41dcaa369dee813a49f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 15:25:32 UTC) from {username='kudu', principal='kudu/127.18.68.190@KRBTEST.COM'} at 127.0.0.1:44844
I20260810 15:25:32.199137 22361 tablet_service.cc:1514] Processing DeleteTablet for tablet 6860556303eb41dcaa369dee813a49f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 15:25:32 UTC) from {username='kudu', principal='kudu/127.18.68.190@KRBTEST.COM'} at 127.0.0.1:46564
I20260810 15:25:32.199124 22620 tablet_service.cc:1514] Processing DeleteTablet for tablet 6860556303eb41dcaa369dee813a49f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 15:25:32 UTC) from {username='kudu', principal='kudu/127.18.68.190@KRBTEST.COM'} at 127.0.0.1:46374
I20260810 15:25:32.199229 22960 tablet_replica.cc:330] T 6860556303eb41dcaa369dee813a49f6 P 0be5c2fe77b24afb982c3c286718a28a: stopping tablet replica
I20260810 15:25:32.199249 22959 tablet_replica.cc:330] T 6860556303eb41dcaa369dee813a49f6 P a6e8360424fb444eb7d9a1ee55c824e1: stopping tablet replica
I20260810 15:25:32.199256 22957 tablet_replica.cc:330] T 6860556303eb41dcaa369dee813a49f6 P e934fc72e9bf430895b18ddfddac2c7d: stopping tablet replica
I20260810 15:25:32.199278 22960 raft_consensus.cc:2229] T 6860556303eb41dcaa369dee813a49f6 P 0be5c2fe77b24afb982c3c286718a28a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 15:25:32.199314 22960 raft_consensus.cc:2258] T 6860556303eb41dcaa369dee813a49f6 P 0be5c2fe77b24afb982c3c286718a28a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 15:25:32.199307 22959 raft_consensus.cc:2229] T 6860556303eb41dcaa369dee813a49f6 P a6e8360424fb444eb7d9a1ee55c824e1 [term 1 LEADER]: Raft consensus shutting down.
I20260810 15:25:32.199326 22957 raft_consensus.cc:2229] T 6860556303eb41dcaa369dee813a49f6 P e934fc72e9bf430895b18ddfddac2c7d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 15:25:32.199368 22959 raft_consensus.cc:2258] T 6860556303eb41dcaa369dee813a49f6 P a6e8360424fb444eb7d9a1ee55c824e1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 15:25:32.199373 22957 raft_consensus.cc:2258] T 6860556303eb41dcaa369dee813a49f6 P e934fc72e9bf430895b18ddfddac2c7d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 15:25:32.199381 21870 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58324:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 15:25:32.199536 21870 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 15:25:32.199687 22960 ts_tablet_manager.cc:1905] T 6860556303eb41dcaa369dee813a49f6 P 0be5c2fe77b24afb982c3c286718a28a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 15:25:32.199703 22959 ts_tablet_manager.cc:1905] T 6860556303eb41dcaa369dee813a49f6 P a6e8360424fb444eb7d9a1ee55c824e1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 15:25:32.200845 22107 tablet_service.cc:1467] Processing CreateTablet for tablet ff2910bc827c435a932cafc14878ec29 (DEFAULT_TABLE table=test-table [id=954c1685de3a492fa6ab83d434e8db81]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 15:25:32.200894 22361 tablet_service.cc:1467] Processing CreateTablet for tablet ff2910bc827c435a932cafc14878ec29 (DEFAULT_TABLE table=test-table [id=954c1685de3a492fa6ab83d434e8db81]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 15:25:32.200989 22107 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ff2910bc827c435a932cafc14878ec29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:25:32.200992 22361 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ff2910bc827c435a932cafc14878ec29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:25:32.201404 22960 ts_tablet_manager.cc:1918] T 6860556303eb41dcaa369dee813a49f6 P 0be5c2fe77b24afb982c3c286718a28a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 15:25:32.201431 22959 ts_tablet_manager.cc:1918] T 6860556303eb41dcaa369dee813a49f6 P a6e8360424fb444eb7d9a1ee55c824e1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 15:25:32.201457 22960 log.cc:1196] T 6860556303eb41dcaa369dee813a49f6 P 0be5c2fe77b24afb982c3c286718a28a: Deleting WAL directory at /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/minicluster-data/ts-1/wal/wals/6860556303eb41dcaa369dee813a49f6
I20260810 15:25:32.201478 22959 log.cc:1196] T 6860556303eb41dcaa369dee813a49f6 P a6e8360424fb444eb7d9a1ee55c824e1: Deleting WAL directory at /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/minicluster-data/ts-2/wal/wals/6860556303eb41dcaa369dee813a49f6
I20260810 15:25:32.201692 22960 ts_tablet_manager.cc:1939] T 6860556303eb41dcaa369dee813a49f6 P 0be5c2fe77b24afb982c3c286718a28a: Deleting consensus metadata
I20260810 15:25:32.201697 22959 ts_tablet_manager.cc:1939] T 6860556303eb41dcaa369dee813a49f6 P a6e8360424fb444eb7d9a1ee55c824e1: Deleting consensus metadata
I20260810 15:25:32.202435 22983 tablet_bootstrap.cc:492] T ff2910bc827c435a932cafc14878ec29 P 0be5c2fe77b24afb982c3c286718a28a: Bootstrap starting.
I20260810 15:25:32.202450 22982 tablet_bootstrap.cc:492] T ff2910bc827c435a932cafc14878ec29 P e934fc72e9bf430895b18ddfddac2c7d: Bootstrap starting.
I20260810 15:25:32.202731 21844 catalog_manager.cc:4841] TS 0be5c2fe77b24afb982c3c286718a28a (127.18.68.130:43129): tablet 6860556303eb41dcaa369dee813a49f6 (table test-table [id=953cf9b1d6e248d7856cd9c03a6affd9]) successfully deleted
I20260810 15:25:32.202804 22982 tablet_bootstrap.cc:654] T ff2910bc827c435a932cafc14878ec29 P e934fc72e9bf430895b18ddfddac2c7d: Neither blocks nor log segments found. Creating new log.
I20260810 15:25:32.202797 22983 tablet_bootstrap.cc:654] T ff2910bc827c435a932cafc14878ec29 P 0be5c2fe77b24afb982c3c286718a28a: Neither blocks nor log segments found. Creating new log.
I20260810 15:25:32.202922 21844 catalog_manager.cc:4841] TS a6e8360424fb444eb7d9a1ee55c824e1 (127.18.68.131:37443): tablet 6860556303eb41dcaa369dee813a49f6 (table test-table [id=953cf9b1d6e248d7856cd9c03a6affd9]) successfully deleted
I20260810 15:25:32.203009 22620 tablet_service.cc:1467] Processing CreateTablet for tablet ff2910bc827c435a932cafc14878ec29 (DEFAULT_TABLE table=test-table [id=954c1685de3a492fa6ab83d434e8db81]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 15:25:32.203125 22620 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ff2910bc827c435a932cafc14878ec29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:25:32.203450 22982 tablet_bootstrap.cc:492] T ff2910bc827c435a932cafc14878ec29 P e934fc72e9bf430895b18ddfddac2c7d: No bootstrap required, opened a new log
I20260810 15:25:32.203496 22982 ts_tablet_manager.cc:1397] T ff2910bc827c435a932cafc14878ec29 P e934fc72e9bf430895b18ddfddac2c7d: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260810 15:25:32.203617 22982 raft_consensus.cc:348] T ff2910bc827c435a932cafc14878ec29 P e934fc72e9bf430895b18ddfddac2c7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e934fc72e9bf430895b18ddfddac2c7d" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35749 } } peers { permanent_uuid: "0be5c2fe77b24afb982c3c286718a28a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 43129 } } peers { permanent_uuid: "a6e8360424fb444eb7d9a1ee55c824e1" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37443 } }
I20260810 15:25:32.203670 22982 raft_consensus.cc:374] T ff2910bc827c435a932cafc14878ec29 P e934fc72e9bf430895b18ddfddac2c7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:25:32.203684 22982 raft_consensus.cc:729] T ff2910bc827c435a932cafc14878ec29 P e934fc72e9bf430895b18ddfddac2c7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e934fc72e9bf430895b18ddfddac2c7d, State: Initialized, Role: FOLLOWER
I20260810 15:25:32.203714 22982 consensus_queue.cc:260] T ff2910bc827c435a932cafc14878ec29 P e934fc72e9bf430895b18ddfddac2c7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e934fc72e9bf430895b18ddfddac2c7d" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35749 } } peers { permanent_uuid: "0be5c2fe77b24afb982c3c286718a28a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 43129 } } peers { permanent_uuid: "a6e8360424fb444eb7d9a1ee55c824e1" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37443 } }
I20260810 15:25:32.203815 22982 ts_tablet_manager.cc:1428] T ff2910bc827c435a932cafc14878ec29 P e934fc72e9bf430895b18ddfddac2c7d: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:32.204523 22985 tablet_bootstrap.cc:492] T ff2910bc827c435a932cafc14878ec29 P a6e8360424fb444eb7d9a1ee55c824e1: Bootstrap starting.
I20260810 15:25:32.204828 22957 ts_tablet_manager.cc:1905] T 6860556303eb41dcaa369dee813a49f6 P e934fc72e9bf430895b18ddfddac2c7d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 15:25:32.204852 22985 tablet_bootstrap.cc:654] T ff2910bc827c435a932cafc14878ec29 P a6e8360424fb444eb7d9a1ee55c824e1: Neither blocks nor log segments found. Creating new log.
I20260810 15:25:32.205430 22985 tablet_bootstrap.cc:492] T ff2910bc827c435a932cafc14878ec29 P a6e8360424fb444eb7d9a1ee55c824e1: No bootstrap required, opened a new log
I20260810 15:25:32.205497 22985 ts_tablet_manager.cc:1397] T ff2910bc827c435a932cafc14878ec29 P a6e8360424fb444eb7d9a1ee55c824e1: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260810 15:25:32.205644 22985 raft_consensus.cc:348] T ff2910bc827c435a932cafc14878ec29 P a6e8360424fb444eb7d9a1ee55c824e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e934fc72e9bf430895b18ddfddac2c7d" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35749 } } peers { permanent_uuid: "0be5c2fe77b24afb982c3c286718a28a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 43129 } } peers { permanent_uuid: "a6e8360424fb444eb7d9a1ee55c824e1" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37443 } }
I20260810 15:25:32.205741 22985 raft_consensus.cc:374] T ff2910bc827c435a932cafc14878ec29 P a6e8360424fb444eb7d9a1ee55c824e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:25:32.205767 22985 raft_consensus.cc:729] T ff2910bc827c435a932cafc14878ec29 P a6e8360424fb444eb7d9a1ee55c824e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6e8360424fb444eb7d9a1ee55c824e1, State: Initialized, Role: FOLLOWER
I20260810 15:25:32.205828 22985 consensus_queue.cc:260] T ff2910bc827c435a932cafc14878ec29 P a6e8360424fb444eb7d9a1ee55c824e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e934fc72e9bf430895b18ddfddac2c7d" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35749 } } peers { permanent_uuid: "0be5c2fe77b24afb982c3c286718a28a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 43129 } } peers { permanent_uuid: "a6e8360424fb444eb7d9a1ee55c824e1" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37443 } }
I20260810 15:25:32.205940 22985 ts_tablet_manager.cc:1428] T ff2910bc827c435a932cafc14878ec29 P a6e8360424fb444eb7d9a1ee55c824e1: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260810 15:25:32.206491 22957 ts_tablet_manager.cc:1918] T 6860556303eb41dcaa369dee813a49f6 P e934fc72e9bf430895b18ddfddac2c7d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 15:25:32.206539 22983 tablet_bootstrap.cc:492] T ff2910bc827c435a932cafc14878ec29 P 0be5c2fe77b24afb982c3c286718a28a: No bootstrap required, opened a new log
I20260810 15:25:32.206557 22957 log.cc:1196] T 6860556303eb41dcaa369dee813a49f6 P e934fc72e9bf430895b18ddfddac2c7d: Deleting WAL directory at /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/minicluster-data/ts-0/wal/wals/6860556303eb41dcaa369dee813a49f6
I20260810 15:25:32.206590 22983 ts_tablet_manager.cc:1397] T ff2910bc827c435a932cafc14878ec29 P 0be5c2fe77b24afb982c3c286718a28a: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260810 15:25:32.206781 22983 raft_consensus.cc:348] T ff2910bc827c435a932cafc14878ec29 P 0be5c2fe77b24afb982c3c286718a28a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e934fc72e9bf430895b18ddfddac2c7d" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35749 } } peers { permanent_uuid: "0be5c2fe77b24afb982c3c286718a28a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 43129 } } peers { permanent_uuid: "a6e8360424fb444eb7d9a1ee55c824e1" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37443 } }
I20260810 15:25:32.206863 22983 raft_consensus.cc:374] T ff2910bc827c435a932cafc14878ec29 P 0be5c2fe77b24afb982c3c286718a28a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:25:32.206871 22957 ts_tablet_manager.cc:1939] T 6860556303eb41dcaa369dee813a49f6 P e934fc72e9bf430895b18ddfddac2c7d: Deleting consensus metadata
I20260810 15:25:32.206894 22983 raft_consensus.cc:729] T ff2910bc827c435a932cafc14878ec29 P 0be5c2fe77b24afb982c3c286718a28a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0be5c2fe77b24afb982c3c286718a28a, State: Initialized, Role: FOLLOWER
I20260810 15:25:32.206943 22983 consensus_queue.cc:260] T ff2910bc827c435a932cafc14878ec29 P 0be5c2fe77b24afb982c3c286718a28a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e934fc72e9bf430895b18ddfddac2c7d" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35749 } } peers { permanent_uuid: "0be5c2fe77b24afb982c3c286718a28a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 43129 } } peers { permanent_uuid: "a6e8360424fb444eb7d9a1ee55c824e1" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37443 } }
I20260810 15:25:32.207037 22983 ts_tablet_manager.cc:1428] T ff2910bc827c435a932cafc14878ec29 P 0be5c2fe77b24afb982c3c286718a28a: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260810 15:25:32.207196 21845 catalog_manager.cc:4841] TS e934fc72e9bf430895b18ddfddac2c7d (127.18.68.129:35749): tablet 6860556303eb41dcaa369dee813a49f6 (table test-table [id=953cf9b1d6e248d7856cd9c03a6affd9]) successfully deleted
I20260810 15:25:32.226378 22819 raft_consensus.cc:482] T ff2910bc827c435a932cafc14878ec29 P a6e8360424fb444eb7d9a1ee55c824e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 15:25:32.226475 22819 raft_consensus.cc:504] T ff2910bc827c435a932cafc14878ec29 P a6e8360424fb444eb7d9a1ee55c824e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e934fc72e9bf430895b18ddfddac2c7d" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35749 } } peers { permanent_uuid: "0be5c2fe77b24afb982c3c286718a28a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 43129 } } peers { permanent_uuid: "a6e8360424fb444eb7d9a1ee55c824e1" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37443 } }
I20260810 15:25:32.226711 22819 leader_election.cc:288] T ff2910bc827c435a932cafc14878ec29 P a6e8360424fb444eb7d9a1ee55c824e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e934fc72e9bf430895b18ddfddac2c7d (127.18.68.129:35749), 0be5c2fe77b24afb982c3c286718a28a (127.18.68.130:43129)
I20260810 15:25:32.226974 22146 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff2910bc827c435a932cafc14878ec29" candidate_uuid: "a6e8360424fb444eb7d9a1ee55c824e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e934fc72e9bf430895b18ddfddac2c7d" is_pre_election: true
I20260810 15:25:32.226992 22402 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff2910bc827c435a932cafc14878ec29" candidate_uuid: "a6e8360424fb444eb7d9a1ee55c824e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0be5c2fe77b24afb982c3c286718a28a" is_pre_election: true
I20260810 15:25:32.227105 22146 raft_consensus.cc:2454] T ff2910bc827c435a932cafc14878ec29 P e934fc72e9bf430895b18ddfddac2c7d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6e8360424fb444eb7d9a1ee55c824e1 in term 0.
I20260810 15:25:32.227101 22402 raft_consensus.cc:2454] T ff2910bc827c435a932cafc14878ec29 P 0be5c2fe77b24afb982c3c286718a28a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6e8360424fb444eb7d9a1ee55c824e1 in term 0.
I20260810 15:25:32.227308 22538 leader_election.cc:302] T ff2910bc827c435a932cafc14878ec29 P a6e8360424fb444eb7d9a1ee55c824e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0be5c2fe77b24afb982c3c286718a28a, a6e8360424fb444eb7d9a1ee55c824e1; no voters:
I20260810 15:25:32.227429 22819 raft_consensus.cc:2781] T ff2910bc827c435a932cafc14878ec29 P a6e8360424fb444eb7d9a1ee55c824e1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 15:25:32.227512 22819 raft_consensus.cc:482] T ff2910bc827c435a932cafc14878ec29 P a6e8360424fb444eb7d9a1ee55c824e1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 15:25:32.227553 22819 raft_consensus.cc:3037] T ff2910bc827c435a932cafc14878ec29 P a6e8360424fb444eb7d9a1ee55c824e1 [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:25:32.228447 22819 raft_consensus.cc:504] T ff2910bc827c435a932cafc14878ec29 P a6e8360424fb444eb7d9a1ee55c824e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e934fc72e9bf430895b18ddfddac2c7d" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35749 } } peers { permanent_uuid: "0be5c2fe77b24afb982c3c286718a28a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 43129 } } peers { permanent_uuid: "a6e8360424fb444eb7d9a1ee55c824e1" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37443 } }
I20260810 15:25:32.228611 22819 leader_election.cc:288] T ff2910bc827c435a932cafc14878ec29 P a6e8360424fb444eb7d9a1ee55c824e1 [CANDIDATE]: Term 1 election: Requested vote from peers e934fc72e9bf430895b18ddfddac2c7d (127.18.68.129:35749), 0be5c2fe77b24afb982c3c286718a28a (127.18.68.130:43129)
I20260810 15:25:32.228755 22146 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff2910bc827c435a932cafc14878ec29" candidate_uuid: "a6e8360424fb444eb7d9a1ee55c824e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e934fc72e9bf430895b18ddfddac2c7d"
I20260810 15:25:32.228852 22146 raft_consensus.cc:3037] T ff2910bc827c435a932cafc14878ec29 P e934fc72e9bf430895b18ddfddac2c7d [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:25:32.228830 22402 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff2910bc827c435a932cafc14878ec29" candidate_uuid: "a6e8360424fb444eb7d9a1ee55c824e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0be5c2fe77b24afb982c3c286718a28a"
I20260810 15:25:32.228951 22402 raft_consensus.cc:3037] T ff2910bc827c435a932cafc14878ec29 P 0be5c2fe77b24afb982c3c286718a28a [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:25:32.229632 22146 raft_consensus.cc:2454] T ff2910bc827c435a932cafc14878ec29 P e934fc72e9bf430895b18ddfddac2c7d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6e8360424fb444eb7d9a1ee55c824e1 in term 1.
I20260810 15:25:32.229677 22402 raft_consensus.cc:2454] T ff2910bc827c435a932cafc14878ec29 P 0be5c2fe77b24afb982c3c286718a28a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6e8360424fb444eb7d9a1ee55c824e1 in term 1.
I20260810 15:25:32.229857 22539 leader_election.cc:302] T ff2910bc827c435a932cafc14878ec29 P a6e8360424fb444eb7d9a1ee55c824e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a6e8360424fb444eb7d9a1ee55c824e1, e934fc72e9bf430895b18ddfddac2c7d; no voters:
I20260810 15:25:32.229965 22819 raft_consensus.cc:2781] T ff2910bc827c435a932cafc14878ec29 P a6e8360424fb444eb7d9a1ee55c824e1 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 15:25:32.230070 22819 raft_consensus.cc:686] T ff2910bc827c435a932cafc14878ec29 P a6e8360424fb444eb7d9a1ee55c824e1 [term 1 LEADER]: Becoming Leader. State: Replica: a6e8360424fb444eb7d9a1ee55c824e1, State: Running, Role: LEADER
I20260810 15:25:32.230139 22819 consensus_queue.cc:237] T ff2910bc827c435a932cafc14878ec29 P a6e8360424fb444eb7d9a1ee55c824e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e934fc72e9bf430895b18ddfddac2c7d" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35749 } } peers { permanent_uuid: "0be5c2fe77b24afb982c3c286718a28a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 43129 } } peers { permanent_uuid: "a6e8360424fb444eb7d9a1ee55c824e1" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37443 } }
I20260810 15:25:32.230731 21867 catalog_manager.cc:5495] T ff2910bc827c435a932cafc14878ec29 P a6e8360424fb444eb7d9a1ee55c824e1 reported cstate change: term changed from 0 to 1, leader changed from <none> to a6e8360424fb444eb7d9a1ee55c824e1 (127.18.68.131). New cstate: current_term: 1 leader_uuid: "a6e8360424fb444eb7d9a1ee55c824e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e934fc72e9bf430895b18ddfddac2c7d" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0be5c2fe77b24afb982c3c286718a28a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 43129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6e8360424fb444eb7d9a1ee55c824e1" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37443 } health_report { overall_health: HEALTHY } } }
I20260810 15:25:32.242141 22402 raft_consensus.cc:1261] T ff2910bc827c435a932cafc14878ec29 P 0be5c2fe77b24afb982c3c286718a28a [term 1 FOLLOWER]: Refusing update from remote peer a6e8360424fb444eb7d9a1ee55c824e1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 15:25:32.242158 22146 raft_consensus.cc:1261] T ff2910bc827c435a932cafc14878ec29 P e934fc72e9bf430895b18ddfddac2c7d [term 1 FOLLOWER]: Refusing update from remote peer a6e8360424fb444eb7d9a1ee55c824e1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 15:25:32.242391 22930 consensus_queue.cc:1035] T ff2910bc827c435a932cafc14878ec29 P a6e8360424fb444eb7d9a1ee55c824e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e934fc72e9bf430895b18ddfddac2c7d" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 15:25:32.242503 22916 consensus_queue.cc:1035] T ff2910bc827c435a932cafc14878ec29 P a6e8360424fb444eb7d9a1ee55c824e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0be5c2fe77b24afb982c3c286718a28a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 43129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 15:25:32.246757 22913 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260810 15:25:33.764711 21870 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58324:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 15:25:33.764812 21870 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58324:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 15:25:33.765601 21870 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 511c7f22094c4364b143e11cf834e945: Sending DeleteTablet for 3 replicas of tablet ff2910bc827c435a932cafc14878ec29
I20260810 15:25:33.765856 22361 tablet_service.cc:1514] Processing DeleteTablet for tablet ff2910bc827c435a932cafc14878ec29 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 15:25:33 UTC) from {username='kudu', principal='kudu/127.18.68.190@KRBTEST.COM'} at 127.0.0.1:46564
I20260810 15:25:33.765872 22107 tablet_service.cc:1514] Processing DeleteTablet for tablet ff2910bc827c435a932cafc14878ec29 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 15:25:33 UTC) from {username='kudu', principal='kudu/127.18.68.190@KRBTEST.COM'} at 127.0.0.1:44844
I20260810 15:25:33.766014 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 21997
I20260810 15:25:33.766052 22620 tablet_service.cc:1514] Processing DeleteTablet for tablet ff2910bc827c435a932cafc14878ec29 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 15:25:33 UTC) from {username='kudu', principal='kudu/127.18.68.190@KRBTEST.COM'} at 127.0.0.1:46374
I20260810 15:25:33.777456 23046 tablet_replica.cc:330] T ff2910bc827c435a932cafc14878ec29 P 0be5c2fe77b24afb982c3c286718a28a: stopping tablet replica
I20260810 15:25:33.777571 23046 raft_consensus.cc:2229] T ff2910bc827c435a932cafc14878ec29 P 0be5c2fe77b24afb982c3c286718a28a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 15:25:33.777642 23046 raft_consensus.cc:2258] T ff2910bc827c435a932cafc14878ec29 P 0be5c2fe77b24afb982c3c286718a28a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 15:25:33.777990 23046 ts_tablet_manager.cc:1905] T ff2910bc827c435a932cafc14878ec29 P 0be5c2fe77b24afb982c3c286718a28a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 15:25:33.778153 23049 tablet_replica.cc:330] T ff2910bc827c435a932cafc14878ec29 P a6e8360424fb444eb7d9a1ee55c824e1: stopping tablet replica
I20260810 15:25:33.778263 23049 raft_consensus.cc:2229] T ff2910bc827c435a932cafc14878ec29 P a6e8360424fb444eb7d9a1ee55c824e1 [term 1 LEADER]: Raft consensus shutting down.
I20260810 15:25:33.778379 23049 raft_consensus.cc:2258] T ff2910bc827c435a932cafc14878ec29 P a6e8360424fb444eb7d9a1ee55c824e1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 15:25:33.778666 23049 ts_tablet_manager.cc:1905] T ff2910bc827c435a932cafc14878ec29 P a6e8360424fb444eb7d9a1ee55c824e1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 15:25:33.779963 23046 ts_tablet_manager.cc:1918] T ff2910bc827c435a932cafc14878ec29 P 0be5c2fe77b24afb982c3c286718a28a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260810 15:25:33.780072 23046 log.cc:1196] T ff2910bc827c435a932cafc14878ec29 P 0be5c2fe77b24afb982c3c286718a28a: Deleting WAL directory at /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/minicluster-data/ts-1/wal/wals/ff2910bc827c435a932cafc14878ec29
I20260810 15:25:33.780393 23046 ts_tablet_manager.cc:1939] T ff2910bc827c435a932cafc14878ec29 P 0be5c2fe77b24afb982c3c286718a28a: Deleting consensus metadata
I20260810 15:25:33.780717 23049 ts_tablet_manager.cc:1918] T ff2910bc827c435a932cafc14878ec29 P a6e8360424fb444eb7d9a1ee55c824e1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260810 15:25:33.780812 23049 log.cc:1196] T ff2910bc827c435a932cafc14878ec29 P a6e8360424fb444eb7d9a1ee55c824e1: Deleting WAL directory at /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786375520124696-18706-0/minicluster-data/ts-2/wal/wals/ff2910bc827c435a932cafc14878ec29
I20260810 15:25:33.780844 21844 catalog_manager.cc:4841] TS 0be5c2fe77b24afb982c3c286718a28a (127.18.68.130:43129): tablet ff2910bc827c435a932cafc14878ec29 (table test-table [id=954c1685de3a492fa6ab83d434e8db81]) successfully deleted
I20260810 15:25:33.781158 23049 ts_tablet_manager.cc:1939] T ff2910bc827c435a932cafc14878ec29 P a6e8360424fb444eb7d9a1ee55c824e1: Deleting consensus metadata
I20260810 15:25:33.781531 21844 catalog_manager.cc:4841] TS a6e8360424fb444eb7d9a1ee55c824e1 (127.18.68.131:37443): tablet ff2910bc827c435a932cafc14878ec29 (table test-table [id=954c1685de3a492fa6ab83d434e8db81]) successfully deleted
W20260810 15:25:33.785851 21845 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.18.68.129:35749 (error 108)
I20260810 15:25:33.786129 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 22251
I20260810 15:25:33.799211 23051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:33.788632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.129:35749 (local address 127.0.0.1:44854)
0810 15:25:33.799046 (+ 10414us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:33.799142 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.129:35749: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":10374,"thread_start_us":1515,"threads_started":1}
W20260810 15:25:33.799655 21845 catalog_manager.cc:4584] TS e934fc72e9bf430895b18ddfddac2c7d (127.18.68.129:35749): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ff2910bc827c435a932cafc14878ec29: Network error: Client connection negotiation failed: client connection to 127.18.68.129:35749: connect: Connection refused (error 111)
I20260810 15:25:33.807210 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 22510
I20260810 15:25:33.822639 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 21814
2026-08-10T15:25:33Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (6326 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786375520124696-18706-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 15:25:33 dist-test-slave-2p8l krb5kdc[23056](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 15:25:33 dist-test-slave-2p8l krb5kdc[23056](info): set up 2 sockets
Aug 10 15:25:33 dist-test-slave-2p8l krb5kdc[23056](info): commencing operation
krb5kdc: starting...
W20260810 15:25:35.132998 18706 mini_kdc.cc:121] Time spent starting KDC: real 1.277s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786375520124696-18706-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786375520124696-18706-0/krb5kdc/test-user.keytab.
Aug 10 15:25:35 dist-test-slave-2p8l krb5kdc[23056](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375535, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T15:25:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T15:25:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.68.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.68.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.68.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab.
Entry for principal kudu/127.18.68.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab.
I20260810 15:25:35.260795 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786375520124696-18706-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786375520124696-18706-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786375520124696-18706-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.190:41423
--webserver_interface=127.18.68.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab
--principal=kudu/127.18.68.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:37187
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.68.190:41423
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:25:35.345279 23082 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:25:35.345527 23082 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:25:35.345567 23082 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:25:35.346736 23082 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 15:25:35.346807 23082 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:25:35.346830 23082 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:25:35.346849 23082 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 15:25:35.346880 23082 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 15:25:35.348378 23082 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:37187
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786375520124696-18706-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786375520124696-18706-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.68.190:41423
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab
--principal=kudu/127.18.68.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.190:41423
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.68.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23082
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786375520124696-18706-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:25:35.348672 23082 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:25:35.348906 23082 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:25:35.354077 23098 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:35.354113 23093 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:35.354190 23091 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:25:35.354272 23082 server_base.cc:1034] running on GCE node
I20260810 15:25:35.354545 23082 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:25:35.354869 23082 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:25:35.356057 23082 hybrid_clock.cc:648] HybridClock initialized: now 1786375535356042 us; error 48 us; skew 500 ppm
Aug 10 15:25:35 dist-test-slave-2p8l krb5kdc[23056](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375535, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:25:35.358692 23082 init.cc:377] Logged in from keytab as kudu/127.18.68.190@KRBTEST.COM (short username kudu)
I20260810 15:25:35.359179 23082 webserver.cc:460] Webserver started at http://127.18.68.190:43927/ using document root <none> and password file <none>
I20260810 15:25:35.359367 23082 fs_manager.cc:359] Metadata directory not provided
I20260810 15:25:35.359407 23082 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:25:35.359498 23082 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:25:35.360544 23082 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786375520124696-18706-0/minicluster-data/master-0/data/instance:
uuid: "cd66f0cfd2b24bfdae2f17c82da574d8"
format_stamp: "Formatted at 2026-08-10 15:25:35 on dist-test-slave-2p8l"
server_key: "70d341d8609cbc574a6b3f37df5aa821"
server_key_iv: "e9b066f6cca1a44b0cc476346698a667"
server_key_version: "encryptionkey@0"
I20260810 15:25:35.360864 23082 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786375520124696-18706-0/minicluster-data/master-0/wal/instance:
uuid: "cd66f0cfd2b24bfdae2f17c82da574d8"
format_stamp: "Formatted at 2026-08-10 15:25:35 on dist-test-slave-2p8l"
server_key: "70d341d8609cbc574a6b3f37df5aa821"
server_key_iv: "e9b066f6cca1a44b0cc476346698a667"
server_key_version: "encryptionkey@0"
I20260810 15:25:35.362270 23082 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260810 15:25:35.363005 23114 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:35.363194 23082 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:35.363288 23082 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786375520124696-18706-0/minicluster-data/master-0/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786375520124696-18706-0/minicluster-data/master-0/wal
uuid: "cd66f0cfd2b24bfdae2f17c82da574d8"
format_stamp: "Formatted at 2026-08-10 15:25:35 on dist-test-slave-2p8l"
server_key: "70d341d8609cbc574a6b3f37df5aa821"
server_key_iv: "e9b066f6cca1a44b0cc476346698a667"
server_key_version: "encryptionkey@0"
I20260810 15:25:35.363344 23082 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786375520124696-18706-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786375520124696-18706-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786375520124696-18706-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:25:35.374181 23082 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:25:35.376616 23082 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:25:35.376744 23082 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:25:35.380738 23082 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.190:41423
I20260810 15:25:35.380824 23197 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.190:41423 every 8 connection(s)
I20260810 15:25:35.381358 23082 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
I20260810 15:25:35.382134 23198 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:25:35.384549 23198 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cd66f0cfd2b24bfdae2f17c82da574d8: Bootstrap starting.
I20260810 15:25:35.385187 23198 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cd66f0cfd2b24bfdae2f17c82da574d8: Neither blocks nor log segments found. Creating new log.
I20260810 15:25:35.385491 23198 log.cc:824] T 00000000000000000000000000000000 P cd66f0cfd2b24bfdae2f17c82da574d8: Log is configured to *not* fsync() on all Append() calls
I20260810 15:25:35.386379 23198 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cd66f0cfd2b24bfdae2f17c82da574d8: No bootstrap required, opened a new log
I20260810 15:25:35.386772 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 23082
I20260810 15:25:35.386886 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786375520124696-18706-0/minicluster-data/master-0/wal/instance
I20260810 15:25:35.387072 18706 external_mini_cluster.cc:1428] Setting key 5af96bf24ab6967d6041151df570820b
I20260810 15:25:35.388741 23198 raft_consensus.cc:348] T 00000000000000000000000000000000 P cd66f0cfd2b24bfdae2f17c82da574d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd66f0cfd2b24bfdae2f17c82da574d8" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 41423 } }
I20260810 15:25:35.388928 23198 raft_consensus.cc:374] T 00000000000000000000000000000000 P cd66f0cfd2b24bfdae2f17c82da574d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:25:35.388968 23198 raft_consensus.cc:729] T 00000000000000000000000000000000 P cd66f0cfd2b24bfdae2f17c82da574d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd66f0cfd2b24bfdae2f17c82da574d8, State: Initialized, Role: FOLLOWER
I20260810 15:25:35.389160 23198 consensus_queue.cc:260] T 00000000000000000000000000000000 P cd66f0cfd2b24bfdae2f17c82da574d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd66f0cfd2b24bfdae2f17c82da574d8" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 41423 } }
I20260810 15:25:35.389250 23198 raft_consensus.cc:388] T 00000000000000000000000000000000 P cd66f0cfd2b24bfdae2f17c82da574d8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 15:25:35.389274 23198 raft_consensus.cc:482] T 00000000000000000000000000000000 P cd66f0cfd2b24bfdae2f17c82da574d8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 15:25:35.389330 23198 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cd66f0cfd2b24bfdae2f17c82da574d8 [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:25:35.390676 23198 raft_consensus.cc:504] T 00000000000000000000000000000000 P cd66f0cfd2b24bfdae2f17c82da574d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd66f0cfd2b24bfdae2f17c82da574d8" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 41423 } }
I20260810 15:25:35.390798 23198 leader_election.cc:302] T 00000000000000000000000000000000 P cd66f0cfd2b24bfdae2f17c82da574d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cd66f0cfd2b24bfdae2f17c82da574d8; no voters:
I20260810 15:25:35.390969 23198 leader_election.cc:288] T 00000000000000000000000000000000 P cd66f0cfd2b24bfdae2f17c82da574d8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 15:25:35.391049 23205 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cd66f0cfd2b24bfdae2f17c82da574d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 15:25:35.391222 23198 sys_catalog.cc:564] T 00000000000000000000000000000000 P cd66f0cfd2b24bfdae2f17c82da574d8 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 15:25:35.391285 23205 raft_consensus.cc:686] T 00000000000000000000000000000000 P cd66f0cfd2b24bfdae2f17c82da574d8 [term 1 LEADER]: Becoming Leader. State: Replica: cd66f0cfd2b24bfdae2f17c82da574d8, State: Running, Role: LEADER
I20260810 15:25:35.392632 23205 consensus_queue.cc:237] T 00000000000000000000000000000000 P cd66f0cfd2b24bfdae2f17c82da574d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd66f0cfd2b24bfdae2f17c82da574d8" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 41423 } }
W20260810 15:25:35.393715 23235 catalog_manager.cc:1558] T 00000000000000000000000000000000 P cd66f0cfd2b24bfdae2f17c82da574d8: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260810 15:25:35.393392 23208 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd66f0cfd2b24bfdae2f17c82da574d8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cd66f0cfd2b24bfdae2f17c82da574d8. Latest consensus state: current_term: 1 leader_uuid: "cd66f0cfd2b24bfdae2f17c82da574d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd66f0cfd2b24bfdae2f17c82da574d8" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 41423 } } }
W20260810 15:25:35.393779 23235 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 15:25:35.393262 23207 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd66f0cfd2b24bfdae2f17c82da574d8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cd66f0cfd2b24bfdae2f17c82da574d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd66f0cfd2b24bfdae2f17c82da574d8" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 41423 } } }
I20260810 15:25:35.393803 23208 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd66f0cfd2b24bfdae2f17c82da574d8 [sys.catalog]: This master's current role is: LEADER
I20260810 15:25:35.393821 23207 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd66f0cfd2b24bfdae2f17c82da574d8 [sys.catalog]: This master's current role is: LEADER
I20260810 15:25:35.394037 23237 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 15:25:35.394270 23237 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 10 15:25:35 dist-test-slave-2p8l krb5kdc[23056](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375535, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
I20260810 15:25:35.396852 23237 catalog_manager.cc:1347] Generated new cluster ID: 1c1eaff6ba6d42f7ac2ed485226fb37b
I20260810 15:25:35.396912 23237 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 15:25:35.400182 23204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:35.387702 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42980 (local address 127.18.68.190:41423)
0810 15:25:35.387956 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:35.387967 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:35.388003 (+ 36us) server_negotiation.cc:407] Connection header received
0810 15:25:35.388693 (+ 690us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:35.388702 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:35.388772 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:35.388932 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:35.389776 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:35.391305 (+ 1529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:35.392316 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:35.392941 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:35.393071 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:35.396147 (+ 3076us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:35.396158 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:35.396158 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:35.396172 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:35.398389 (+ 2217us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:35.398821 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:35.398824 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:35.398824 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:35.398958 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:35.399208 (+ 250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:35.399209 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:35.399209 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:35.399506 (+ 297us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:35.399652 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:35.399842 (+ 190us) server_negotiation.cc:299] Negotiation successful
0810 15:25:35.399984 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":196,"thread_start_us":123,"threads_started":1}
I20260810 15:25:35.414919 23237 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 15:25:35.415485 23237 catalog_manager.cc:1504] Loading token signing keys...
I20260810 15:25:35.423362 23237 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cd66f0cfd2b24bfdae2f17c82da574d8: Generated new TSK 0
I20260810 15:25:35.423568 23237 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.18.68.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.68.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.68.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.129.keytab.
Entry for principal kudu/127.18.68.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.129.keytab.
I20260810 15:25:35.457772 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786375520124696-18706-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786375520124696-18706-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786375520124696-18706-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786375520124696-18706-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.68.129:0
--local_ip_for_outbound_sockets=127.18.68.129
--webserver_interface=127.18.68.129
--webserver_port=0
--tserver_master_addrs=127.18.68.190:41423
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.129.keytab
--principal=kudu/127.18.68.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:37187
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:25:35.542325 23244 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:25:35.542573 23244 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:25:35.542623 23244 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:25:35.543819 23244 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:25:35.543886 23244 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:25:35.543931 23244 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.68.129
I20260810 15:25:35.545404 23244 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:37187
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786375520124696-18706-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786375520124696-18706-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.129.keytab
--principal=kudu/127.18.68.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.68.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786375520124696-18706-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.68.129
--webserver_port=0
--tserver_master_addrs=127.18.68.190:41423
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23244
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.68.129
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786375520124696-18706-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:25:35.545678 23244 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:25:35.545912 23244 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:25:35.551343 23258 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:35.551343 23253 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:35.551343 23252 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:25:35.551558 23244 server_base.cc:1034] running on GCE node
I20260810 15:25:35.551795 23244 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:25:35.552078 23244 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:25:35.553280 23244 hybrid_clock.cc:648] HybridClock initialized: now 1786375535553267 us; error 30 us; skew 500 ppm
Aug 10 15:25:35 dist-test-slave-2p8l krb5kdc[23056](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375535, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:25:35.556175 23244 init.cc:377] Logged in from keytab as kudu/127.18.68.129@KRBTEST.COM (short username kudu)
I20260810 15:25:35.556726 23244 webserver.cc:460] Webserver started at http://127.18.68.129:46065/ using document root <none> and password file <none>
I20260810 15:25:35.556979 23244 fs_manager.cc:359] Metadata directory not provided
I20260810 15:25:35.557054 23244 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:25:35.557222 23244 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:25:35.558542 23244 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786375520124696-18706-0/minicluster-data/ts-0/data/instance:
uuid: "89fe96b9fd4f4053a3e1c62924415f9a"
format_stamp: "Formatted at 2026-08-10 15:25:35 on dist-test-slave-2p8l"
server_key: "7b632d438f2a24a6ac7479e9f1f8c788"
server_key_iv: "1027fe85912fbd96a3225363efb82c9e"
server_key_version: "encryptionkey@0"
I20260810 15:25:35.558962 23244 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786375520124696-18706-0/minicluster-data/ts-0/wal/instance:
uuid: "89fe96b9fd4f4053a3e1c62924415f9a"
format_stamp: "Formatted at 2026-08-10 15:25:35 on dist-test-slave-2p8l"
server_key: "7b632d438f2a24a6ac7479e9f1f8c788"
server_key_iv: "1027fe85912fbd96a3225363efb82c9e"
server_key_version: "encryptionkey@0"
I20260810 15:25:35.560617 23244 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 15:25:35.561452 23268 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:35.561682 23244 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:25:35.561800 23244 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786375520124696-18706-0/minicluster-data/ts-0/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786375520124696-18706-0/minicluster-data/ts-0/wal
uuid: "89fe96b9fd4f4053a3e1c62924415f9a"
format_stamp: "Formatted at 2026-08-10 15:25:35 on dist-test-slave-2p8l"
server_key: "7b632d438f2a24a6ac7479e9f1f8c788"
server_key_iv: "1027fe85912fbd96a3225363efb82c9e"
server_key_version: "encryptionkey@0"
I20260810 15:25:35.561884 23244 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786375520124696-18706-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786375520124696-18706-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786375520124696-18706-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:25:35.572261 23244 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:25:35.574854 23244 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:25:35.575037 23244 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:25:35.575304 23244 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 15:25:35.575659 23244 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 15:25:35.575722 23244 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:35.575757 23244 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 15:25:35.575798 23244 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:35.581792 23244 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.129:41027
I20260810 15:25:35.581845 23465 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.129:41027 every 8 connection(s)
I20260810 15:25:35.582238 23244 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786375520124696-18706-0/minicluster-data/ts-0/data/info.pb
I20260810 15:25:35.583932 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 23244
I20260810 15:25:35.584030 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786375520124696-18706-0/minicluster-data/ts-0/wal/instance
I20260810 15:25:35.584251 18706 external_mini_cluster.cc:1428] Setting key 51490769a5000e8c865e53c3dbd2eda2
Aug 10 15:25:35 dist-test-slave-2p8l krb5kdc[23056](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375535, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.129@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
I20260810 15:25:35.593093 23204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:35.582958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.129:48081 (local address 127.18.68.190:41423)
0810 15:25:35.583050 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:35.583052 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:35.583218 (+ 166us) server_negotiation.cc:407] Connection header received
0810 15:25:35.583822 (+ 604us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:35.583823 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:35.583837 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:35.583902 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:35.585183 (+ 1281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:35.585699 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:35.587156 (+ 1457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:35.587383 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:35.587461 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:35.589764 (+ 2303us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:35.589766 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:35.589766 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:35.589774 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:35.591419 (+ 1645us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:35.591974 (+ 555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:35.591976 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:35.591976 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:35.592036 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:35.592342 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:35.592343 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:35.592343 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:35.592466 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:35.592503 (+ 37us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:35.592888 (+ 385us) server_negotiation.cc:299] Negotiation successful
0810 15:25:35.592996 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260810 15:25:35.593291 23475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:35.582914 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:41423 (local address 127.18.68.129:48081)
0810 15:25:35.583084 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:35.583123 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:35.583647 (+ 524us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:35.583999 (+ 352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:35.584004 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:35.584794 (+ 790us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:25:35.585084 (+ 290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:35.585090 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:35.585798 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:35.585800 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:35.587043 (+ 1243us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:35.587046 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:35.587470 (+ 424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:35.587471 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:35.587601 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:35.588180 (+ 579us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:25:35.588189 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:25:35.589658 (+ 1469us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:25:35.591517 (+ 1859us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:35.591526 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:35.591528 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:35.591847 (+ 319us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:35.592122 (+ 275us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:35.592122 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:35.592123 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:35.592235 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:35.592546 (+ 311us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:25:35.592553 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:25:35.592670 (+ 117us) client_negotiation.cc:769] Sending connection context
0810 15:25:35.592863 (+ 193us) client_negotiation.cc:240] Negotiation successful
0810 15:25:35.593043 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":106,"threads_started":1}
WARNING: no policy specified for kudu/127.18.68.130@KRBTEST.COM; defaulting to no policy
I20260810 15:25:35.593780 23466 heartbeater.cc:347] Connected to a master server at 127.18.68.190:41423
I20260810 15:25:35.593933 23466 heartbeater.cc:464] Registering TS with master...
I20260810 15:25:35.594190 23466 heartbeater.cc:511] Master 127.18.68.190:41423 requested a full tablet report, sending...
I20260810 15:25:35.594807 23144 ts_manager.cc:194] Registered new tserver with Master: 89fe96b9fd4f4053a3e1c62924415f9a (127.18.68.129:41027)
I20260810 15:25:35.595439 23144 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.68.129@KRBTEST.COM'} at 127.18.68.129:48081
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.68.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.68.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.130.keytab.
Entry for principal kudu/127.18.68.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.130.keytab.
I20260810 15:25:35.612982 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786375520124696-18706-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786375520124696-18706-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786375520124696-18706-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786375520124696-18706-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.68.130:0
--local_ip_for_outbound_sockets=127.18.68.130
--webserver_interface=127.18.68.130
--webserver_port=0
--tserver_master_addrs=127.18.68.190:41423
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.130.keytab
--principal=kudu/127.18.68.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:37187
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:25:35.695811 23478 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:25:35.696038 23478 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:25:35.696064 23478 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:25:35.697288 23478 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:25:35.697336 23478 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:25:35.697364 23478 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.68.130
I20260810 15:25:35.698990 23478 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:37187
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786375520124696-18706-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786375520124696-18706-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.130.keytab
--principal=kudu/127.18.68.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.68.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786375520124696-18706-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.68.130
--webserver_port=0
--tserver_master_addrs=127.18.68.190:41423
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23478
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.68.130
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786375520124696-18706-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:25:35.699255 23478 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:25:35.699489 23478 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:25:35.704722 23488 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:35.704725 23493 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:35.704751 23490 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:25:35.705041 23478 server_base.cc:1034] running on GCE node
I20260810 15:25:35.705282 23478 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:25:35.705556 23478 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:25:35.706768 23478 hybrid_clock.cc:648] HybridClock initialized: now 1786375535706753 us; error 28 us; skew 500 ppm
Aug 10 15:25:35 dist-test-slave-2p8l krb5kdc[23056](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375535, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:25:35.713394 23478 init.cc:377] Logged in from keytab as kudu/127.18.68.130@KRBTEST.COM (short username kudu)
I20260810 15:25:35.714082 23478 webserver.cc:460] Webserver started at http://127.18.68.130:37931/ using document root <none> and password file <none>
I20260810 15:25:35.714397 23478 fs_manager.cc:359] Metadata directory not provided
I20260810 15:25:35.714478 23478 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:25:35.714634 23478 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:25:35.715790 23478 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786375520124696-18706-0/minicluster-data/ts-1/data/instance:
uuid: "914fbb609cd9452bbac79442d1b78a9c"
format_stamp: "Formatted at 2026-08-10 15:25:35 on dist-test-slave-2p8l"
server_key: "bdfa89192357b6db229dbadb232708b1"
server_key_iv: "0eeb3ae2531f545ad84c1448736c6f7a"
server_key_version: "encryptionkey@0"
I20260810 15:25:35.716176 23478 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786375520124696-18706-0/minicluster-data/ts-1/wal/instance:
uuid: "914fbb609cd9452bbac79442d1b78a9c"
format_stamp: "Formatted at 2026-08-10 15:25:35 on dist-test-slave-2p8l"
server_key: "bdfa89192357b6db229dbadb232708b1"
server_key_iv: "0eeb3ae2531f545ad84c1448736c6f7a"
server_key_version: "encryptionkey@0"
I20260810 15:25:35.717638 23478 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 15:25:35.718546 23510 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:35.718735 23478 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260810 15:25:35.718845 23478 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786375520124696-18706-0/minicluster-data/ts-1/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786375520124696-18706-0/minicluster-data/ts-1/wal
uuid: "914fbb609cd9452bbac79442d1b78a9c"
format_stamp: "Formatted at 2026-08-10 15:25:35 on dist-test-slave-2p8l"
server_key: "bdfa89192357b6db229dbadb232708b1"
server_key_iv: "0eeb3ae2531f545ad84c1448736c6f7a"
server_key_version: "encryptionkey@0"
I20260810 15:25:35.718925 23478 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786375520124696-18706-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786375520124696-18706-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786375520124696-18706-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:25:35.740181 23478 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:25:35.743081 23478 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:25:35.743278 23478 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:25:35.743563 23478 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 15:25:35.743947 23478 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 15:25:35.744016 23478 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:35.744057 23478 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 15:25:35.744094 23478 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:35.751142 23478 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.130:35981
I20260810 15:25:35.751225 23697 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.130:35981 every 8 connection(s)
I20260810 15:25:35.751606 23478 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786375520124696-18706-0/minicluster-data/ts-1/data/info.pb
I20260810 15:25:35.758898 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 23478
I20260810 15:25:35.759027 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786375520124696-18706-0/minicluster-data/ts-1/wal/instance
I20260810 15:25:35.759271 18706 external_mini_cluster.cc:1428] Setting key 97d0a333097d9cf108b790f1090d229b
Aug 10 15:25:35 dist-test-slave-2p8l krb5kdc[23056](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375535, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.130@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
I20260810 15:25:35.763140 23204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:35.752484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.130:33601 (local address 127.18.68.190:41423)
0810 15:25:35.752618 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:35.752620 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:35.752753 (+ 133us) server_negotiation.cc:407] Connection header received
0810 15:25:35.753290 (+ 537us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:35.753291 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:35.753301 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:35.753368 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:35.754570 (+ 1202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:35.755097 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:35.756507 (+ 1410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:35.756890 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:35.756980 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:35.759941 (+ 2961us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:35.759943 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:35.759943 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:35.759951 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:35.761445 (+ 1494us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:35.761948 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:35.761949 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:35.761949 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:35.762017 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:35.762371 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:35.762372 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:35.762372 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:35.762524 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:35.762603 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:35.762910 (+ 307us) server_negotiation.cc:299] Negotiation successful
0810 15:25:35.763005 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260810 15:25:35.763226 23704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:35.752429 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:41423 (local address 127.18.68.130:33601)
0810 15:25:35.752617 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:35.752667 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:35.753191 (+ 524us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:35.753429 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:35.753432 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:35.754235 (+ 803us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:25:35.754459 (+ 224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:35.754465 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:35.755215 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:35.755216 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:35.756409 (+ 1193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:35.756412 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:35.756979 (+ 567us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:35.756980 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:35.757136 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:35.757770 (+ 634us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:25:35.757782 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:25:35.759837 (+ 2055us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:25:35.761562 (+ 1725us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:35.761572 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:35.761574 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:35.761872 (+ 298us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:35.762161 (+ 289us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:35.762162 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:35.762163 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:35.762296 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:35.762630 (+ 334us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:25:35.762636 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:25:35.762766 (+ 130us) client_negotiation.cc:769] Sending connection context
0810 15:25:35.762863 (+ 97us) client_negotiation.cc:240] Negotiation successful
0810 15:25:35.763002 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":92,"threads_started":1}
I20260810 15:25:35.763794 23700 heartbeater.cc:347] Connected to a master server at 127.18.68.190:41423
I20260810 15:25:35.763921 23700 heartbeater.cc:464] Registering TS with master...
I20260810 15:25:35.764124 23700 heartbeater.cc:511] Master 127.18.68.190:41423 requested a full tablet report, sending...
I20260810 15:25:35.764604 23144 ts_manager.cc:194] Registered new tserver with Master: 914fbb609cd9452bbac79442d1b78a9c (127.18.68.130:35981)
I20260810 15:25:35.765194 23144 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.68.130@KRBTEST.COM'} at 127.18.68.130:33601
WARNING: no policy specified for kudu/127.18.68.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.68.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.68.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.131.keytab.
Entry for principal kudu/127.18.68.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.131.keytab.
I20260810 15:25:35.790337 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786375520124696-18706-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786375520124696-18706-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786375520124696-18706-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786375520124696-18706-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.68.131:0
--local_ip_for_outbound_sockets=127.18.68.131
--webserver_interface=127.18.68.131
--webserver_port=0
--tserver_master_addrs=127.18.68.190:41423
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.131.keytab
--principal=kudu/127.18.68.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:37187
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:25:35.873167 23710 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:25:35.873389 23710 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:25:35.873416 23710 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:25:35.874678 23710 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:25:35.874723 23710 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:25:35.874752 23710 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.68.131
I20260810 15:25:35.876291 23710 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:37187
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786375520124696-18706-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786375520124696-18706-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.131.keytab
--principal=kudu/127.18.68.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.68.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786375520124696-18706-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.68.131
--webserver_port=0
--tserver_master_addrs=127.18.68.190:41423
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23710
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.68.131
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786375520124696-18706-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:25:35.876564 23710 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:25:35.876817 23710 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:25:35.882002 23719 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:35.882102 23722 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:35.882004 23717 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:25:35.882427 23710 server_base.cc:1034] running on GCE node
I20260810 15:25:35.882665 23710 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:25:35.882951 23710 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:25:35.884116 23710 hybrid_clock.cc:648] HybridClock initialized: now 1786375535884092 us; error 47 us; skew 500 ppm
Aug 10 15:25:35 dist-test-slave-2p8l krb5kdc[23056](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375535, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:25:35.886894 23710 init.cc:377] Logged in from keytab as kudu/127.18.68.131@KRBTEST.COM (short username kudu)
I20260810 15:25:35.887403 23710 webserver.cc:460] Webserver started at http://127.18.68.131:34759/ using document root <none> and password file <none>
I20260810 15:25:35.887663 23710 fs_manager.cc:359] Metadata directory not provided
I20260810 15:25:35.887710 23710 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:25:35.887877 23710 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:25:35.888911 23710 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786375520124696-18706-0/minicluster-data/ts-2/data/instance:
uuid: "31c9a9ac7e7940ecb179c4cf9bc16ea0"
format_stamp: "Formatted at 2026-08-10 15:25:35 on dist-test-slave-2p8l"
server_key: "ead435a08713baf59c9f038cbaa84bf7"
server_key_iv: "11762876873a08f09f67488abcd78181"
server_key_version: "encryptionkey@0"
I20260810 15:25:35.889271 23710 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786375520124696-18706-0/minicluster-data/ts-2/wal/instance:
uuid: "31c9a9ac7e7940ecb179c4cf9bc16ea0"
format_stamp: "Formatted at 2026-08-10 15:25:35 on dist-test-slave-2p8l"
server_key: "ead435a08713baf59c9f038cbaa84bf7"
server_key_iv: "11762876873a08f09f67488abcd78181"
server_key_version: "encryptionkey@0"
I20260810 15:25:35.890753 23710 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 15:25:35.891747 23736 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:35.892185 23710 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:25:35.892268 23710 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786375520124696-18706-0/minicluster-data/ts-2/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786375520124696-18706-0/minicluster-data/ts-2/wal
uuid: "31c9a9ac7e7940ecb179c4cf9bc16ea0"
format_stamp: "Formatted at 2026-08-10 15:25:35 on dist-test-slave-2p8l"
server_key: "ead435a08713baf59c9f038cbaa84bf7"
server_key_iv: "11762876873a08f09f67488abcd78181"
server_key_version: "encryptionkey@0"
I20260810 15:25:35.892321 23710 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786375520124696-18706-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786375520124696-18706-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786375520124696-18706-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:25:35.907328 23710 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:25:35.909786 23710 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:25:35.909957 23710 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:25:35.910249 23710 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 15:25:35.910591 23710 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 15:25:35.910650 23710 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:35.910687 23710 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 15:25:35.910717 23710 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:35.917047 23710 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.131:41639
I20260810 15:25:35.917105 23962 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.131:41639 every 8 connection(s)
I20260810 15:25:35.917505 23710 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786375520124696-18706-0/minicluster-data/ts-2/data/info.pb
Aug 10 15:25:35 dist-test-slave-2p8l krb5kdc[23056](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375535, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.131@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
I20260810 15:25:35.926652 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 23710
I20260810 15:25:35.926793 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786375520124696-18706-0/minicluster-data/ts-2/wal/instance
I20260810 15:25:35.926988 18706 external_mini_cluster.cc:1428] Setting key c0fe1f8aad3990dfb6b529a6908261dd
I20260810 15:25:35.927868 23204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:35.918378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.131:60047 (local address 127.18.68.190:41423)
0810 15:25:35.918460 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:35.918463 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:35.918667 (+ 204us) server_negotiation.cc:407] Connection header received
0810 15:25:35.919224 (+ 557us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:35.919226 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:35.919239 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:35.919285 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:35.920299 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:35.920805 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:35.921934 (+ 1129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:35.922190 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:35.922277 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:35.924778 (+ 2501us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:35.924780 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:35.924781 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:35.924789 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:35.926312 (+ 1523us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:35.926781 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:35.926782 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:35.926783 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:35.926857 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:35.927153 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:35.927154 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:35.927154 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:35.927292 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:35.927330 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:35.927680 (+ 350us) server_negotiation.cc:299] Negotiation successful
0810 15:25:35.927769 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260810 15:25:35.928094 23967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:35.918340 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:41423 (local address 127.18.68.131:60047)
0810 15:25:35.918521 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:35.918567 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:35.919095 (+ 528us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:35.919372 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:35.919378 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:35.919975 (+ 597us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:25:35.920187 (+ 212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:35.920192 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:35.920911 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:35.920912 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:35.921841 (+ 929us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:35.921844 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:35.922292 (+ 448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:35.922293 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:35.922435 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:35.923088 (+ 653us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:25:35.923098 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:25:35.924662 (+ 1564us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:25:35.926406 (+ 1744us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:35.926417 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:35.926420 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:35.926676 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:35.926938 (+ 262us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:35.926939 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:35.926939 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:35.927052 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:35.927370 (+ 318us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:25:35.927376 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:25:35.927517 (+ 141us) client_negotiation.cc:769] Sending connection context
0810 15:25:35.927655 (+ 138us) client_negotiation.cc:240] Negotiation successful
0810 15:25:35.927838 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":86,"threads_started":1}
I20260810 15:25:35.928676 23964 heartbeater.cc:347] Connected to a master server at 127.18.68.190:41423
I20260810 15:25:35.928795 23964 heartbeater.cc:464] Registering TS with master...
I20260810 15:25:35.928992 23964 heartbeater.cc:511] Master 127.18.68.190:41423 requested a full tablet report, sending...
I20260810 15:25:35.929461 23144 ts_manager.cc:194] Registered new tserver with Master: 31c9a9ac7e7940ecb179c4cf9bc16ea0 (127.18.68.131:41639)
I20260810 15:25:35.929896 23144 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.68.131@KRBTEST.COM'} at 127.18.68.131:60047
I20260810 15:25:35.939487 18706 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260810 15:25:35.953543 23204 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 15:25:35.952626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42996 (local address 127.18.68.190:41423)
0810 15:25:35.952701 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:35.952703 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:35.952826 (+ 123us) server_negotiation.cc:407] Connection header received
0810 15:25:35.952876 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:35.952877 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:35.952887 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:35.952952 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:35.953485 (+ 533us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42996: BlockingRecv error: recv got EOF from 127.0.0.1:42996 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
I20260810 15:25:35.954689 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 23244
I20260810 15:25:35.998994 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 23478
I20260810 15:25:36.016690 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 23710
I20260810 15:25:36.027201 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 23082
2026-08-10T15:25:36Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (2201 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786375520124696-18706-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 15:25:36 dist-test-slave-2p8l krb5kdc[23986](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 15:25:36 dist-test-slave-2p8l krb5kdc[23986](info): set up 2 sockets
Aug 10 15:25:36 dist-test-slave-2p8l krb5kdc[23986](info): commencing operation
krb5kdc: starting...
W20260810 15:25:37.337653 18706 mini_kdc.cc:121] Time spent starting KDC: real 1.281s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786375520124696-18706-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786375520124696-18706-0/krb5kdc/test-user.keytab.
Aug 10 15:25:37 dist-test-slave-2p8l krb5kdc[23986](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375537, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T15:25:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T15:25:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.68.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.68.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.68.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab.
Entry for principal kudu/127.18.68.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab.
I20260810 15:25:37.465549 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786375520124696-18706-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786375520124696-18706-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786375520124696-18706-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.190:34311
--webserver_interface=127.18.68.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab
--principal=kudu/127.18.68.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:46577
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.68.190:34311
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:25:37.558583 24009 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:25:37.558823 24009 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:25:37.558851 24009 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:25:37.560070 24009 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 15:25:37.560105 24009 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:25:37.560127 24009 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:25:37.560139 24009 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 15:25:37.560151 24009 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 15:25:37.561749 24009 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:46577
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786375520124696-18706-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786375520124696-18706-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.68.190:34311
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab
--principal=kudu/127.18.68.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.190:34311
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.68.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24009
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786375520124696-18706-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:25:37.561973 24009 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:25:37.562237 24009 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:25:37.567119 24023 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:37.567129 24027 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:37.567129 24021 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:25:37.567513 24009 server_base.cc:1034] running on GCE node
I20260810 15:25:37.567799 24009 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:25:37.568105 24009 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:25:37.569299 24009 hybrid_clock.cc:648] HybridClock initialized: now 1786375537569285 us; error 46 us; skew 500 ppm
Aug 10 15:25:37 dist-test-slave-2p8l krb5kdc[23986](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375537, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:25:37.571985 24009 init.cc:377] Logged in from keytab as kudu/127.18.68.190@KRBTEST.COM (short username kudu)
I20260810 15:25:37.572454 24009 webserver.cc:460] Webserver started at http://127.18.68.190:45419/ using document root <none> and password file <none>
I20260810 15:25:37.572710 24009 fs_manager.cc:359] Metadata directory not provided
I20260810 15:25:37.572781 24009 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:25:37.572939 24009 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:25:37.574024 24009 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786375520124696-18706-0/minicluster-data/master-0/data/instance:
uuid: "5c867dae16de413eacb34007591bd32f"
format_stamp: "Formatted at 2026-08-10 15:25:37 on dist-test-slave-2p8l"
server_key: "0cadbb22673223b7f675f26c0b8043dc"
server_key_iv: "1a9de8881b361e1e229f193af5732f43"
server_key_version: "encryptionkey@0"
I20260810 15:25:37.574489 24009 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786375520124696-18706-0/minicluster-data/master-0/wal/instance:
uuid: "5c867dae16de413eacb34007591bd32f"
format_stamp: "Formatted at 2026-08-10 15:25:37 on dist-test-slave-2p8l"
server_key: "0cadbb22673223b7f675f26c0b8043dc"
server_key_iv: "1a9de8881b361e1e229f193af5732f43"
server_key_version: "encryptionkey@0"
I20260810 15:25:37.575896 24009 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260810 15:25:37.576702 24040 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:37.576889 24009 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 15:25:37.577003 24009 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786375520124696-18706-0/minicluster-data/master-0/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786375520124696-18706-0/minicluster-data/master-0/wal
uuid: "5c867dae16de413eacb34007591bd32f"
format_stamp: "Formatted at 2026-08-10 15:25:37 on dist-test-slave-2p8l"
server_key: "0cadbb22673223b7f675f26c0b8043dc"
server_key_iv: "1a9de8881b361e1e229f193af5732f43"
server_key_version: "encryptionkey@0"
I20260810 15:25:37.577080 24009 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786375520124696-18706-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786375520124696-18706-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786375520124696-18706-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:25:37.593997 24009 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:25:37.596215 24009 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:25:37.596392 24009 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:25:37.600764 24009 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.190:34311
I20260810 15:25:37.600797 24133 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.190:34311 every 8 connection(s)
I20260810 15:25:37.601293 24009 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
I20260810 15:25:37.601572 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 24009
I20260810 15:25:37.601699 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786375520124696-18706-0/minicluster-data/master-0/wal/instance
I20260810 15:25:37.601909 18706 external_mini_cluster.cc:1428] Setting key 268791084d18099ddc5fd84621aa69f6
I20260810 15:25:37.602139 24135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:25:37.605016 24135 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5c867dae16de413eacb34007591bd32f: Bootstrap starting.
I20260810 15:25:37.605674 24135 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5c867dae16de413eacb34007591bd32f: Neither blocks nor log segments found. Creating new log.
I20260810 15:25:37.605983 24135 log.cc:824] T 00000000000000000000000000000000 P 5c867dae16de413eacb34007591bd32f: Log is configured to *not* fsync() on all Append() calls
I20260810 15:25:37.606844 24135 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5c867dae16de413eacb34007591bd32f: No bootstrap required, opened a new log
Aug 10 15:25:37 dist-test-slave-2p8l krb5kdc[23986](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375537, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
I20260810 15:25:37.608752 24135 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5c867dae16de413eacb34007591bd32f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c867dae16de413eacb34007591bd32f" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 34311 } }
I20260810 15:25:37.608909 24135 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5c867dae16de413eacb34007591bd32f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:25:37.608978 24135 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5c867dae16de413eacb34007591bd32f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c867dae16de413eacb34007591bd32f, State: Initialized, Role: FOLLOWER
I20260810 15:25:37.609138 24135 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5c867dae16de413eacb34007591bd32f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c867dae16de413eacb34007591bd32f" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 34311 } }
I20260810 15:25:37.609222 24135 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5c867dae16de413eacb34007591bd32f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 15:25:37.609267 24135 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5c867dae16de413eacb34007591bd32f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 15:25:37.609306 24135 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5c867dae16de413eacb34007591bd32f [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:25:37.609838 24135 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5c867dae16de413eacb34007591bd32f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c867dae16de413eacb34007591bd32f" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 34311 } }
I20260810 15:25:37.609952 24135 leader_election.cc:302] T 00000000000000000000000000000000 P 5c867dae16de413eacb34007591bd32f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5c867dae16de413eacb34007591bd32f; no voters:
I20260810 15:25:37.610164 24135 leader_election.cc:288] T 00000000000000000000000000000000 P 5c867dae16de413eacb34007591bd32f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 15:25:37.610235 24143 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5c867dae16de413eacb34007591bd32f [term 1 FOLLOWER]: Leader election won for term 1
I20260810 15:25:37.610390 24143 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5c867dae16de413eacb34007591bd32f [term 1 LEADER]: Becoming Leader. State: Replica: 5c867dae16de413eacb34007591bd32f, State: Running, Role: LEADER
I20260810 15:25:37.610450 24135 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5c867dae16de413eacb34007591bd32f [sys.catalog]: configured and running, proceeding with master startup.
I20260810 15:25:37.610484 24143 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5c867dae16de413eacb34007591bd32f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c867dae16de413eacb34007591bd32f" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 34311 } }
I20260810 15:25:37.610858 24144 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c867dae16de413eacb34007591bd32f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5c867dae16de413eacb34007591bd32f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c867dae16de413eacb34007591bd32f" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 34311 } } }
I20260810 15:25:37.610961 24144 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c867dae16de413eacb34007591bd32f [sys.catalog]: This master's current role is: LEADER
I20260810 15:25:37.610847 24143 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c867dae16de413eacb34007591bd32f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5c867dae16de413eacb34007591bd32f. Latest consensus state: current_term: 1 leader_uuid: "5c867dae16de413eacb34007591bd32f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c867dae16de413eacb34007591bd32f" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 34311 } } }
I20260810 15:25:37.611163 24143 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c867dae16de413eacb34007591bd32f [sys.catalog]: This master's current role is: LEADER
I20260810 15:25:37.611307 24158 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 15:25:37.611961 24158 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 15:25:37.612990 24141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:37.602465 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55224 (local address 127.18.68.190:34311)
0810 15:25:37.602669 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:37.602684 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:37.602710 (+ 26us) server_negotiation.cc:407] Connection header received
0810 15:25:37.603228 (+ 518us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:37.603234 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:37.603281 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:37.603436 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:37.604107 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:37.604981 (+ 874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:37.605775 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:37.606335 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:37.606456 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:37.608916 (+ 2460us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:37.608925 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:37.608925 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:37.608956 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:37.611158 (+ 2202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:37.611600 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:37.611603 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:37.611604 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:37.611707 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:37.611982 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:37.611983 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:37.611983 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:37.612296 (+ 313us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:37.612493 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:37.612566 (+ 73us) server_negotiation.cc:299] Negotiation successful
0810 15:25:37.612848 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":90,"threads_started":1}
I20260810 15:25:37.613554 24158 catalog_manager.cc:1347] Generated new cluster ID: 083079a19a444ad3947a376c1c291f69
I20260810 15:25:37.613610 24158 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 15:25:37.613989 18706 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 15:25:37.634517 24158 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 15:25:37.635056 24158 catalog_manager.cc:1504] Loading token signing keys...
I20260810 15:25:37.638782 24141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:37.630505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55234 (local address 127.18.68.190:34311)
0810 15:25:37.630570 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:37.630572 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:37.630782 (+ 210us) server_negotiation.cc:407] Connection header received
0810 15:25:37.630825 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:37.630826 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:37.630838 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:37.630906 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:37.631329 (+ 423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:37.632117 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:37.633144 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:37.633464 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:37.633537 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:37.638197 (+ 4660us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:37.638198 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:37.638199 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 15:25:37.638432 (+ 233us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:37.638453 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 15:25:37.638461 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:37.638528 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:37.638623 (+ 95us) server_negotiation.cc:299] Negotiation successful
0810 15:25:37.638678 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":37}
I20260810 15:25:37.639117 24158 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5c867dae16de413eacb34007591bd32f: Generated new TSK 0
I20260810 15:25:37.639289 24158 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 15:25:37.645094 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 24009
2026-08-10T15:25:37Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1615 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786375520124696-18706-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 15:25:37 dist-test-slave-2p8l krb5kdc[24197](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 15:25:37 dist-test-slave-2p8l krb5kdc[24197](info): set up 2 sockets
Aug 10 15:25:37 dist-test-slave-2p8l krb5kdc[24197](info): commencing operation
krb5kdc: starting...
W20260810 15:25:39.007108 18706 mini_kdc.cc:121] Time spent starting KDC: real 1.335s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786375520124696-18706-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786375520124696-18706-0/krb5kdc/test-user.keytab.
Aug 10 15:25:39 dist-test-slave-2p8l krb5kdc[24197](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375539, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T15:25:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T15:25:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.68.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.68.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.68.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab.
Entry for principal kudu/127.18.68.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab.
I20260810 15:25:39.137252 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786375520124696-18706-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786375520124696-18706-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786375520124696-18706-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.190:41219
--webserver_interface=127.18.68.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab
--principal=kudu/127.18.68.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:42507
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.68.190:41219
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:25:39.218015 24218 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:25:39.218297 24218 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:25:39.218334 24218 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:25:39.219492 24218 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 15:25:39.219561 24218 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:25:39.219584 24218 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:25:39.219604 24218 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 15:25:39.219632 24218 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 15:25:39.221091 24218 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:42507
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786375520124696-18706-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786375520124696-18706-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.68.190:41219
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab
--principal=kudu/127.18.68.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.190:41219
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.68.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24218
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786375520124696-18706-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:25:39.221385 24218 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:25:39.221614 24218 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:25:39.226549 24225 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:39.226570 24224 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:39.226576 24228 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:25:39.226840 24218 server_base.cc:1034] running on GCE node
I20260810 15:25:39.227092 24218 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:25:39.227330 24218 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:25:39.228490 24218 hybrid_clock.cc:648] HybridClock initialized: now 1786375539228470 us; error 34 us; skew 500 ppm
Aug 10 15:25:39 dist-test-slave-2p8l krb5kdc[24197](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375539, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:25:39.234480 24218 init.cc:377] Logged in from keytab as kudu/127.18.68.190@KRBTEST.COM (short username kudu)
I20260810 15:25:39.234995 24218 webserver.cc:460] Webserver started at http://127.18.68.190:33053/ using document root <none> and password file <none>
I20260810 15:25:39.235232 24218 fs_manager.cc:359] Metadata directory not provided
I20260810 15:25:39.235277 24218 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:25:39.235443 24218 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:25:39.236510 24218 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786375520124696-18706-0/minicluster-data/master-0/data/instance:
uuid: "b9533338a9404ac9bbf3099e269adba4"
format_stamp: "Formatted at 2026-08-10 15:25:39 on dist-test-slave-2p8l"
server_key: "770202c04325dcd93cf22cf08c564d47"
server_key_iv: "a4dd7880f871b470a610140a81551976"
server_key_version: "encryptionkey@0"
I20260810 15:25:39.236891 24218 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786375520124696-18706-0/minicluster-data/master-0/wal/instance:
uuid: "b9533338a9404ac9bbf3099e269adba4"
format_stamp: "Formatted at 2026-08-10 15:25:39 on dist-test-slave-2p8l"
server_key: "770202c04325dcd93cf22cf08c564d47"
server_key_iv: "a4dd7880f871b470a610140a81551976"
server_key_version: "encryptionkey@0"
I20260810 15:25:39.238318 24218 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 15:25:39.239148 24240 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:39.239363 24218 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:25:39.239497 24218 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786375520124696-18706-0/minicluster-data/master-0/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786375520124696-18706-0/minicluster-data/master-0/wal
uuid: "b9533338a9404ac9bbf3099e269adba4"
format_stamp: "Formatted at 2026-08-10 15:25:39 on dist-test-slave-2p8l"
server_key: "770202c04325dcd93cf22cf08c564d47"
server_key_iv: "a4dd7880f871b470a610140a81551976"
server_key_version: "encryptionkey@0"
I20260810 15:25:39.239588 24218 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786375520124696-18706-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786375520124696-18706-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786375520124696-18706-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:25:39.265408 24218 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:25:39.267398 24218 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:25:39.267592 24218 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:25:39.272073 24218 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.190:41219
I20260810 15:25:39.272106 24333 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.190:41219 every 8 connection(s)
I20260810 15:25:39.272481 24218 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
I20260810 15:25:39.272730 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 24218
I20260810 15:25:39.272841 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786375520124696-18706-0/minicluster-data/master-0/wal/instance
I20260810 15:25:39.273041 18706 external_mini_cluster.cc:1428] Setting key 5d2828ea690ff6f316d806daa67c676d
I20260810 15:25:39.273859 24334 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:25:39.276903 24334 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b9533338a9404ac9bbf3099e269adba4: Bootstrap starting.
I20260810 15:25:39.277616 24334 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b9533338a9404ac9bbf3099e269adba4: Neither blocks nor log segments found. Creating new log.
I20260810 15:25:39.277927 24334 log.cc:824] T 00000000000000000000000000000000 P b9533338a9404ac9bbf3099e269adba4: Log is configured to *not* fsync() on all Append() calls
I20260810 15:25:39.278748 24334 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b9533338a9404ac9bbf3099e269adba4: No bootstrap required, opened a new log
Aug 10 15:25:39 dist-test-slave-2p8l krb5kdc[24197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375539, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
I20260810 15:25:39.281116 24334 raft_consensus.cc:348] T 00000000000000000000000000000000 P b9533338a9404ac9bbf3099e269adba4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b9533338a9404ac9bbf3099e269adba4" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 41219 } }
I20260810 15:25:39.281281 24334 raft_consensus.cc:374] T 00000000000000000000000000000000 P b9533338a9404ac9bbf3099e269adba4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:25:39.281335 24334 raft_consensus.cc:729] T 00000000000000000000000000000000 P b9533338a9404ac9bbf3099e269adba4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9533338a9404ac9bbf3099e269adba4, State: Initialized, Role: FOLLOWER
I20260810 15:25:39.281481 24334 consensus_queue.cc:260] T 00000000000000000000000000000000 P b9533338a9404ac9bbf3099e269adba4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b9533338a9404ac9bbf3099e269adba4" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 41219 } }
I20260810 15:25:39.281580 24334 raft_consensus.cc:388] T 00000000000000000000000000000000 P b9533338a9404ac9bbf3099e269adba4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 15:25:39.281620 24334 raft_consensus.cc:482] T 00000000000000000000000000000000 P b9533338a9404ac9bbf3099e269adba4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 15:25:39.281662 24334 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b9533338a9404ac9bbf3099e269adba4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:25:39.282438 24334 raft_consensus.cc:504] T 00000000000000000000000000000000 P b9533338a9404ac9bbf3099e269adba4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b9533338a9404ac9bbf3099e269adba4" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 41219 } }
I20260810 15:25:39.282546 24334 leader_election.cc:302] T 00000000000000000000000000000000 P b9533338a9404ac9bbf3099e269adba4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b9533338a9404ac9bbf3099e269adba4; no voters:
I20260810 15:25:39.282701 24334 leader_election.cc:288] T 00000000000000000000000000000000 P b9533338a9404ac9bbf3099e269adba4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 15:25:39.282786 24342 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b9533338a9404ac9bbf3099e269adba4 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 15:25:39.282989 24334 sys_catalog.cc:564] T 00000000000000000000000000000000 P b9533338a9404ac9bbf3099e269adba4 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 15:25:39.282989 24342 raft_consensus.cc:686] T 00000000000000000000000000000000 P b9533338a9404ac9bbf3099e269adba4 [term 1 LEADER]: Becoming Leader. State: Replica: b9533338a9404ac9bbf3099e269adba4, State: Running, Role: LEADER
I20260810 15:25:39.283507 24342 consensus_queue.cc:237] T 00000000000000000000000000000000 P b9533338a9404ac9bbf3099e269adba4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b9533338a9404ac9bbf3099e269adba4" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 41219 } }
I20260810 15:25:39.283975 24345 sys_catalog.cc:455] T 00000000000000000000000000000000 P b9533338a9404ac9bbf3099e269adba4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b9533338a9404ac9bbf3099e269adba4. Latest consensus state: current_term: 1 leader_uuid: "b9533338a9404ac9bbf3099e269adba4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b9533338a9404ac9bbf3099e269adba4" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 41219 } } }
I20260810 15:25:39.284068 24345 sys_catalog.cc:458] T 00000000000000000000000000000000 P b9533338a9404ac9bbf3099e269adba4 [sys.catalog]: This master's current role is: LEADER
I20260810 15:25:39.284268 24361 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 15:25:39.284406 24344 sys_catalog.cc:455] T 00000000000000000000000000000000 P b9533338a9404ac9bbf3099e269adba4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b9533338a9404ac9bbf3099e269adba4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b9533338a9404ac9bbf3099e269adba4" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 41219 } } }
I20260810 15:25:39.284490 24344 sys_catalog.cc:458] T 00000000000000000000000000000000 P b9533338a9404ac9bbf3099e269adba4 [sys.catalog]: This master's current role is: LEADER
I20260810 15:25:39.285028 24361 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 15:25:39.285243 24339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:39.273611 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53248 (local address 127.18.68.190:41219)
0810 15:25:39.273825 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:39.273835 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:39.273874 (+ 39us) server_negotiation.cc:407] Connection header received
0810 15:25:39.274464 (+ 590us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:39.274471 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:39.274523 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:39.274645 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:39.275490 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:39.276474 (+ 984us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:39.277533 (+ 1059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:39.278181 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:39.278308 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:39.280890 (+ 2582us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:39.280894 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:39.280894 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:39.280906 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:39.282984 (+ 2078us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:39.283422 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:39.283425 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:39.283425 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:39.283542 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:39.283816 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:39.283818 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:39.283818 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:39.284162 (+ 344us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:39.284309 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:39.284860 (+ 551us) server_negotiation.cc:299] Negotiation successful
0810 15:25:39.285017 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":163,"thread_start_us":119,"threads_started":1}
I20260810 15:25:39.287072 24361 catalog_manager.cc:1347] Generated new cluster ID: 252d3e63e5874efabde701dedcf93615
I20260810 15:25:39.287149 24361 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 15:25:39.293434 24361 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 15:25:39.294049 24361 catalog_manager.cc:1504] Loading token signing keys...
I20260810 15:25:39.297142 24361 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b9533338a9404ac9bbf3099e269adba4: Generated new TSK 0
I20260810 15:25:39.297304 24361 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.18.68.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.68.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.68.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.129.keytab.
Entry for principal kudu/127.18.68.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.129.keytab.
I20260810 15:25:39.325594 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786375520124696-18706-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786375520124696-18706-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786375520124696-18706-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786375520124696-18706-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.68.129:0
--local_ip_for_outbound_sockets=127.18.68.129
--webserver_interface=127.18.68.129
--webserver_port=0
--tserver_master_addrs=127.18.68.190:41219
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.129.keytab
--principal=kudu/127.18.68.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:42507
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:25:39.410439 24378 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:25:39.410655 24378 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:25:39.410678 24378 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:25:39.411854 24378 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:25:39.411898 24378 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:25:39.411926 24378 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.68.129
I20260810 15:25:39.413470 24378 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:42507
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786375520124696-18706-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786375520124696-18706-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.129.keytab
--principal=kudu/127.18.68.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.68.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786375520124696-18706-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.68.129
--webserver_port=0
--tserver_master_addrs=127.18.68.190:41219
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24378
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.68.129
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786375520124696-18706-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:25:39.413730 24378 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:25:39.413995 24378 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:25:39.419411 24385 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:39.419418 24388 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:39.419418 24386 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:25:39.419670 24378 server_base.cc:1034] running on GCE node
I20260810 15:25:39.419988 24378 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:25:39.420274 24378 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:25:39.421463 24378 hybrid_clock.cc:648] HybridClock initialized: now 1786375539421449 us; error 31 us; skew 500 ppm
Aug 10 15:25:39 dist-test-slave-2p8l krb5kdc[24197](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375539, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:25:39.424274 24378 init.cc:377] Logged in from keytab as kudu/127.18.68.129@KRBTEST.COM (short username kudu)
I20260810 15:25:39.424750 24378 webserver.cc:460] Webserver started at http://127.18.68.129:44337/ using document root <none> and password file <none>
I20260810 15:25:39.424978 24378 fs_manager.cc:359] Metadata directory not provided
I20260810 15:25:39.425024 24378 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:25:39.425141 24378 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:25:39.426259 24378 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786375520124696-18706-0/minicluster-data/ts-0/data/instance:
uuid: "90e8e50b1d3f402b9e36ac91c18ea0f9"
format_stamp: "Formatted at 2026-08-10 15:25:39 on dist-test-slave-2p8l"
server_key: "0f14b505babffe8528a9fc2e6b9b23a1"
server_key_iv: "9962717c2433c2fbaba1da9fcb07f2dd"
server_key_version: "encryptionkey@0"
I20260810 15:25:39.426617 24378 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786375520124696-18706-0/minicluster-data/ts-0/wal/instance:
uuid: "90e8e50b1d3f402b9e36ac91c18ea0f9"
format_stamp: "Formatted at 2026-08-10 15:25:39 on dist-test-slave-2p8l"
server_key: "0f14b505babffe8528a9fc2e6b9b23a1"
server_key_iv: "9962717c2433c2fbaba1da9fcb07f2dd"
server_key_version: "encryptionkey@0"
I20260810 15:25:39.428020 24378 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:25:39.428808 24399 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:39.429095 24378 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:25:39.429250 24378 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786375520124696-18706-0/minicluster-data/ts-0/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786375520124696-18706-0/minicluster-data/ts-0/wal
uuid: "90e8e50b1d3f402b9e36ac91c18ea0f9"
format_stamp: "Formatted at 2026-08-10 15:25:39 on dist-test-slave-2p8l"
server_key: "0f14b505babffe8528a9fc2e6b9b23a1"
server_key_iv: "9962717c2433c2fbaba1da9fcb07f2dd"
server_key_version: "encryptionkey@0"
I20260810 15:25:39.429342 24378 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786375520124696-18706-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786375520124696-18706-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786375520124696-18706-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:25:39.439579 24378 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:25:39.441753 24378 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:25:39.441926 24378 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:25:39.442240 24378 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 15:25:39.442590 24378 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 15:25:39.442672 24378 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:39.442715 24378 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 15:25:39.442744 24378 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:39.448993 24378 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.129:41437
I20260810 15:25:39.449041 24582 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.129:41437 every 8 connection(s)
I20260810 15:25:39.449374 24378 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786375520124696-18706-0/minicluster-data/ts-0/data/info.pb
I20260810 15:25:39.450918 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 24378
I20260810 15:25:39.451035 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786375520124696-18706-0/minicluster-data/ts-0/wal/instance
I20260810 15:25:39.451246 18706 external_mini_cluster.cc:1428] Setting key 253e9f2f9095d4af0283d60441b1098b
Aug 10 15:25:39 dist-test-slave-2p8l krb5kdc[24197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375539, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.129@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.18.68.130@KRBTEST.COM; defaulting to no policy
I20260810 15:25:39.459867 24339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:39.450176 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.129:56723 (local address 127.18.68.190:41219)
0810 15:25:39.450242 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:39.450244 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:39.450526 (+ 282us) server_negotiation.cc:407] Connection header received
0810 15:25:39.451138 (+ 612us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:39.451139 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:39.451150 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:39.451217 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:39.452530 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:39.453035 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:39.454399 (+ 1364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:39.454635 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:39.454725 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:39.456940 (+ 2215us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:39.456941 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:39.456942 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:39.456950 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:39.458443 (+ 1493us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:39.458885 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:39.458886 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:39.458887 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:39.458949 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:39.459218 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:39.459218 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:39.459219 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:39.459334 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:39.459408 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:39.459686 (+ 278us) server_negotiation.cc:299] Negotiation successful
0810 15:25:39.459777 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260810 15:25:39.460058 24586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:39.450143 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:41219 (local address 127.18.68.129:56723)
0810 15:25:39.450317 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:39.450359 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:39.450964 (+ 605us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:39.451305 (+ 341us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:39.451309 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:39.452160 (+ 851us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:25:39.452437 (+ 277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:39.452443 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:39.453140 (+ 697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:39.453141 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:39.454286 (+ 1145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:39.454289 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:39.454738 (+ 449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:39.454739 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:39.454864 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:39.455450 (+ 586us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:25:39.455458 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:25:39.456840 (+ 1382us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:25:39.458545 (+ 1705us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:39.458552 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:39.458555 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:39.458790 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:39.459021 (+ 231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:39.459022 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:39.459022 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:39.459134 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:39.459411 (+ 277us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:25:39.459419 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:25:39.459555 (+ 136us) client_negotiation.cc:769] Sending connection context
0810 15:25:39.459663 (+ 108us) client_negotiation.cc:240] Negotiation successful
0810 15:25:39.459818 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":101,"threads_started":1}
I20260810 15:25:39.460613 24584 heartbeater.cc:347] Connected to a master server at 127.18.68.190:41219
I20260810 15:25:39.460729 24584 heartbeater.cc:464] Registering TS with master...
I20260810 15:25:39.460914 24584 heartbeater.cc:511] Master 127.18.68.190:41219 requested a full tablet report, sending...
I20260810 15:25:39.461488 24273 ts_manager.cc:194] Registered new tserver with Master: 90e8e50b1d3f402b9e36ac91c18ea0f9 (127.18.68.129:41437)
I20260810 15:25:39.462200 24273 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.68.129@KRBTEST.COM'} at 127.18.68.129:56723
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.68.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.68.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.130.keytab.
Entry for principal kudu/127.18.68.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.130.keytab.
I20260810 15:25:39.476627 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786375520124696-18706-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786375520124696-18706-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786375520124696-18706-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786375520124696-18706-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.68.130:0
--local_ip_for_outbound_sockets=127.18.68.130
--webserver_interface=127.18.68.130
--webserver_port=0
--tserver_master_addrs=127.18.68.190:41219
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.130.keytab
--principal=kudu/127.18.68.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:42507
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:25:39.560333 24590 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:25:39.560544 24590 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:25:39.560567 24590 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:25:39.561645 24590 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:25:39.561681 24590 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:25:39.561707 24590 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.68.130
I20260810 15:25:39.563207 24590 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:42507
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786375520124696-18706-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786375520124696-18706-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.130.keytab
--principal=kudu/127.18.68.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.68.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786375520124696-18706-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.68.130
--webserver_port=0
--tserver_master_addrs=127.18.68.190:41219
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24590
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.68.130
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786375520124696-18706-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:25:39.563413 24590 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:25:39.563586 24590 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:25:39.568605 24602 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:39.568576 24599 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:39.568584 24597 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:25:39.568837 24590 server_base.cc:1034] running on GCE node
I20260810 15:25:39.569133 24590 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:25:39.569379 24590 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:25:39.570551 24590 hybrid_clock.cc:648] HybridClock initialized: now 1786375539570526 us; error 61 us; skew 500 ppm
Aug 10 15:25:39 dist-test-slave-2p8l krb5kdc[24197](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375539, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:25:39.573118 24590 init.cc:377] Logged in from keytab as kudu/127.18.68.130@KRBTEST.COM (short username kudu)
I20260810 15:25:39.573490 24590 webserver.cc:460] Webserver started at http://127.18.68.130:37273/ using document root <none> and password file <none>
I20260810 15:25:39.573681 24590 fs_manager.cc:359] Metadata directory not provided
I20260810 15:25:39.573722 24590 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:25:39.573810 24590 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:25:39.574877 24590 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786375520124696-18706-0/minicluster-data/ts-1/data/instance:
uuid: "f01d52fe88944c68a6d9757fc583ef6c"
format_stamp: "Formatted at 2026-08-10 15:25:39 on dist-test-slave-2p8l"
server_key: "aba6e0c5c5c2252d82837f5623900ea3"
server_key_iv: "2a4bb97cdbcc21185c7fcd4179f2bfe8"
server_key_version: "encryptionkey@0"
I20260810 15:25:39.575181 24590 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786375520124696-18706-0/minicluster-data/ts-1/wal/instance:
uuid: "f01d52fe88944c68a6d9757fc583ef6c"
format_stamp: "Formatted at 2026-08-10 15:25:39 on dist-test-slave-2p8l"
server_key: "aba6e0c5c5c2252d82837f5623900ea3"
server_key_iv: "2a4bb97cdbcc21185c7fcd4179f2bfe8"
server_key_version: "encryptionkey@0"
I20260810 15:25:39.576421 24590 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260810 15:25:39.577193 24609 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:39.577376 24590 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 15:25:39.577486 24590 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786375520124696-18706-0/minicluster-data/ts-1/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786375520124696-18706-0/minicluster-data/ts-1/wal
uuid: "f01d52fe88944c68a6d9757fc583ef6c"
format_stamp: "Formatted at 2026-08-10 15:25:39 on dist-test-slave-2p8l"
server_key: "aba6e0c5c5c2252d82837f5623900ea3"
server_key_iv: "2a4bb97cdbcc21185c7fcd4179f2bfe8"
server_key_version: "encryptionkey@0"
I20260810 15:25:39.577587 24590 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786375520124696-18706-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786375520124696-18706-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786375520124696-18706-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:25:39.588447 24590 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:25:39.590448 24590 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:25:39.590613 24590 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:25:39.590848 24590 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 15:25:39.591171 24590 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 15:25:39.591235 24590 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:39.591276 24590 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 15:25:39.591305 24590 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:39.597206 24590 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.130:41223
I20260810 15:25:39.597288 24831 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.130:41223 every 8 connection(s)
I20260810 15:25:39.597615 24590 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786375520124696-18706-0/minicluster-data/ts-1/data/info.pb
I20260810 15:25:39.601913 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 24590
I20260810 15:25:39.602023 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786375520124696-18706-0/minicluster-data/ts-1/wal/instance
I20260810 15:25:39.602253 18706 external_mini_cluster.cc:1428] Setting key 818ccaefefe80f07a8a9557c09ba2489
Aug 10 15:25:39 dist-test-slave-2p8l krb5kdc[24197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375539, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.130@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
I20260810 15:25:39.607805 24339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:39.598494 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.130:57765 (local address 127.18.68.190:41219)
0810 15:25:39.598582 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:39.598584 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:39.598740 (+ 156us) server_negotiation.cc:407] Connection header received
0810 15:25:39.599247 (+ 507us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:39.599248 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:39.599260 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:39.599318 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:39.600277 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:39.600765 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:39.601862 (+ 1097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:39.602197 (+ 335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:39.602275 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:39.604595 (+ 2320us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:39.604596 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:39.604597 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:39.604606 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:39.606252 (+ 1646us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:39.606760 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:39.606761 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:39.606761 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:39.606819 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:39.607134 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:39.607135 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:39.607135 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:39.607253 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:39.607315 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:39.607670 (+ 355us) server_negotiation.cc:299] Negotiation successful
0810 15:25:39.607740 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260810 15:25:39.608179 24834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:39.598440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:41219 (local address 127.18.68.130:57765)
0810 15:25:39.598606 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:39.598653 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:39.599147 (+ 494us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:39.599398 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:39.599401 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:39.599972 (+ 571us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:25:39.600185 (+ 213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:39.600190 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:39.600846 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:39.600846 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:39.601656 (+ 810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:39.601658 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:39.602308 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:39.602309 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:39.602481 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:39.603091 (+ 610us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:25:39.603101 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:25:39.604489 (+ 1388us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:25:39.606335 (+ 1846us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:39.606343 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:39.606345 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:39.606679 (+ 334us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:39.606893 (+ 214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:39.606894 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:39.606894 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:39.607044 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:39.607331 (+ 287us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:25:39.607338 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:25:39.607516 (+ 178us) client_negotiation.cc:769] Sending connection context
0810 15:25:39.607646 (+ 130us) client_negotiation.cc:240] Negotiation successful
0810 15:25:39.607840 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":101,"threads_started":1}
I20260810 15:25:39.608822 24832 heartbeater.cc:347] Connected to a master server at 127.18.68.190:41219
I20260810 15:25:39.608937 24832 heartbeater.cc:464] Registering TS with master...
I20260810 15:25:39.609171 24832 heartbeater.cc:511] Master 127.18.68.190:41219 requested a full tablet report, sending...
I20260810 15:25:39.609612 24273 ts_manager.cc:194] Registered new tserver with Master: f01d52fe88944c68a6d9757fc583ef6c (127.18.68.130:41223)
I20260810 15:25:39.609994 24273 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.68.130@KRBTEST.COM'} at 127.18.68.130:57765
WARNING: no policy specified for kudu/127.18.68.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.68.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.68.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.131.keytab.
Entry for principal kudu/127.18.68.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.131.keytab.
I20260810 15:25:39.629285 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786375520124696-18706-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786375520124696-18706-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786375520124696-18706-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786375520124696-18706-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.68.131:0
--local_ip_for_outbound_sockets=127.18.68.131
--webserver_interface=127.18.68.131
--webserver_port=0
--tserver_master_addrs=127.18.68.190:41219
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.131.keytab
--principal=kudu/127.18.68.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:42507
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:25:39.712946 24837 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:25:39.713174 24837 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:25:39.713220 24837 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:25:39.714475 24837 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:25:39.714540 24837 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:25:39.714583 24837 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.68.131
I20260810 15:25:39.716063 24837 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:42507
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786375520124696-18706-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786375520124696-18706-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.131.keytab
--principal=kudu/127.18.68.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.68.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786375520124696-18706-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.68.131
--webserver_port=0
--tserver_master_addrs=127.18.68.190:41219
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24837
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.68.131
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786375520124696-18706-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:25:39.716338 24837 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:25:39.716575 24837 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:25:39.721535 24850 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:39.721578 24853 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:39.721556 24856 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:25:39.721868 24837 server_base.cc:1034] running on GCE node
I20260810 15:25:39.722090 24837 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:25:39.722354 24837 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:25:39.723493 24837 hybrid_clock.cc:648] HybridClock initialized: now 1786375539723473 us; error 38 us; skew 500 ppm
Aug 10 15:25:39 dist-test-slave-2p8l krb5kdc[24197](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375539, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:25:39.726159 24837 init.cc:377] Logged in from keytab as kudu/127.18.68.131@KRBTEST.COM (short username kudu)
I20260810 15:25:39.726576 24837 webserver.cc:460] Webserver started at http://127.18.68.131:40319/ using document root <none> and password file <none>
I20260810 15:25:39.726848 24837 fs_manager.cc:359] Metadata directory not provided
I20260810 15:25:39.726922 24837 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:25:39.727072 24837 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:25:39.728070 24837 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786375520124696-18706-0/minicluster-data/ts-2/data/instance:
uuid: "9bf23c14d62f438495b170689ce9d185"
format_stamp: "Formatted at 2026-08-10 15:25:39 on dist-test-slave-2p8l"
server_key: "eac34fb4a8aa05f0cde15693d29611f4"
server_key_iv: "1cfa73e72038e40cd13c6ed8219bbb49"
server_key_version: "encryptionkey@0"
I20260810 15:25:39.728420 24837 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786375520124696-18706-0/minicluster-data/ts-2/wal/instance:
uuid: "9bf23c14d62f438495b170689ce9d185"
format_stamp: "Formatted at 2026-08-10 15:25:39 on dist-test-slave-2p8l"
server_key: "eac34fb4a8aa05f0cde15693d29611f4"
server_key_iv: "1cfa73e72038e40cd13c6ed8219bbb49"
server_key_version: "encryptionkey@0"
I20260810 15:25:39.729746 24837 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 15:25:39.730566 24868 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:39.730734 24837 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:39.730842 24837 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786375520124696-18706-0/minicluster-data/ts-2/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786375520124696-18706-0/minicluster-data/ts-2/wal
uuid: "9bf23c14d62f438495b170689ce9d185"
format_stamp: "Formatted at 2026-08-10 15:25:39 on dist-test-slave-2p8l"
server_key: "eac34fb4a8aa05f0cde15693d29611f4"
server_key_iv: "1cfa73e72038e40cd13c6ed8219bbb49"
server_key_version: "encryptionkey@0"
I20260810 15:25:39.730916 24837 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786375520124696-18706-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786375520124696-18706-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786375520124696-18706-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:25:39.762676 24837 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:25:39.764770 24837 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:25:39.764943 24837 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:25:39.765260 24837 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 15:25:39.765547 24837 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 15:25:39.765579 24837 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:39.765601 24837 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 15:25:39.765614 24837 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:39.774740 24837 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.131:35271
I20260810 15:25:39.774798 25061 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.131:35271 every 8 connection(s)
I20260810 15:25:39.775187 24837 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786375520124696-18706-0/minicluster-data/ts-2/data/info.pb
Aug 10 15:25:39 dist-test-slave-2p8l krb5kdc[24197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375539, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.131@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
I20260810 15:25:39.784771 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 24837
I20260810 15:25:39.784898 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786375520124696-18706-0/minicluster-data/ts-2/wal/instance
I20260810 15:25:39.785116 18706 external_mini_cluster.cc:1428] Setting key c0e9659e82802fdae7cb7cb9f8bc3bde
I20260810 15:25:39.786374 24339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:39.775979 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.131:57165 (local address 127.18.68.190:41219)
0810 15:25:39.776029 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:39.776031 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:39.776264 (+ 233us) server_negotiation.cc:407] Connection header received
0810 15:25:39.776828 (+ 564us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:39.776830 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:39.776844 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:39.776895 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:39.777876 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:39.778483 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:39.779531 (+ 1048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:39.779731 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:39.779792 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:39.782313 (+ 2521us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:39.782314 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:39.782314 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:39.782321 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:39.784027 (+ 1706us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:39.785277 (+ 1250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:39.785278 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:39.785278 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:39.785351 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:39.785677 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:39.785678 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:39.785678 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:39.785824 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:39.785898 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:39.786243 (+ 345us) server_negotiation.cc:299] Negotiation successful
0810 15:25:39.786311 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260810 15:25:39.786588 25065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:39.775951 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:41219 (local address 127.18.68.131:57165)
0810 15:25:39.776131 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:39.776169 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:39.776707 (+ 538us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:39.776970 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:39.776974 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:39.777562 (+ 588us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:25:39.777771 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:39.777776 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:39.778597 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:39.778598 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:39.779436 (+ 838us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:39.779439 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:39.779816 (+ 377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:39.779817 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:39.779930 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:39.780502 (+ 572us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:25:39.780510 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:25:39.782223 (+ 1713us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:25:39.784146 (+ 1923us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:39.784155 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:39.784157 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:39.784517 (+ 360us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:39.785442 (+ 925us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:39.785443 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:39.785444 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:39.785601 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:39.785900 (+ 299us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:25:39.785907 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:25:39.786085 (+ 178us) client_negotiation.cc:769] Sending connection context
0810 15:25:39.786206 (+ 121us) client_negotiation.cc:240] Negotiation successful
0810 15:25:39.786338 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":85,"threads_started":1}
I20260810 15:25:39.787075 25062 heartbeater.cc:347] Connected to a master server at 127.18.68.190:41219
I20260810 15:25:39.787164 25062 heartbeater.cc:464] Registering TS with master...
I20260810 15:25:39.787367 25062 heartbeater.cc:511] Master 127.18.68.190:41219 requested a full tablet report, sending...
I20260810 15:25:39.787750 24273 ts_manager.cc:194] Registered new tserver with Master: 9bf23c14d62f438495b170689ce9d185 (127.18.68.131:35271)
I20260810 15:25:39.788120 24273 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.68.131@KRBTEST.COM'} at 127.18.68.131:57165
I20260810 15:25:39.796989 18706 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 10 15:25:39 dist-test-slave-2p8l krb5kdc[24197](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375539, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 10 15:25:39 dist-test-slave-2p8l krb5kdc[24197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375539, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
I20260810 15:25:39.821939 24339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:39.814438 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53258 (local address 127.18.68.190:41219)
0810 15:25:39.814529 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:39.814531 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:39.814641 (+ 110us) server_negotiation.cc:407] Connection header received
0810 15:25:39.814731 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:39.814732 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:39.814742 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:39.814812 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:39.815426 (+ 614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:39.816017 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:39.816810 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:39.817005 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:39.817092 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:39.819478 (+ 2386us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:39.819479 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:39.819479 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:39.819488 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:39.820752 (+ 1264us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:39.821106 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:39.821107 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:39.821108 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:39.821170 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:39.821371 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:39.821372 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:39.821372 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:39.821533 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:39.821651 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:39.821754 (+ 103us) server_negotiation.cc:299] Negotiation successful
0810 15:25:39.821834 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
W20260810 15:25:39.822230 24273 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:53258
I20260810 15:25:39.822737 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 24378
I20260810 15:25:39.860957 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 24590
I20260810 15:25:39.879686 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 24837
I20260810 15:25:39.892812 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 24218
2026-08-10T15:25:39Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (2244 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786375520124696-18706-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 15:25:39 dist-test-slave-2p8l krb5kdc[25080](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 15:25:39 dist-test-slave-2p8l krb5kdc[25080](info): set up 2 sockets
Aug 10 15:25:39 dist-test-slave-2p8l krb5kdc[25080](info): commencing operation
krb5kdc: starting...
W20260810 15:25:41.198689 18706 mini_kdc.cc:121] Time spent starting KDC: real 1.282s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786375520124696-18706-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786375520124696-18706-0/krb5kdc/test-user.keytab.
Aug 10 15:25:41 dist-test-slave-2p8l krb5kdc[25080](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375541, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T15:25:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T15:25:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.68.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.68.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.68.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab.
Entry for principal kudu/127.18.68.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab.
I20260810 15:25:41.326988 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786375520124696-18706-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786375520124696-18706-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786375520124696-18706-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.190:39883
--webserver_interface=127.18.68.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab
--principal=kudu/127.18.68.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:39165
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.68.190:39883
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:25:41.408917 25105 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:25:41.409125 25105 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:25:41.409154 25105 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:25:41.410368 25105 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 15:25:41.410410 25105 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:25:41.410425 25105 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:25:41.410439 25105 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 15:25:41.410481 25105 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 15:25:41.411967 25105 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:39165
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786375520124696-18706-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786375520124696-18706-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.68.190:39883
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab
--principal=kudu/127.18.68.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.190:39883
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.68.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25105
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786375520124696-18706-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:25:41.412230 25105 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:25:41.412458 25105 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:25:41.417557 25126 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:25:41.417702 25105 server_base.cc:1034] running on GCE node
W20260810 15:25:41.417798 25122 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:41.417567 25121 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:25:41.418135 25105 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:25:41.418460 25105 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:25:41.419638 25105 hybrid_clock.cc:648] HybridClock initialized: now 1786375541419614 us; error 35 us; skew 500 ppm
Aug 10 15:25:41 dist-test-slave-2p8l krb5kdc[25080](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375541, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:25:41.422225 25105 init.cc:377] Logged in from keytab as kudu/127.18.68.190@KRBTEST.COM (short username kudu)
I20260810 15:25:41.422685 25105 webserver.cc:460] Webserver started at http://127.18.68.190:44215/ using document root <none> and password file <none>
I20260810 15:25:41.422941 25105 fs_manager.cc:359] Metadata directory not provided
I20260810 15:25:41.423013 25105 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:25:41.423169 25105 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:25:41.424227 25105 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786375520124696-18706-0/minicluster-data/master-0/data/instance:
uuid: "2ecbeaa6d885432cb69323eca6e77249"
format_stamp: "Formatted at 2026-08-10 15:25:41 on dist-test-slave-2p8l"
server_key: "5ec6333be8359ade483308e7b2dcba5d"
server_key_iv: "3a1a8385fa6ca63ece4631d1356cd9bf"
server_key_version: "encryptionkey@0"
I20260810 15:25:41.424613 25105 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786375520124696-18706-0/minicluster-data/master-0/wal/instance:
uuid: "2ecbeaa6d885432cb69323eca6e77249"
format_stamp: "Formatted at 2026-08-10 15:25:41 on dist-test-slave-2p8l"
server_key: "5ec6333be8359ade483308e7b2dcba5d"
server_key_iv: "3a1a8385fa6ca63ece4631d1356cd9bf"
server_key_version: "encryptionkey@0"
I20260810 15:25:41.425940 25105 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 15:25:41.426745 25141 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:41.426918 25105 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 15:25:41.427027 25105 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786375520124696-18706-0/minicluster-data/master-0/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786375520124696-18706-0/minicluster-data/master-0/wal
uuid: "2ecbeaa6d885432cb69323eca6e77249"
format_stamp: "Formatted at 2026-08-10 15:25:41 on dist-test-slave-2p8l"
server_key: "5ec6333be8359ade483308e7b2dcba5d"
server_key_iv: "3a1a8385fa6ca63ece4631d1356cd9bf"
server_key_version: "encryptionkey@0"
I20260810 15:25:41.427119 25105 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786375520124696-18706-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786375520124696-18706-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786375520124696-18706-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:25:41.448626 25105 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:25:41.450650 25105 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:25:41.450820 25105 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:25:41.454995 25105 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.190:39883
I20260810 15:25:41.455281 25227 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.190:39883 every 8 connection(s)
I20260810 15:25:41.455408 25105 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
I20260810 15:25:41.456079 25228 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:25:41.458400 25228 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2ecbeaa6d885432cb69323eca6e77249: Bootstrap starting.
I20260810 15:25:41.459010 25228 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2ecbeaa6d885432cb69323eca6e77249: Neither blocks nor log segments found. Creating new log.
I20260810 15:25:41.459319 25228 log.cc:824] T 00000000000000000000000000000000 P 2ecbeaa6d885432cb69323eca6e77249: Log is configured to *not* fsync() on all Append() calls
I20260810 15:25:41.460038 25228 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2ecbeaa6d885432cb69323eca6e77249: No bootstrap required, opened a new log
I20260810 15:25:41.461601 25228 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2ecbeaa6d885432cb69323eca6e77249 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ecbeaa6d885432cb69323eca6e77249" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 39883 } }
I20260810 15:25:41.461743 25228 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2ecbeaa6d885432cb69323eca6e77249 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:25:41.461767 25228 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2ecbeaa6d885432cb69323eca6e77249 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ecbeaa6d885432cb69323eca6e77249, State: Initialized, Role: FOLLOWER
I20260810 15:25:41.461943 25228 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2ecbeaa6d885432cb69323eca6e77249 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ecbeaa6d885432cb69323eca6e77249" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 39883 } }
I20260810 15:25:41.462008 25228 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2ecbeaa6d885432cb69323eca6e77249 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 15:25:41.462081 25228 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2ecbeaa6d885432cb69323eca6e77249 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 15:25:41.462133 25228 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2ecbeaa6d885432cb69323eca6e77249 [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:25:41.462212 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 25105
I20260810 15:25:41.462311 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786375520124696-18706-0/minicluster-data/master-0/wal/instance
I20260810 15:25:41.462477 18706 external_mini_cluster.cc:1428] Setting key 74ec1911c21fb0f4621922cd98f69077
I20260810 15:25:41.463279 25228 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2ecbeaa6d885432cb69323eca6e77249 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ecbeaa6d885432cb69323eca6e77249" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 39883 } }
I20260810 15:25:41.463403 25228 leader_election.cc:302] T 00000000000000000000000000000000 P 2ecbeaa6d885432cb69323eca6e77249 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2ecbeaa6d885432cb69323eca6e77249; no voters:
I20260810 15:25:41.463567 25228 leader_election.cc:288] T 00000000000000000000000000000000 P 2ecbeaa6d885432cb69323eca6e77249 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 15:25:41.463644 25244 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2ecbeaa6d885432cb69323eca6e77249 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 15:25:41.463835 25228 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2ecbeaa6d885432cb69323eca6e77249 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 15:25:41.463845 25244 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2ecbeaa6d885432cb69323eca6e77249 [term 1 LEADER]: Becoming Leader. State: Replica: 2ecbeaa6d885432cb69323eca6e77249, State: Running, Role: LEADER
I20260810 15:25:41.464030 25244 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2ecbeaa6d885432cb69323eca6e77249 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ecbeaa6d885432cb69323eca6e77249" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 39883 } }
I20260810 15:25:41.464389 25246 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2ecbeaa6d885432cb69323eca6e77249 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2ecbeaa6d885432cb69323eca6e77249" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ecbeaa6d885432cb69323eca6e77249" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 39883 } } }
I20260810 15:25:41.464484 25246 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2ecbeaa6d885432cb69323eca6e77249 [sys.catalog]: This master's current role is: LEADER
I20260810 15:25:41.464656 25247 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2ecbeaa6d885432cb69323eca6e77249 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2ecbeaa6d885432cb69323eca6e77249. Latest consensus state: current_term: 1 leader_uuid: "2ecbeaa6d885432cb69323eca6e77249" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ecbeaa6d885432cb69323eca6e77249" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 39883 } } }
I20260810 15:25:41.464743 25247 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2ecbeaa6d885432cb69323eca6e77249 [sys.catalog]: This master's current role is: LEADER
I20260810 15:25:41.465075 25254 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 15:25:41.465528 25254 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 15:25:41.467231 25254 catalog_manager.cc:1347] Generated new cluster ID: f41b9a9928544b72bbb8323a33edc780
I20260810 15:25:41.467525 25254 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 10 15:25:41 dist-test-slave-2p8l krb5kdc[25080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375541, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
I20260810 15:25:41.474421 25242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:41.462983 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59784 (local address 127.18.68.190:39883)
0810 15:25:41.463185 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:41.463193 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:41.463221 (+ 28us) server_negotiation.cc:407] Connection header received
0810 15:25:41.463310 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:41.463315 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:41.463355 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:41.463510 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:41.464308 (+ 798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:41.465740 (+ 1432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:41.466710 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:41.467247 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:41.467360 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:41.470178 (+ 2818us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:41.470182 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:41.470183 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:41.470196 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:41.472730 (+ 2534us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:41.473154 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:41.473157 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:41.473158 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:41.473264 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:41.473496 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:41.473496 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:41.473497 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:41.473776 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:41.473926 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:41.474045 (+ 119us) server_negotiation.cc:299] Negotiation successful
0810 15:25:41.474193 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":105,"threads_started":1}
I20260810 15:25:41.483244 25254 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 15:25:41.483803 25254 catalog_manager.cc:1504] Loading token signing keys...
I20260810 15:25:41.490813 25254 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2ecbeaa6d885432cb69323eca6e77249: Generated new TSK 0
I20260810 15:25:41.491019 25254 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.18.68.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.68.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.68.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.129.keytab.
Entry for principal kudu/127.18.68.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.129.keytab.
I20260810 15:25:41.520738 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786375520124696-18706-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786375520124696-18706-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786375520124696-18706-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786375520124696-18706-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.68.129:0
--local_ip_for_outbound_sockets=127.18.68.129
--webserver_interface=127.18.68.129
--webserver_port=0
--tserver_master_addrs=127.18.68.190:39883
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.129.keytab
--principal=kudu/127.18.68.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:39165
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:25:41.605724 25275 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:25:41.605950 25275 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:25:41.605975 25275 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:25:41.607276 25275 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:25:41.607327 25275 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:25:41.607354 25275 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.68.129
I20260810 15:25:41.608928 25275 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:39165
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786375520124696-18706-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786375520124696-18706-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.129.keytab
--principal=kudu/127.18.68.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.68.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786375520124696-18706-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.68.129
--webserver_port=0
--tserver_master_addrs=127.18.68.190:39883
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25275
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.68.129
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786375520124696-18706-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:25:41.609208 25275 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:25:41.609472 25275 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 15:25:41.615002 25275 server_base.cc:1034] running on GCE node
W20260810 15:25:41.615017 25285 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:41.615003 25289 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:41.615002 25283 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:25:41.615458 25275 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:25:41.615700 25275 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:25:41.616878 25275 hybrid_clock.cc:648] HybridClock initialized: now 1786375541616873 us; error 39 us; skew 500 ppm
Aug 10 15:25:41 dist-test-slave-2p8l krb5kdc[25080](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375541, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:25:41.619730 25275 init.cc:377] Logged in from keytab as kudu/127.18.68.129@KRBTEST.COM (short username kudu)
I20260810 15:25:41.620152 25275 webserver.cc:460] Webserver started at http://127.18.68.129:46135/ using document root <none> and password file <none>
I20260810 15:25:41.620364 25275 fs_manager.cc:359] Metadata directory not provided
I20260810 15:25:41.620405 25275 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:25:41.620497 25275 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:25:41.621501 25275 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786375520124696-18706-0/minicluster-data/ts-0/data/instance:
uuid: "8e073388606a49498291f7aa9f501bd5"
format_stamp: "Formatted at 2026-08-10 15:25:41 on dist-test-slave-2p8l"
server_key: "b953052896c68de492109d2b06d98e01"
server_key_iv: "f03d008161d30883c8dd92667552a7d0"
server_key_version: "encryptionkey@0"
I20260810 15:25:41.621811 25275 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786375520124696-18706-0/minicluster-data/ts-0/wal/instance:
uuid: "8e073388606a49498291f7aa9f501bd5"
format_stamp: "Formatted at 2026-08-10 15:25:41 on dist-test-slave-2p8l"
server_key: "b953052896c68de492109d2b06d98e01"
server_key_iv: "f03d008161d30883c8dd92667552a7d0"
server_key_version: "encryptionkey@0"
I20260810 15:25:41.623245 25275 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 15:25:41.624061 25300 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:41.624258 25275 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260810 15:25:41.624351 25275 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786375520124696-18706-0/minicluster-data/ts-0/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786375520124696-18706-0/minicluster-data/ts-0/wal
uuid: "8e073388606a49498291f7aa9f501bd5"
format_stamp: "Formatted at 2026-08-10 15:25:41 on dist-test-slave-2p8l"
server_key: "b953052896c68de492109d2b06d98e01"
server_key_iv: "f03d008161d30883c8dd92667552a7d0"
server_key_version: "encryptionkey@0"
I20260810 15:25:41.624406 25275 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786375520124696-18706-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786375520124696-18706-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786375520124696-18706-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:25:41.639806 25275 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:25:41.641736 25275 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:25:41.641849 25275 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:25:41.642030 25275 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 15:25:41.642366 25275 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 15:25:41.642401 25275 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:41.642423 25275 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 15:25:41.642436 25275 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:41.648473 25275 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.129:43279
I20260810 15:25:41.648581 25494 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.129:43279 every 8 connection(s)
I20260810 15:25:41.648887 25275 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786375520124696-18706-0/minicluster-data/ts-0/data/info.pb
Aug 10 15:25:41 dist-test-slave-2p8l krb5kdc[25080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375541, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.129@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
I20260810 15:25:41.656802 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 25275
I20260810 15:25:41.656895 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786375520124696-18706-0/minicluster-data/ts-0/wal/instance
I20260810 15:25:41.657150 18706 external_mini_cluster.cc:1428] Setting key 93792f02bceca7ceb83ab7012cf3a42b
I20260810 15:25:41.659051 25242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:41.649715 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.129:46733 (local address 127.18.68.190:39883)
0810 15:25:41.649799 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:41.649801 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:41.649916 (+ 115us) server_negotiation.cc:407] Connection header received
0810 15:25:41.650984 (+ 1068us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:41.650985 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:41.651000 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:41.651051 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:41.651695 (+ 644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:41.652194 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:41.653269 (+ 1075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:41.653497 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:41.653569 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:41.656055 (+ 2486us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:41.656056 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:41.656057 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:41.656063 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:41.657564 (+ 1501us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:41.658009 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:41.658010 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:41.658011 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:41.658134 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:41.658391 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:41.658393 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:41.658393 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:41.658510 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:41.658585 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:41.658872 (+ 287us) server_negotiation.cc:299] Negotiation successful
0810 15:25:41.658961 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260810 15:25:41.659237 25497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:41.649622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:39883 (local address 127.18.68.129:46733)
0810 15:25:41.649787 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:41.649825 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:41.650881 (+ 1056us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:41.651118 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:41.651121 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:41.651394 (+ 273us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:25:41.651616 (+ 222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:41.651621 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:41.652275 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:41.652276 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:41.653184 (+ 908us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:41.653187 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:41.653628 (+ 441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:41.653629 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:41.653796 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:41.654456 (+ 660us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:25:41.654465 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:25:41.655965 (+ 1500us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:25:41.657681 (+ 1716us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:41.657688 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:41.657691 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:41.657929 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:41.658204 (+ 275us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:41.658205 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:41.658205 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:41.658318 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:41.658588 (+ 270us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:25:41.658595 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:25:41.658736 (+ 141us) client_negotiation.cc:769] Sending connection context
0810 15:25:41.658849 (+ 113us) client_negotiation.cc:240] Negotiation successful
0810 15:25:41.659013 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":70,"threads_started":1}
I20260810 15:25:41.659870 25495 heartbeater.cc:347] Connected to a master server at 127.18.68.190:39883
I20260810 15:25:41.659978 25495 heartbeater.cc:464] Registering TS with master...
I20260810 15:25:41.660197 25495 heartbeater.cc:511] Master 127.18.68.190:39883 requested a full tablet report, sending...
I20260810 15:25:41.660732 25164 ts_manager.cc:194] Registered new tserver with Master: 8e073388606a49498291f7aa9f501bd5 (127.18.68.129:43279)
I20260810 15:25:41.661859 25164 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.68.129@KRBTEST.COM'} at 127.18.68.129:46733
WARNING: no policy specified for kudu/127.18.68.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.68.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.68.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.130.keytab.
Entry for principal kudu/127.18.68.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.130.keytab.
I20260810 15:25:41.685444 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786375520124696-18706-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786375520124696-18706-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786375520124696-18706-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786375520124696-18706-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.68.130:0
--local_ip_for_outbound_sockets=127.18.68.130
--webserver_interface=127.18.68.130
--webserver_port=0
--tserver_master_addrs=127.18.68.190:39883
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.130.keytab
--principal=kudu/127.18.68.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:39165
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:25:41.768302 25502 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:25:41.768621 25502 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:25:41.768671 25502 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:25:41.769840 25502 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:25:41.769907 25502 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:25:41.769951 25502 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.68.130
I20260810 15:25:41.771500 25502 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:39165
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786375520124696-18706-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786375520124696-18706-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.130.keytab
--principal=kudu/127.18.68.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.68.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786375520124696-18706-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.68.130
--webserver_port=0
--tserver_master_addrs=127.18.68.190:39883
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25502
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.68.130
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786375520124696-18706-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:25:41.771775 25502 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:25:41.772007 25502 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:25:41.777443 25517 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:41.777514 25514 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:41.777443 25511 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:25:41.777870 25502 server_base.cc:1034] running on GCE node
I20260810 15:25:41.778124 25502 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:25:41.778343 25502 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:25:41.779517 25502 hybrid_clock.cc:648] HybridClock initialized: now 1786375541779509 us; error 39 us; skew 500 ppm
Aug 10 15:25:41 dist-test-slave-2p8l krb5kdc[25080](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375541, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:25:41.782910 25502 init.cc:377] Logged in from keytab as kudu/127.18.68.130@KRBTEST.COM (short username kudu)
I20260810 15:25:41.783432 25502 webserver.cc:460] Webserver started at http://127.18.68.130:37749/ using document root <none> and password file <none>
I20260810 15:25:41.783706 25502 fs_manager.cc:359] Metadata directory not provided
I20260810 15:25:41.783777 25502 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:25:41.783917 25502 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:25:41.784997 25502 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786375520124696-18706-0/minicluster-data/ts-1/data/instance:
uuid: "18cb5984f0284627a67cb84046366766"
format_stamp: "Formatted at 2026-08-10 15:25:41 on dist-test-slave-2p8l"
server_key: "52d232b80589161b97a86f00594d9f6a"
server_key_iv: "8c96c25f9c79067323364443050fb336"
server_key_version: "encryptionkey@0"
I20260810 15:25:41.785382 25502 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786375520124696-18706-0/minicluster-data/ts-1/wal/instance:
uuid: "18cb5984f0284627a67cb84046366766"
format_stamp: "Formatted at 2026-08-10 15:25:41 on dist-test-slave-2p8l"
server_key: "52d232b80589161b97a86f00594d9f6a"
server_key_iv: "8c96c25f9c79067323364443050fb336"
server_key_version: "encryptionkey@0"
I20260810 15:25:41.786836 25502 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 15:25:41.787649 25530 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:41.787822 25502 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 15:25:41.787917 25502 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786375520124696-18706-0/minicluster-data/ts-1/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786375520124696-18706-0/minicluster-data/ts-1/wal
uuid: "18cb5984f0284627a67cb84046366766"
format_stamp: "Formatted at 2026-08-10 15:25:41 on dist-test-slave-2p8l"
server_key: "52d232b80589161b97a86f00594d9f6a"
server_key_iv: "8c96c25f9c79067323364443050fb336"
server_key_version: "encryptionkey@0"
I20260810 15:25:41.787998 25502 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786375520124696-18706-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786375520124696-18706-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786375520124696-18706-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:25:41.815451 25502 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:25:41.817934 25502 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:25:41.818136 25502 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:25:41.818358 25502 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 15:25:41.818683 25502 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 15:25:41.818718 25502 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:41.818742 25502 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 15:25:41.818790 25502 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:41.824889 25502 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.130:43497
I20260810 15:25:41.824934 25723 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.130:43497 every 8 connection(s)
I20260810 15:25:41.825281 25502 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786375520124696-18706-0/minicluster-data/ts-1/data/info.pb
I20260810 15:25:41.831615 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 25502
I20260810 15:25:41.831719 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786375520124696-18706-0/minicluster-data/ts-1/wal/instance
I20260810 15:25:41.831928 18706 external_mini_cluster.cc:1428] Setting key 78f818922fa33c31bd82452a7367b540
Aug 10 15:25:41 dist-test-slave-2p8l krb5kdc[25080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375541, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.130@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
I20260810 15:25:41.835708 25242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:41.826151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.130:56235 (local address 127.18.68.190:39883)
0810 15:25:41.826213 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:41.826216 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:41.826470 (+ 254us) server_negotiation.cc:407] Connection header received
0810 15:25:41.827496 (+ 1026us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:41.827497 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:41.827509 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:41.827563 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:41.828257 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:41.828774 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:41.829835 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:41.830098 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:41.830162 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:41.832663 (+ 2501us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:41.832664 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:41.832664 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:41.832672 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:41.834231 (+ 1559us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:41.834687 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:41.834689 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:41.834689 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:41.834752 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:41.835014 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:41.835016 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:41.835017 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:41.835146 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:41.835236 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:41.835523 (+ 287us) server_negotiation.cc:299] Negotiation successful
0810 15:25:41.835610 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260810 15:25:41.835906 25727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:41.826145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:39883 (local address 127.18.68.130:56235)
0810 15:25:41.826341 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:41.826380 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:41.827398 (+ 1018us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:41.827624 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:41.827627 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:41.827926 (+ 299us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:25:41.828165 (+ 239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:41.828170 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:41.828874 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:41.828875 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:41.829744 (+ 869us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:41.829747 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:41.830177 (+ 430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:41.830178 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:41.830304 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:41.830840 (+ 536us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:25:41.830849 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:25:41.832531 (+ 1682us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:25:41.834329 (+ 1798us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:41.834337 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:41.834340 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:41.834589 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:41.834826 (+ 237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:41.834827 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:41.834827 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:41.834944 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:41.835218 (+ 274us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:25:41.835232 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:25:41.835380 (+ 148us) client_negotiation.cc:769] Sending connection context
0810 15:25:41.835494 (+ 114us) client_negotiation.cc:240] Negotiation successful
0810 15:25:41.835657 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":109,"threads_started":1}
I20260810 15:25:41.836594 25725 heartbeater.cc:347] Connected to a master server at 127.18.68.190:39883
I20260810 15:25:41.836714 25725 heartbeater.cc:464] Registering TS with master...
I20260810 15:25:41.836898 25725 heartbeater.cc:511] Master 127.18.68.190:39883 requested a full tablet report, sending...
I20260810 15:25:41.837375 25164 ts_manager.cc:194] Registered new tserver with Master: 18cb5984f0284627a67cb84046366766 (127.18.68.130:43497)
I20260810 15:25:41.837893 25164 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.68.130@KRBTEST.COM'} at 127.18.68.130:56235
WARNING: no policy specified for kudu/127.18.68.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.68.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.68.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.131.keytab.
Entry for principal kudu/127.18.68.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.131.keytab.
I20260810 15:25:41.858767 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786375520124696-18706-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786375520124696-18706-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786375520124696-18706-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786375520124696-18706-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.68.131:0
--local_ip_for_outbound_sockets=127.18.68.131
--webserver_interface=127.18.68.131
--webserver_port=0
--tserver_master_addrs=127.18.68.190:39883
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.131.keytab
--principal=kudu/127.18.68.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:39165
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:25:41.942909 25734 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:25:41.943136 25734 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:25:41.943162 25734 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:25:41.944355 25734 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:25:41.944399 25734 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:25:41.944427 25734 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.68.131
I20260810 15:25:41.945960 25734 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:39165
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786375520124696-18706-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786375520124696-18706-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.131.keytab
--principal=kudu/127.18.68.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.68.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786375520124696-18706-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.68.131
--webserver_port=0
--tserver_master_addrs=127.18.68.190:39883
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25734
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.68.131
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786375520124696-18706-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:25:41.946249 25734 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:25:41.946445 25734 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:25:41.951546 25740 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:41.951632 25741 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:41.951678 25744 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:25:41.951944 25734 server_base.cc:1034] running on GCE node
I20260810 15:25:41.952203 25734 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:25:41.952458 25734 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:25:41.953634 25734 hybrid_clock.cc:648] HybridClock initialized: now 1786375541953668 us; error 76 us; skew 500 ppm
Aug 10 15:25:41 dist-test-slave-2p8l krb5kdc[25080](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375541, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:25:41.956445 25734 init.cc:377] Logged in from keytab as kudu/127.18.68.131@KRBTEST.COM (short username kudu)
I20260810 15:25:41.956957 25734 webserver.cc:460] Webserver started at http://127.18.68.131:46505/ using document root <none> and password file <none>
I20260810 15:25:41.957218 25734 fs_manager.cc:359] Metadata directory not provided
I20260810 15:25:41.957290 25734 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:25:41.957448 25734 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:25:41.958602 25734 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786375520124696-18706-0/minicluster-data/ts-2/data/instance:
uuid: "641013c473ef4ee8b02a1db1df91ca7a"
format_stamp: "Formatted at 2026-08-10 15:25:41 on dist-test-slave-2p8l"
server_key: "f9595eb8a32e0b834dd4cc2210252922"
server_key_iv: "6fdf45b4f09790ea595b730d471dd4d1"
server_key_version: "encryptionkey@0"
I20260810 15:25:41.958979 25734 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786375520124696-18706-0/minicluster-data/ts-2/wal/instance:
uuid: "641013c473ef4ee8b02a1db1df91ca7a"
format_stamp: "Formatted at 2026-08-10 15:25:41 on dist-test-slave-2p8l"
server_key: "f9595eb8a32e0b834dd4cc2210252922"
server_key_iv: "6fdf45b4f09790ea595b730d471dd4d1"
server_key_version: "encryptionkey@0"
I20260810 15:25:41.960439 25734 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 15:25:41.961205 25759 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:41.961374 25734 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 15:25:41.961484 25734 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786375520124696-18706-0/minicluster-data/ts-2/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786375520124696-18706-0/minicluster-data/ts-2/wal
uuid: "641013c473ef4ee8b02a1db1df91ca7a"
format_stamp: "Formatted at 2026-08-10 15:25:41 on dist-test-slave-2p8l"
server_key: "f9595eb8a32e0b834dd4cc2210252922"
server_key_iv: "6fdf45b4f09790ea595b730d471dd4d1"
server_key_version: "encryptionkey@0"
I20260810 15:25:41.961561 25734 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786375520124696-18706-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786375520124696-18706-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786375520124696-18706-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:25:41.976416 25734 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:25:41.978964 25734 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:25:41.979146 25734 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:25:41.979403 25734 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 15:25:41.979735 25734 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 15:25:41.979794 25734 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:41.979838 25734 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 15:25:41.979863 25734 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:41.986418 25734 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.131:46869
I20260810 15:25:41.986466 25958 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.131:46869 every 8 connection(s)
I20260810 15:25:41.986825 25734 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786375520124696-18706-0/minicluster-data/ts-2/data/info.pb
Aug 10 15:25:41 dist-test-slave-2p8l krb5kdc[25080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375541, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.131@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
I20260810 15:25:41.994508 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 25734
I20260810 15:25:41.994626 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786375520124696-18706-0/minicluster-data/ts-2/wal/instance
I20260810 15:25:41.994825 18706 external_mini_cluster.cc:1428] Setting key d3737492890421a967fee6083a0f0308
I20260810 15:25:41.997033 25242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:41.987654 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.131:42671 (local address 127.18.68.190:39883)
0810 15:25:41.987723 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:41.987725 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:41.987898 (+ 173us) server_negotiation.cc:407] Connection header received
0810 15:25:41.988829 (+ 931us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:41.988831 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:41.988842 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:41.988916 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:41.989510 (+ 594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:41.990000 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:41.991068 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:41.991363 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:41.991425 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:41.993686 (+ 2261us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:41.993687 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:41.993688 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:41.993694 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:41.995538 (+ 1844us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:41.995983 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:41.995985 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:41.995986 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:41.996064 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:41.996339 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:41.996340 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:41.996341 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:41.996469 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:41.996550 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:41.996842 (+ 292us) server_negotiation.cc:299] Negotiation successful
0810 15:25:41.996929 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260810 15:25:41.997233 25962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:41.987593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:39883 (local address 127.18.68.131:42671)
0810 15:25:41.987763 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:41.987806 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:41.988715 (+ 909us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:41.988971 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:41.988974 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:41.989229 (+ 255us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:25:41.989419 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:41.989423 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:41.990150 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:41.990151 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:41.990982 (+ 831us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:41.990985 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:41.991434 (+ 449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:41.991435 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:41.991544 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:41.992096 (+ 552us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:25:41.992104 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:25:41.993583 (+ 1479us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:25:41.995608 (+ 2025us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:41.995617 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:41.995619 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:41.995920 (+ 301us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:41.996141 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:41.996141 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:41.996142 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:41.996267 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:41.996543 (+ 276us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:25:41.996550 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:25:41.996702 (+ 152us) client_negotiation.cc:769] Sending connection context
0810 15:25:41.996819 (+ 117us) client_negotiation.cc:240] Negotiation successful
0810 15:25:41.996987 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":92,"threads_started":1}
I20260810 15:25:41.997702 25959 heartbeater.cc:347] Connected to a master server at 127.18.68.190:39883
I20260810 15:25:41.997788 25959 heartbeater.cc:464] Registering TS with master...
I20260810 15:25:41.997996 25959 heartbeater.cc:511] Master 127.18.68.190:39883 requested a full tablet report, sending...
I20260810 15:25:41.998378 25164 ts_manager.cc:194] Registered new tserver with Master: 641013c473ef4ee8b02a1db1df91ca7a (127.18.68.131:46869)
I20260810 15:25:41.998785 25164 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.68.131@KRBTEST.COM'} at 127.18.68.131:42671
I20260810 15:25:42.007005 18706 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 10 15:25:42 dist-test-slave-2p8l krb5kdc[25080](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375542, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 10 15:25:42 dist-test-slave-2p8l krb5kdc[25080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375542, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.68.129@KRBTEST.COM
I20260810 15:25:42.032423 25968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:42.024281 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38770 (local address 127.18.68.129:43279)
0810 15:25:42.024512 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:42.024517 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:42.024528 (+ 11us) server_negotiation.cc:407] Connection header received
0810 15:25:42.024572 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:42.024574 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:42.024589 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:42.024661 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:42.025230 (+ 569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:42.025985 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:42.026790 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:42.027108 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:42.027185 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:42.029618 (+ 2433us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:42.029626 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:42.029626 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:42.029633 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:42.031361 (+ 1728us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:42.031726 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:42.031729 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:42.031729 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:42.031807 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:42.031979 (+ 172us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:42.031980 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:42.031980 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:42.032108 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:42.032209 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:42.032285 (+ 76us) server_negotiation.cc:299] Negotiation successful
0810 15:25:42.032344 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":180,"thread_start_us":121,"threads_started":1}
Aug 10 15:25:42 dist-test-slave-2p8l krb5kdc[25080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375542, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
I20260810 15:25:42.040653 25242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:42.033757 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59792 (local address 127.18.68.190:39883)
0810 15:25:42.033821 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:42.033823 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:42.033832 (+ 9us) server_negotiation.cc:407] Connection header received
0810 15:25:42.033857 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:42.033860 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:42.033873 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:42.033923 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:42.034464 (+ 541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:42.034961 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:42.035643 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:42.035824 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:42.035881 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:42.037934 (+ 2053us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:42.037936 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:42.037936 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:42.037943 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:42.039484 (+ 1541us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:42.039842 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:42.039843 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:42.039843 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:42.039899 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:42.040141 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:42.040141 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:42.040142 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:42.040282 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:42.040358 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:42.040450 (+ 92us) server_negotiation.cc:299] Negotiation successful
0810 15:25:42.040518 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
W20260810 15:25:42.040881 25164 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59792
I20260810 15:25:42.041186 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 25275
I20260810 15:25:42.059742 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 25502
I20260810 15:25:42.073450 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 25734
I20260810 15:25:42.085227 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 25105
2026-08-10T15:25:42Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (2199 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786375520124696-18706-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 15:25:42 dist-test-slave-2p8l krb5kdc[25973](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 15:25:42 dist-test-slave-2p8l krb5kdc[25973](info): set up 2 sockets
Aug 10 15:25:42 dist-test-slave-2p8l krb5kdc[25973](info): commencing operation
krb5kdc: starting...
W20260810 15:25:43.374266 18706 mini_kdc.cc:121] Time spent starting KDC: real 1.258s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786375520124696-18706-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786375520124696-18706-0/krb5kdc/test-user.keytab.
Aug 10 15:25:43 dist-test-slave-2p8l krb5kdc[25973](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375543, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T15:25:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T15:25:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.68.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.68.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.68.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab.
Entry for principal kudu/127.18.68.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab.
I20260810 15:25:43.501060 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786375520124696-18706-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786375520124696-18706-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786375520124696-18706-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.190:46023
--webserver_interface=127.18.68.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab
--principal=kudu/127.18.68.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:37435
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.68.190:46023
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:25:43.584765 26000 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:25:43.584990 26000 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:25:43.585012 26000 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:25:43.586318 26000 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 15:25:43.586359 26000 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:25:43.586374 26000 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:25:43.586387 26000 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 15:25:43.586400 26000 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 15:25:43.587985 26000 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:37435
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786375520124696-18706-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786375520124696-18706-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.68.190:46023
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab
--principal=kudu/127.18.68.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.190:46023
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.68.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26000
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786375520124696-18706-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:25:43.588268 26000 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:25:43.588506 26000 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:25:43.593425 26008 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:43.593432 26011 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:43.593432 26015 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:25:43.593603 26000 server_base.cc:1034] running on GCE node
I20260810 15:25:43.593897 26000 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:25:43.594275 26000 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:25:43.595461 26000 hybrid_clock.cc:648] HybridClock initialized: now 1786375543595431 us; error 39 us; skew 500 ppm
Aug 10 15:25:43 dist-test-slave-2p8l krb5kdc[25973](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375543, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:25:43.598163 26000 init.cc:377] Logged in from keytab as kudu/127.18.68.190@KRBTEST.COM (short username kudu)
I20260810 15:25:43.598483 26000 fs_manager.cc:359] Metadata directory not provided
I20260810 15:25:43.598533 26000 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:25:43.598626 26000 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:25:43.599647 26000 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786375520124696-18706-0/minicluster-data/master-0/data/instance:
uuid: "1b4c584d7a3145a29a37cf2f5fbb02e0"
format_stamp: "Formatted at 2026-08-10 15:25:43 on dist-test-slave-2p8l"
server_key: "8b28b76024368d761f1ef1591e11659e"
server_key_iv: "a60fb5473f0a19695617d40dff662233"
server_key_version: "encryptionkey@0"
I20260810 15:25:43.599960 26000 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786375520124696-18706-0/minicluster-data/master-0/wal/instance:
uuid: "1b4c584d7a3145a29a37cf2f5fbb02e0"
format_stamp: "Formatted at 2026-08-10 15:25:43 on dist-test-slave-2p8l"
server_key: "8b28b76024368d761f1ef1591e11659e"
server_key_iv: "a60fb5473f0a19695617d40dff662233"
server_key_version: "encryptionkey@0"
I20260810 15:25:43.601258 26000 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260810 15:25:43.602046 26025 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:43.602361 26000 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:25:43.602485 26000 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786375520124696-18706-0/minicluster-data/master-0/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786375520124696-18706-0/minicluster-data/master-0/wal
uuid: "1b4c584d7a3145a29a37cf2f5fbb02e0"
format_stamp: "Formatted at 2026-08-10 15:25:43 on dist-test-slave-2p8l"
server_key: "8b28b76024368d761f1ef1591e11659e"
server_key_iv: "a60fb5473f0a19695617d40dff662233"
server_key_version: "encryptionkey@0"
I20260810 15:25:43.602574 26000 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786375520124696-18706-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786375520124696-18706-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786375520124696-18706-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:25:43.622704 26000 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:25:43.624892 26000 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:25:43.625077 26000 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:25:43.629318 26000 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.190:46023
I20260810 15:25:43.629351 26106 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.190:46023 every 8 connection(s)
I20260810 15:25:43.629684 26000 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
I20260810 15:25:43.630812 26107 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:25:43.633364 26107 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1b4c584d7a3145a29a37cf2f5fbb02e0: Bootstrap starting.
I20260810 15:25:43.633989 26107 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1b4c584d7a3145a29a37cf2f5fbb02e0: Neither blocks nor log segments found. Creating new log.
I20260810 15:25:43.634351 26107 log.cc:824] T 00000000000000000000000000000000 P 1b4c584d7a3145a29a37cf2f5fbb02e0: Log is configured to *not* fsync() on all Append() calls
I20260810 15:25:43.635154 26107 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1b4c584d7a3145a29a37cf2f5fbb02e0: No bootstrap required, opened a new log
I20260810 15:25:43.636896 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 26000
I20260810 15:25:43.637017 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786375520124696-18706-0/minicluster-data/master-0/wal/instance
I20260810 15:25:43.637240 18706 external_mini_cluster.cc:1428] Setting key a1029d4a0e1ca75c3534db73343b4fb4
I20260810 15:25:43.637190 26107 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1b4c584d7a3145a29a37cf2f5fbb02e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b4c584d7a3145a29a37cf2f5fbb02e0" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46023 } }
I20260810 15:25:43.637390 26107 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1b4c584d7a3145a29a37cf2f5fbb02e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:25:43.637445 26107 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1b4c584d7a3145a29a37cf2f5fbb02e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b4c584d7a3145a29a37cf2f5fbb02e0, State: Initialized, Role: FOLLOWER
I20260810 15:25:43.637636 26107 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1b4c584d7a3145a29a37cf2f5fbb02e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b4c584d7a3145a29a37cf2f5fbb02e0" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46023 } }
I20260810 15:25:43.637745 26107 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1b4c584d7a3145a29a37cf2f5fbb02e0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 15:25:43.637794 26107 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1b4c584d7a3145a29a37cf2f5fbb02e0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 15:25:43.637848 26107 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1b4c584d7a3145a29a37cf2f5fbb02e0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:25:43.639079 26107 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1b4c584d7a3145a29a37cf2f5fbb02e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b4c584d7a3145a29a37cf2f5fbb02e0" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46023 } }
I20260810 15:25:43.639182 26107 leader_election.cc:302] T 00000000000000000000000000000000 P 1b4c584d7a3145a29a37cf2f5fbb02e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1b4c584d7a3145a29a37cf2f5fbb02e0; no voters:
I20260810 15:25:43.639390 26107 leader_election.cc:288] T 00000000000000000000000000000000 P 1b4c584d7a3145a29a37cf2f5fbb02e0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 15:25:43.639421 26113 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1b4c584d7a3145a29a37cf2f5fbb02e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 15:25:43.639599 26113 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1b4c584d7a3145a29a37cf2f5fbb02e0 [term 1 LEADER]: Becoming Leader. State: Replica: 1b4c584d7a3145a29a37cf2f5fbb02e0, State: Running, Role: LEADER
I20260810 15:25:43.639673 26107 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1b4c584d7a3145a29a37cf2f5fbb02e0 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 15:25:43.639701 26113 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1b4c584d7a3145a29a37cf2f5fbb02e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b4c584d7a3145a29a37cf2f5fbb02e0" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46023 } }
I20260810 15:25:43.640015 26113 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1b4c584d7a3145a29a37cf2f5fbb02e0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1b4c584d7a3145a29a37cf2f5fbb02e0. Latest consensus state: current_term: 1 leader_uuid: "1b4c584d7a3145a29a37cf2f5fbb02e0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b4c584d7a3145a29a37cf2f5fbb02e0" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46023 } } }
I20260810 15:25:43.640105 26113 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1b4c584d7a3145a29a37cf2f5fbb02e0 [sys.catalog]: This master's current role is: LEADER
I20260810 15:25:43.640027 26116 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1b4c584d7a3145a29a37cf2f5fbb02e0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1b4c584d7a3145a29a37cf2f5fbb02e0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b4c584d7a3145a29a37cf2f5fbb02e0" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46023 } } }
I20260810 15:25:43.640265 26116 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1b4c584d7a3145a29a37cf2f5fbb02e0 [sys.catalog]: This master's current role is: LEADER
W20260810 15:25:43.641577 26137 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 1b4c584d7a3145a29a37cf2f5fbb02e0: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 15:25:43.642094 26137 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 15:25:43.642172 26122 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 15:25:43.642325 26122 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 15:25:43.643862 26122 catalog_manager.cc:1347] Generated new cluster ID: b67483ef54b54317a31da433354d6af5
I20260810 15:25:43.643913 26122 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 10 15:25:43 dist-test-slave-2p8l krb5kdc[25973](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375543, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
I20260810 15:25:43.649770 26112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:43.637784 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54842 (local address 127.18.68.190:46023)
0810 15:25:43.638123 (+ 339us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:43.638134 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:43.638170 (+ 36us) server_negotiation.cc:407] Connection header received
0810 15:25:43.638314 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:43.638321 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:43.638407 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:43.638595 (+ 188us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:43.639275 (+ 680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:43.640941 (+ 1666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:43.642104 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:43.642709 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:43.642882 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:43.645896 (+ 3014us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:43.645901 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:43.645901 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:43.645913 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:43.648009 (+ 2096us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:43.648409 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:43.648412 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:43.648412 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:43.648538 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:43.648767 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:43.648768 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:43.648769 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:43.649157 (+ 388us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:43.649308 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:43.649411 (+ 103us) server_negotiation.cc:299] Negotiation successful
0810 15:25:43.649557 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":255,"thread_start_us":111,"threads_started":1}
I20260810 15:25:43.663537 26122 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 15:25:43.664286 26122 catalog_manager.cc:1504] Loading token signing keys...
I20260810 15:25:43.673589 26122 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1b4c584d7a3145a29a37cf2f5fbb02e0: Generated new TSK 0
I20260810 15:25:43.673789 26122 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.18.68.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.68.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.68.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.129.keytab.
Entry for principal kudu/127.18.68.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.129.keytab.
I20260810 15:25:43.705291 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786375520124696-18706-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786375520124696-18706-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786375520124696-18706-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786375520124696-18706-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.68.129:0
--local_ip_for_outbound_sockets=127.18.68.129
--webserver_interface=127.18.68.129
--webserver_port=0
--tserver_master_addrs=127.18.68.190:46023
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.129.keytab
--principal=kudu/127.18.68.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:37435
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:25:43.790297 26149 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:25:43.790587 26149 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:25:43.790630 26149 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:25:43.792089 26149 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:25:43.792138 26149 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:25:43.792166 26149 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.68.129
I20260810 15:25:43.793736 26149 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:37435
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786375520124696-18706-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786375520124696-18706-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.129.keytab
--principal=kudu/127.18.68.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.68.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786375520124696-18706-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.68.129
--webserver_port=0
--tserver_master_addrs=127.18.68.190:46023
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26149
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.68.129
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786375520124696-18706-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:25:43.793928 26149 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:25:43.794195 26149 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:25:43.799180 26160 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:43.799132 26161 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:43.799139 26165 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:25:43.799410 26149 server_base.cc:1034] running on GCE node
I20260810 15:25:43.799619 26149 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:25:43.799819 26149 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:25:43.800981 26149 hybrid_clock.cc:648] HybridClock initialized: now 1786375543800962 us; error 35 us; skew 500 ppm
Aug 10 15:25:43 dist-test-slave-2p8l krb5kdc[25973](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375543, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:25:43.803736 26149 init.cc:377] Logged in from keytab as kudu/127.18.68.129@KRBTEST.COM (short username kudu)
I20260810 15:25:43.804123 26149 fs_manager.cc:359] Metadata directory not provided
I20260810 15:25:43.804178 26149 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:25:43.804272 26149 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:25:43.805435 26149 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786375520124696-18706-0/minicluster-data/ts-0/data/instance:
uuid: "d995649e22234a878339646b47fe6e71"
format_stamp: "Formatted at 2026-08-10 15:25:43 on dist-test-slave-2p8l"
server_key: "45a88078cc98227ed725ecaab5896e5f"
server_key_iv: "2218a5778c67694d32b1362e34ae6557"
server_key_version: "encryptionkey@0"
I20260810 15:25:43.805763 26149 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786375520124696-18706-0/minicluster-data/ts-0/wal/instance:
uuid: "d995649e22234a878339646b47fe6e71"
format_stamp: "Formatted at 2026-08-10 15:25:43 on dist-test-slave-2p8l"
server_key: "45a88078cc98227ed725ecaab5896e5f"
server_key_iv: "2218a5778c67694d32b1362e34ae6557"
server_key_version: "encryptionkey@0"
I20260810 15:25:43.807206 26149 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 15:25:43.807968 26176 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:43.808173 26149 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 15:25:43.808269 26149 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786375520124696-18706-0/minicluster-data/ts-0/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786375520124696-18706-0/minicluster-data/ts-0/wal
uuid: "d995649e22234a878339646b47fe6e71"
format_stamp: "Formatted at 2026-08-10 15:25:43 on dist-test-slave-2p8l"
server_key: "45a88078cc98227ed725ecaab5896e5f"
server_key_iv: "2218a5778c67694d32b1362e34ae6557"
server_key_version: "encryptionkey@0"
I20260810 15:25:43.808344 26149 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786375520124696-18706-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786375520124696-18706-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786375520124696-18706-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:25:43.843580 26149 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:25:43.845858 26149 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:25:43.846037 26149 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:25:43.846370 26149 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 15:25:43.846730 26149 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 15:25:43.846791 26149 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:43.846829 26149 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 15:25:43.846876 26149 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:43.852980 26149 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.129:35977
I20260810 15:25:43.853022 26383 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.129:35977 every 8 connection(s)
I20260810 15:25:43.853303 26149 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786375520124696-18706-0/minicluster-data/ts-0/data/info.pb
Aug 10 15:25:43 dist-test-slave-2p8l krb5kdc[25973](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375543, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.129@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
I20260810 15:25:43.862409 26112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:43.854048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.129:55585 (local address 127.18.68.190:46023)
0810 15:25:43.854147 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:43.854150 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:43.854371 (+ 221us) server_negotiation.cc:407] Connection header received
0810 15:25:43.854830 (+ 459us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:43.854831 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:43.854845 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:43.854899 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:43.855862 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:43.856385 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:43.857418 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:43.857633 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:43.857695 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:43.859885 (+ 2190us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:43.859887 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:43.859887 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:43.859895 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:43.861087 (+ 1192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:43.861481 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:43.861482 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:43.861482 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:43.861533 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:43.861759 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:43.861760 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:43.861760 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:43.861861 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:43.861913 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:43.862226 (+ 313us) server_negotiation.cc:299] Negotiation successful
0810 15:25:43.862322 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260810 15:25:43.862571 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 26149
I20260810 15:25:43.862617 26389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:43.854014 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46023 (local address 127.18.68.129:55585)
0810 15:25:43.854239 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:43.854279 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:43.854745 (+ 466us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:43.854968 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:43.854972 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:43.855257 (+ 285us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:25:43.855771 (+ 514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:43.855776 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:43.856492 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:43.856493 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:43.857323 (+ 830us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:43.857325 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:43.857717 (+ 392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:43.857718 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:43.857826 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:43.858323 (+ 497us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:25:43.858331 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:25:43.859790 (+ 1459us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:25:43.861170 (+ 1380us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:43.861177 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:43.861179 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:43.861414 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:43.861593 (+ 179us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:43.861593 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:43.861594 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:43.861701 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:43.861917 (+ 216us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:25:43.861922 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:25:43.862035 (+ 113us) client_negotiation.cc:769] Sending connection context
0810 15:25:43.862188 (+ 153us) client_negotiation.cc:240] Negotiation successful
0810 15:25:43.862325 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":135,"threads_started":1}
I20260810 15:25:43.862712 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786375520124696-18706-0/minicluster-data/ts-0/wal/instance
I20260810 15:25:43.862920 18706 external_mini_cluster.cc:1428] Setting key 6f82aa52e6b20854fd0fc6809fa34475
I20260810 15:25:43.863158 26385 heartbeater.cc:347] Connected to a master server at 127.18.68.190:46023
I20260810 15:25:43.863272 26385 heartbeater.cc:464] Registering TS with master...
I20260810 15:25:43.863442 26385 heartbeater.cc:511] Master 127.18.68.190:46023 requested a full tablet report, sending...
I20260810 15:25:43.864006 26052 ts_manager.cc:194] Registered new tserver with Master: d995649e22234a878339646b47fe6e71 (127.18.68.129:35977)
I20260810 15:25:43.864648 26052 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.68.129@KRBTEST.COM'} at 127.18.68.129:55585
WARNING: no policy specified for kudu/127.18.68.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.68.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.68.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.130.keytab.
Entry for principal kudu/127.18.68.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.130.keytab.
I20260810 15:25:43.889650 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786375520124696-18706-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786375520124696-18706-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786375520124696-18706-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786375520124696-18706-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.68.130:0
--local_ip_for_outbound_sockets=127.18.68.130
--webserver_interface=127.18.68.130
--webserver_port=0
--tserver_master_addrs=127.18.68.190:46023
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.130.keytab
--principal=kudu/127.18.68.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:37435
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:25:43.972909 26393 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:25:43.973152 26393 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:25:43.973191 26393 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:25:43.974375 26393 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:25:43.974447 26393 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:25:43.974490 26393 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.68.130
I20260810 15:25:43.976020 26393 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:37435
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786375520124696-18706-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786375520124696-18706-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.130.keytab
--principal=kudu/127.18.68.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.68.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786375520124696-18706-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.68.130
--webserver_port=0
--tserver_master_addrs=127.18.68.190:46023
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26393
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.68.130
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786375520124696-18706-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:25:43.976303 26393 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:25:43.976533 26393 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:25:43.981585 26416 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:43.981612 26413 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:43.981611 26408 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:25:43.981705 26393 server_base.cc:1034] running on GCE node
I20260810 15:25:43.982116 26393 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:25:43.982414 26393 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:25:43.983585 26393 hybrid_clock.cc:648] HybridClock initialized: now 1786375543983570 us; error 43 us; skew 500 ppm
Aug 10 15:25:43 dist-test-slave-2p8l krb5kdc[25973](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375543, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:25:43.986238 26393 init.cc:377] Logged in from keytab as kudu/127.18.68.130@KRBTEST.COM (short username kudu)
I20260810 15:25:43.986660 26393 fs_manager.cc:359] Metadata directory not provided
I20260810 15:25:43.986737 26393 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:25:43.986896 26393 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:25:43.987942 26393 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786375520124696-18706-0/minicluster-data/ts-1/data/instance:
uuid: "f6433573d14f4240b5ab79d4cd0fc5cf"
format_stamp: "Formatted at 2026-08-10 15:25:43 on dist-test-slave-2p8l"
server_key: "d572014d111df76eb3ef92fecb352802"
server_key_iv: "7bb8b52f079e334870a3b4b511a4cfe8"
server_key_version: "encryptionkey@0"
I20260810 15:25:43.988314 26393 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786375520124696-18706-0/minicluster-data/ts-1/wal/instance:
uuid: "f6433573d14f4240b5ab79d4cd0fc5cf"
format_stamp: "Formatted at 2026-08-10 15:25:43 on dist-test-slave-2p8l"
server_key: "d572014d111df76eb3ef92fecb352802"
server_key_iv: "7bb8b52f079e334870a3b4b511a4cfe8"
server_key_version: "encryptionkey@0"
I20260810 15:25:43.989604 26393 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 15:25:43.990484 26426 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:43.990657 26393 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260810 15:25:43.990762 26393 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786375520124696-18706-0/minicluster-data/ts-1/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786375520124696-18706-0/minicluster-data/ts-1/wal
uuid: "f6433573d14f4240b5ab79d4cd0fc5cf"
format_stamp: "Formatted at 2026-08-10 15:25:43 on dist-test-slave-2p8l"
server_key: "d572014d111df76eb3ef92fecb352802"
server_key_iv: "7bb8b52f079e334870a3b4b511a4cfe8"
server_key_version: "encryptionkey@0"
I20260810 15:25:43.990850 26393 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786375520124696-18706-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786375520124696-18706-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786375520124696-18706-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:25:44.011014 26393 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:25:44.013283 26393 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:25:44.013458 26393 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:25:44.013716 26393 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 15:25:44.014097 26393 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 15:25:44.014166 26393 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:44.014210 26393 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 15:25:44.014251 26393 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:44.020447 26393 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.130:32799
I20260810 15:25:44.020483 26606 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.130:32799 every 8 connection(s)
I20260810 15:25:44.020769 26393 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786375520124696-18706-0/minicluster-data/ts-1/data/info.pb
I20260810 15:25:44.025064 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 26393
I20260810 15:25:44.025192 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786375520124696-18706-0/minicluster-data/ts-1/wal/instance
I20260810 15:25:44.025393 18706 external_mini_cluster.cc:1428] Setting key ff582b673b37dd4499c5b8d4e11f0228
Aug 10 15:25:44 dist-test-slave-2p8l krb5kdc[25973](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375543, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.130@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
I20260810 15:25:44.031198 26112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:44.021528 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.130:54333 (local address 127.18.68.190:46023)
0810 15:25:44.021599 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:44.021601 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:44.021859 (+ 258us) server_negotiation.cc:407] Connection header received
0810 15:25:44.022440 (+ 581us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:44.022441 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:44.022454 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:44.022519 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:44.023479 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:44.023998 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:44.025036 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:44.025311 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:44.025375 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:44.027881 (+ 2506us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:44.027882 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:44.027883 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:44.027891 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:44.029651 (+ 1760us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:44.030055 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:44.030056 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:44.030056 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:44.030149 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:44.030404 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:44.030405 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:44.030405 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:44.030572 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:44.030661 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:44.030979 (+ 318us) server_negotiation.cc:299] Negotiation successful
0810 15:25:44.031093 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260810 15:25:44.031229 26615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:44.021498 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46023 (local address 127.18.68.130:54333)
0810 15:25:44.021731 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:44.021768 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:44.022331 (+ 563us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:44.022595 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:44.022598 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:44.022861 (+ 263us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:25:44.023364 (+ 503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:44.023369 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:44.024097 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:44.024098 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:44.024939 (+ 841us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:44.024941 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:44.025383 (+ 442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:44.025384 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:44.025546 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:44.026166 (+ 620us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:25:44.026174 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:25:44.027777 (+ 1603us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:25:44.029741 (+ 1964us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:44.029749 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:44.029751 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:44.029972 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:44.030213 (+ 241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:44.030214 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:44.030214 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:44.030331 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:44.030651 (+ 320us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:25:44.030656 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:25:44.030813 (+ 157us) client_negotiation.cc:769] Sending connection context
0810 15:25:44.030927 (+ 114us) client_negotiation.cc:240] Negotiation successful
0810 15:25:44.031058 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":93,"threads_started":1}
I20260810 15:25:44.031766 26608 heartbeater.cc:347] Connected to a master server at 127.18.68.190:46023
I20260810 15:25:44.031867 26608 heartbeater.cc:464] Registering TS with master...
I20260810 15:25:44.032038 26608 heartbeater.cc:511] Master 127.18.68.190:46023 requested a full tablet report, sending...
I20260810 15:25:44.032442 26052 ts_manager.cc:194] Registered new tserver with Master: f6433573d14f4240b5ab79d4cd0fc5cf (127.18.68.130:32799)
I20260810 15:25:44.032789 26052 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.68.130@KRBTEST.COM'} at 127.18.68.130:54333
WARNING: no policy specified for kudu/127.18.68.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.68.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.68.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.131.keytab.
Entry for principal kudu/127.18.68.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.131.keytab.
I20260810 15:25:44.053565 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786375520124696-18706-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786375520124696-18706-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786375520124696-18706-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786375520124696-18706-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.68.131:0
--local_ip_for_outbound_sockets=127.18.68.131
--webserver_interface=127.18.68.131
--webserver_port=0
--tserver_master_addrs=127.18.68.190:46023
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.131.keytab
--principal=kudu/127.18.68.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:37435
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:25:44.138692 26620 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:25:44.138931 26620 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:25:44.138974 26620 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:25:44.140368 26620 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:25:44.140455 26620 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:25:44.140501 26620 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.68.131
I20260810 15:25:44.142213 26620 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:37435
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786375520124696-18706-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786375520124696-18706-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.131.keytab
--principal=kudu/127.18.68.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.68.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786375520124696-18706-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.68.131
--webserver_port=0
--tserver_master_addrs=127.18.68.190:46023
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26620
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.68.131
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786375520124696-18706-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:25:44.142452 26620 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:25:44.142712 26620 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:25:44.147838 26626 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:44.147861 26627 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:25:44.148058 26620 server_base.cc:1034] running on GCE node
W20260810 15:25:44.147867 26631 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:25:44.148348 26620 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:25:44.148664 26620 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:25:44.149830 26620 hybrid_clock.cc:648] HybridClock initialized: now 1786375544149820 us; error 41 us; skew 500 ppm
Aug 10 15:25:44 dist-test-slave-2p8l krb5kdc[25973](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375544, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:25:44.152367 26620 init.cc:377] Logged in from keytab as kudu/127.18.68.131@KRBTEST.COM (short username kudu)
I20260810 15:25:44.152662 26620 fs_manager.cc:359] Metadata directory not provided
I20260810 15:25:44.152706 26620 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:25:44.152796 26620 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:25:44.153815 26620 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786375520124696-18706-0/minicluster-data/ts-2/data/instance:
uuid: "cd7decda01e84f4b92180f97c8c81991"
format_stamp: "Formatted at 2026-08-10 15:25:44 on dist-test-slave-2p8l"
server_key: "41422799d2ee9aaf68a0995fb22eea73"
server_key_iv: "74dba2e6c9b1f862416196e9da53ee7c"
server_key_version: "encryptionkey@0"
I20260810 15:25:44.154207 26620 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786375520124696-18706-0/minicluster-data/ts-2/wal/instance:
uuid: "cd7decda01e84f4b92180f97c8c81991"
format_stamp: "Formatted at 2026-08-10 15:25:44 on dist-test-slave-2p8l"
server_key: "41422799d2ee9aaf68a0995fb22eea73"
server_key_iv: "74dba2e6c9b1f862416196e9da53ee7c"
server_key_version: "encryptionkey@0"
I20260810 15:25:44.155476 26620 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:25:44.156257 26642 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:44.156432 26620 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:25:44.156522 26620 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786375520124696-18706-0/minicluster-data/ts-2/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786375520124696-18706-0/minicluster-data/ts-2/wal
uuid: "cd7decda01e84f4b92180f97c8c81991"
format_stamp: "Formatted at 2026-08-10 15:25:44 on dist-test-slave-2p8l"
server_key: "41422799d2ee9aaf68a0995fb22eea73"
server_key_iv: "74dba2e6c9b1f862416196e9da53ee7c"
server_key_version: "encryptionkey@0"
I20260810 15:25:44.156576 26620 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786375520124696-18706-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786375520124696-18706-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786375520124696-18706-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:25:44.167621 26620 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:25:44.169728 26620 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:25:44.169842 26620 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:25:44.170022 26620 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 15:25:44.170404 26620 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 15:25:44.170444 26620 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:44.170466 26620 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 15:25:44.170516 26620 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:44.176754 26620 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.131:46617
I20260810 15:25:44.176842 26831 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.131:46617 every 8 connection(s)
I20260810 15:25:44.177104 26620 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786375520124696-18706-0/minicluster-data/ts-2/data/info.pb
I20260810 15:25:44.179097 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 26620
I20260810 15:25:44.179214 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786375520124696-18706-0/minicluster-data/ts-2/wal/instance
I20260810 15:25:44.179382 18706 external_mini_cluster.cc:1428] Setting key 6b680db3f8c4b085428ab3759804c059
Aug 10 15:25:44 dist-test-slave-2p8l krb5kdc[25973](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375544, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.131@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
I20260810 15:25:44.186749 26112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:44.177872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.131:43817 (local address 127.18.68.190:46023)
0810 15:25:44.177915 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:44.177917 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:44.178195 (+ 278us) server_negotiation.cc:407] Connection header received
0810 15:25:44.178674 (+ 479us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:44.178675 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:44.178685 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:44.178739 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:44.179861 (+ 1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:44.180530 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:44.181540 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:44.181737 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:44.181795 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:44.183922 (+ 2127us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:44.183923 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:44.183923 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:44.183931 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:44.185397 (+ 1466us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:44.185808 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:44.185808 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:44.185809 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:44.185858 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:44.186152 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:44.186153 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:44.186153 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:44.186280 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:44.186360 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:44.186604 (+ 244us) server_negotiation.cc:299] Negotiation successful
0810 15:25:44.186681 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260810 15:25:44.186980 26836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:44.177848 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46023 (local address 127.18.68.131:43817)
0810 15:25:44.178011 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:44.178088 (+ 77us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:44.178584 (+ 496us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:44.178790 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:44.178793 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:44.179050 (+ 257us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:25:44.179722 (+ 672us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:44.179730 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:44.180623 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:44.180624 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:44.181459 (+ 835us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:44.181461 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:44.181816 (+ 355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:44.181817 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:44.181921 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:44.182432 (+ 511us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:25:44.182440 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:25:44.183835 (+ 1395us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:25:44.185479 (+ 1644us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:44.185486 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:44.185488 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:44.185737 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:44.185917 (+ 180us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:44.185918 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:44.185918 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:44.186017 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:44.186358 (+ 341us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:25:44.186365 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:25:44.186484 (+ 119us) client_negotiation.cc:769] Sending connection context
0810 15:25:44.186570 (+ 86us) client_negotiation.cc:240] Negotiation successful
0810 15:25:44.186716 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":81,"threads_started":1}
I20260810 15:25:44.187530 26833 heartbeater.cc:347] Connected to a master server at 127.18.68.190:46023
I20260810 15:25:44.187672 26833 heartbeater.cc:464] Registering TS with master...
I20260810 15:25:44.187840 26833 heartbeater.cc:511] Master 127.18.68.190:46023 requested a full tablet report, sending...
I20260810 15:25:44.188241 26052 ts_manager.cc:194] Registered new tserver with Master: cd7decda01e84f4b92180f97c8c81991 (127.18.68.131:46617)
I20260810 15:25:44.188613 26052 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.68.131@KRBTEST.COM'} at 127.18.68.131:43817
I20260810 15:25:44.191148 18706 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 15:25:44.198670 26112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:44.192472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54854 (local address 127.18.68.190:46023)
0810 15:25:44.192533 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:44.192535 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:44.192696 (+ 161us) server_negotiation.cc:407] Connection header received
0810 15:25:44.192785 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:44.192786 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:44.192797 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:44.192876 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:44.193441 (+ 565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:44.193969 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:44.194809 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:44.195001 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:44.195086 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:44.196274 (+ 1188us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:44.196275 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:44.196275 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:44.196282 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:44.197457 (+ 1175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:44.197813 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:44.197814 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:44.197814 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:44.197876 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:44.198101 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:44.198102 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:44.198102 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:44.198261 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:44.198370 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:44.198487 (+ 117us) server_negotiation.cc:299] Negotiation successful
0810 15:25:44.198567 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260810 15:25:44.200117 26052 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54854:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 15:25:44.201594 26052 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 15:25:44.208841 26855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:44.204456 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.130:32799 (local address 127.0.0.1:54690)
0810 15:25:44.205120 (+ 664us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:44.205131 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:44.205183 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:44.205372 (+ 189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:44.205373 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:44.205375 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:25:44.205410 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:44.205412 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:44.206700 (+ 1288us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:44.206701 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:44.207775 (+ 1074us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:44.207777 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:44.208618 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:44.208619 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:44.208676 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:44.208678 (+ 2us) client_negotiation.cc:769] Sending connection context
0810 15:25:44.208729 (+ 51us) client_negotiation.cc:240] Negotiation successful
0810 15:25:44.208768 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":643,"thread_start_us":104,"threads_started":1}
I20260810 15:25:44.208860 26859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:44.204593 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54690 (local address 127.18.68.130:32799)
0810 15:25:44.204815 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:44.204820 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:44.205184 (+ 364us) server_negotiation.cc:407] Connection header received
0810 15:25:44.205266 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:44.205269 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:44.205285 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:44.205359 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:25:44.205499 (+ 140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:44.206598 (+ 1099us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:44.207867 (+ 1269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:44.208548 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:44.208628 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:44.208681 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:44.208739 (+ 58us) server_negotiation.cc:299] Negotiation successful
0810 15:25:44.208782 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":162,"thread_start_us":94,"threads_started":1}
I20260810 15:25:44.208927 26861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:44.204692 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54394 (local address 127.18.68.129:35977)
0810 15:25:44.204921 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:44.204926 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:44.204966 (+ 40us) server_negotiation.cc:407] Connection header received
0810 15:25:44.205077 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:44.205080 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:44.205097 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:44.205172 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:25:44.205423 (+ 251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:44.206343 (+ 920us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:44.207882 (+ 1539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:44.208377 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:44.208468 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:44.208527 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:44.208787 (+ 260us) server_negotiation.cc:299] Negotiation successful
0810 15:25:44.208834 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":192,"thread_start_us":91,"threads_started":1}
I20260810 15:25:44.209106 26854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:44.204231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.131:46617 (local address 127.0.0.1:39208)
0810 15:25:44.204457 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:44.204513 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:44.204579 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:44.205010 (+ 431us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:44.205014 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:44.205016 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:25:44.205090 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:44.205092 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:44.206556 (+ 1464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:44.206556 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:44.207555 (+ 999us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:44.207557 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:44.208556 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:44.208557 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:44.208634 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:44.208638 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 15:25:44.208688 (+ 50us) client_negotiation.cc:240] Negotiation successful
0810 15:25:44.208736 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":186,"mutex_wait_us":41,"thread_start_us":51,"threads_started":1}
I20260810 15:25:44.209219 26857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:44.204416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39208 (local address 127.18.68.131:46617)
0810 15:25:44.204813 (+ 397us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:44.204818 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:44.204831 (+ 13us) server_negotiation.cc:407] Connection header received
0810 15:25:44.204876 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:44.204878 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:44.204895 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:44.204993 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:25:44.205190 (+ 197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:44.206431 (+ 1241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:44.207656 (+ 1225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:44.208382 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:44.208457 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:44.208515 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:44.208810 (+ 295us) server_negotiation.cc:299] Negotiation successful
0810 15:25:44.208853 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":358,"thread_start_us":150,"threads_started":1}
I20260810 15:25:44.209452 26853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:44.204273 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.129:35977 (local address 127.0.0.1:54394)
0810 15:25:44.204875 (+ 602us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:44.204917 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:44.204975 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:44.205260 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:44.205260 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:44.205262 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:25:44.205320 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:44.205321 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:44.206451 (+ 1130us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:44.206452 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:44.207771 (+ 1319us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:44.207774 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:44.208468 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:44.208469 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:44.208562 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:44.208578 (+ 16us) client_negotiation.cc:769] Sending connection context
0810 15:25:44.208650 (+ 72us) client_negotiation.cc:240] Negotiation successful
0810 15:25:44.208709 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":587,"thread_start_us":108,"threads_started":1}
I20260810 15:25:44.209877 26506 tablet_service.cc:1467] Processing CreateTablet for tablet 7bcf4a4052d94cf28e04710cedeefa31 (DEFAULT_TABLE table=test-table [id=7c5e05c8df8c4b8592eae99712106bde]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 15:25:44.209877 26720 tablet_service.cc:1467] Processing CreateTablet for tablet 7bcf4a4052d94cf28e04710cedeefa31 (DEFAULT_TABLE table=test-table [id=7c5e05c8df8c4b8592eae99712106bde]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 15:25:44.210300 26506 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7bcf4a4052d94cf28e04710cedeefa31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:25:44.210304 26720 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7bcf4a4052d94cf28e04710cedeefa31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:25:44.210739 26273 tablet_service.cc:1467] Processing CreateTablet for tablet 7bcf4a4052d94cf28e04710cedeefa31 (DEFAULT_TABLE table=test-table [id=7c5e05c8df8c4b8592eae99712106bde]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 15:25:44.210987 26273 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7bcf4a4052d94cf28e04710cedeefa31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:25:44.213581 26864 tablet_bootstrap.cc:492] T 7bcf4a4052d94cf28e04710cedeefa31 P d995649e22234a878339646b47fe6e71: Bootstrap starting.
I20260810 15:25:44.214177 26866 tablet_bootstrap.cc:492] T 7bcf4a4052d94cf28e04710cedeefa31 P f6433573d14f4240b5ab79d4cd0fc5cf: Bootstrap starting.
I20260810 15:25:44.214219 26870 tablet_bootstrap.cc:492] T 7bcf4a4052d94cf28e04710cedeefa31 P cd7decda01e84f4b92180f97c8c81991: Bootstrap starting.
I20260810 15:25:44.214329 26864 tablet_bootstrap.cc:654] T 7bcf4a4052d94cf28e04710cedeefa31 P d995649e22234a878339646b47fe6e71: Neither blocks nor log segments found. Creating new log.
I20260810 15:25:44.214807 26870 tablet_bootstrap.cc:654] T 7bcf4a4052d94cf28e04710cedeefa31 P cd7decda01e84f4b92180f97c8c81991: Neither blocks nor log segments found. Creating new log.
I20260810 15:25:44.214970 26864 log.cc:824] T 7bcf4a4052d94cf28e04710cedeefa31 P d995649e22234a878339646b47fe6e71: Log is configured to *not* fsync() on all Append() calls
I20260810 15:25:44.215080 26866 tablet_bootstrap.cc:654] T 7bcf4a4052d94cf28e04710cedeefa31 P f6433573d14f4240b5ab79d4cd0fc5cf: Neither blocks nor log segments found. Creating new log.
I20260810 15:25:44.215443 26870 log.cc:824] T 7bcf4a4052d94cf28e04710cedeefa31 P cd7decda01e84f4b92180f97c8c81991: Log is configured to *not* fsync() on all Append() calls
I20260810 15:25:44.215646 26866 log.cc:824] T 7bcf4a4052d94cf28e04710cedeefa31 P f6433573d14f4240b5ab79d4cd0fc5cf: Log is configured to *not* fsync() on all Append() calls
I20260810 15:25:44.215948 26864 tablet_bootstrap.cc:492] T 7bcf4a4052d94cf28e04710cedeefa31 P d995649e22234a878339646b47fe6e71: No bootstrap required, opened a new log
I20260810 15:25:44.216032 26864 ts_tablet_manager.cc:1397] T 7bcf4a4052d94cf28e04710cedeefa31 P d995649e22234a878339646b47fe6e71: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260810 15:25:44.216207 26870 tablet_bootstrap.cc:492] T 7bcf4a4052d94cf28e04710cedeefa31 P cd7decda01e84f4b92180f97c8c81991: No bootstrap required, opened a new log
I20260810 15:25:44.216284 26870 ts_tablet_manager.cc:1397] T 7bcf4a4052d94cf28e04710cedeefa31 P cd7decda01e84f4b92180f97c8c81991: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 15:25:44.216399 26866 tablet_bootstrap.cc:492] T 7bcf4a4052d94cf28e04710cedeefa31 P f6433573d14f4240b5ab79d4cd0fc5cf: No bootstrap required, opened a new log
I20260810 15:25:44.216467 26866 ts_tablet_manager.cc:1397] T 7bcf4a4052d94cf28e04710cedeefa31 P f6433573d14f4240b5ab79d4cd0fc5cf: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260810 15:25:44.217756 26870 raft_consensus.cc:348] T 7bcf4a4052d94cf28e04710cedeefa31 P cd7decda01e84f4b92180f97c8c81991 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd7decda01e84f4b92180f97c8c81991" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 46617 } } peers { permanent_uuid: "f6433573d14f4240b5ab79d4cd0fc5cf" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 32799 } } peers { permanent_uuid: "d995649e22234a878339646b47fe6e71" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35977 } }
I20260810 15:25:44.217911 26870 raft_consensus.cc:374] T 7bcf4a4052d94cf28e04710cedeefa31 P cd7decda01e84f4b92180f97c8c81991 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:25:44.217957 26870 raft_consensus.cc:729] T 7bcf4a4052d94cf28e04710cedeefa31 P cd7decda01e84f4b92180f97c8c81991 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd7decda01e84f4b92180f97c8c81991, State: Initialized, Role: FOLLOWER
I20260810 15:25:44.218115 26870 consensus_queue.cc:260] T 7bcf4a4052d94cf28e04710cedeefa31 P cd7decda01e84f4b92180f97c8c81991 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd7decda01e84f4b92180f97c8c81991" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 46617 } } peers { permanent_uuid: "f6433573d14f4240b5ab79d4cd0fc5cf" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 32799 } } peers { permanent_uuid: "d995649e22234a878339646b47fe6e71" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35977 } }
I20260810 15:25:44.218196 26864 raft_consensus.cc:348] T 7bcf4a4052d94cf28e04710cedeefa31 P d995649e22234a878339646b47fe6e71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd7decda01e84f4b92180f97c8c81991" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 46617 } } peers { permanent_uuid: "f6433573d14f4240b5ab79d4cd0fc5cf" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 32799 } } peers { permanent_uuid: "d995649e22234a878339646b47fe6e71" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35977 } }
I20260810 15:25:44.218371 26864 raft_consensus.cc:374] T 7bcf4a4052d94cf28e04710cedeefa31 P d995649e22234a878339646b47fe6e71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:25:44.218415 26864 raft_consensus.cc:729] T 7bcf4a4052d94cf28e04710cedeefa31 P d995649e22234a878339646b47fe6e71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d995649e22234a878339646b47fe6e71, State: Initialized, Role: FOLLOWER
I20260810 15:25:44.218423 26870 ts_tablet_manager.cc:1428] T 7bcf4a4052d94cf28e04710cedeefa31 P cd7decda01e84f4b92180f97c8c81991: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 15:25:44.218551 26833 heartbeater.cc:503] Master 127.18.68.190:46023 was elected leader, sending a full tablet report...
I20260810 15:25:44.218535 26864 consensus_queue.cc:260] T 7bcf4a4052d94cf28e04710cedeefa31 P d995649e22234a878339646b47fe6e71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd7decda01e84f4b92180f97c8c81991" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 46617 } } peers { permanent_uuid: "f6433573d14f4240b5ab79d4cd0fc5cf" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 32799 } } peers { permanent_uuid: "d995649e22234a878339646b47fe6e71" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35977 } }
I20260810 15:25:44.218483 26866 raft_consensus.cc:348] T 7bcf4a4052d94cf28e04710cedeefa31 P f6433573d14f4240b5ab79d4cd0fc5cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd7decda01e84f4b92180f97c8c81991" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 46617 } } peers { permanent_uuid: "f6433573d14f4240b5ab79d4cd0fc5cf" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 32799 } } peers { permanent_uuid: "d995649e22234a878339646b47fe6e71" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35977 } }
I20260810 15:25:44.218629 26866 raft_consensus.cc:374] T 7bcf4a4052d94cf28e04710cedeefa31 P f6433573d14f4240b5ab79d4cd0fc5cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:25:44.218680 26866 raft_consensus.cc:729] T 7bcf4a4052d94cf28e04710cedeefa31 P f6433573d14f4240b5ab79d4cd0fc5cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6433573d14f4240b5ab79d4cd0fc5cf, State: Initialized, Role: FOLLOWER
I20260810 15:25:44.218796 26864 ts_tablet_manager.cc:1428] T 7bcf4a4052d94cf28e04710cedeefa31 P d995649e22234a878339646b47fe6e71: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 15:25:44.218796 26866 consensus_queue.cc:260] T 7bcf4a4052d94cf28e04710cedeefa31 P f6433573d14f4240b5ab79d4cd0fc5cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd7decda01e84f4b92180f97c8c81991" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 46617 } } peers { permanent_uuid: "f6433573d14f4240b5ab79d4cd0fc5cf" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 32799 } } peers { permanent_uuid: "d995649e22234a878339646b47fe6e71" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35977 } }
I20260810 15:25:44.218914 26385 heartbeater.cc:503] Master 127.18.68.190:46023 was elected leader, sending a full tablet report...
I20260810 15:25:44.219070 26866 ts_tablet_manager.cc:1428] T 7bcf4a4052d94cf28e04710cedeefa31 P f6433573d14f4240b5ab79d4cd0fc5cf: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260810 15:25:44.219393 26608 heartbeater.cc:503] Master 127.18.68.190:46023 was elected leader, sending a full tablet report...
W20260810 15:25:44.271381 26612 tablet.cc:2369] T 7bcf4a4052d94cf28e04710cedeefa31 P f6433573d14f4240b5ab79d4cd0fc5cf: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 15:25:44.321668 26877 raft_consensus.cc:482] T 7bcf4a4052d94cf28e04710cedeefa31 P cd7decda01e84f4b92180f97c8c81991 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 15:25:44.321798 26877 raft_consensus.cc:504] T 7bcf4a4052d94cf28e04710cedeefa31 P cd7decda01e84f4b92180f97c8c81991 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd7decda01e84f4b92180f97c8c81991" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 46617 } } peers { permanent_uuid: "f6433573d14f4240b5ab79d4cd0fc5cf" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 32799 } } peers { permanent_uuid: "d995649e22234a878339646b47fe6e71" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35977 } }
I20260810 15:25:44.322228 26877 leader_election.cc:288] T 7bcf4a4052d94cf28e04710cedeefa31 P cd7decda01e84f4b92180f97c8c81991 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f6433573d14f4240b5ab79d4cd0fc5cf (127.18.68.130:32799), d995649e22234a878339646b47fe6e71 (127.18.68.129:35977)
I20260810 15:25:44.325098 26861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:44.322502 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.131:43261 (local address 127.18.68.129:35977)
0810 15:25:44.322572 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:44.322575 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:44.322586 (+ 11us) server_negotiation.cc:407] Connection header received
0810 15:25:44.322684 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:44.322685 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:44.322693 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:44.322750 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:25:44.322922 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:44.323396 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:44.324357 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:44.324741 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:44.324828 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:44.324836 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:44.324989 (+ 153us) server_negotiation.cc:299] Negotiation successful
0810 15:25:44.325026 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260810 15:25:44.325098 26836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:44.322411 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.129:35977 (local address 127.18.68.131:43261)
0810 15:25:44.322464 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:44.322479 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:44.322583 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:44.322771 (+ 188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:44.322772 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:44.322773 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:25:44.322849 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:44.322851 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:44.323481 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:44.323482 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:44.324257 (+ 775us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:44.324259 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:44.324825 (+ 566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:44.324826 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:44.324910 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:44.324913 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 15:25:44.324983 (+ 70us) client_negotiation.cc:240] Negotiation successful
0810 15:25:44.325028 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28}
I20260810 15:25:44.325248 26859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:44.322573 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.131:52667 (local address 127.18.68.130:32799)
0810 15:25:44.322637 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:44.322638 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:44.322801 (+ 163us) server_negotiation.cc:407] Connection header received
0810 15:25:44.322873 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:44.322874 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:44.322884 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:44.322965 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:25:44.323127 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:44.323582 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:44.324520 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:44.324895 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:44.324981 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:44.324989 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:44.325144 (+ 155us) server_negotiation.cc:299] Negotiation successful
0810 15:25:44.325182 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260810 15:25:44.325268 26880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:44.322411 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.130:32799 (local address 127.18.68.131:52667)
0810 15:25:44.322722 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:44.322731 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:44.322814 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:44.322972 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:44.322973 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:44.322975 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:25:44.323052 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:44.323054 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:44.323668 (+ 614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:44.323669 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:44.324409 (+ 740us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:44.324410 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:44.324992 (+ 582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:44.324994 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:44.325068 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:44.325071 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 15:25:44.325139 (+ 68us) client_negotiation.cc:240] Negotiation successful
0810 15:25:44.325178 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":293,"mutex_wait_us":142,"thread_start_us":95,"threads_started":1}
I20260810 15:25:44.325455 26311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7bcf4a4052d94cf28e04710cedeefa31" candidate_uuid: "cd7decda01e84f4b92180f97c8c81991" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d995649e22234a878339646b47fe6e71" is_pre_election: true
I20260810 15:25:44.325635 26311 raft_consensus.cc:2454] T 7bcf4a4052d94cf28e04710cedeefa31 P d995649e22234a878339646b47fe6e71 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd7decda01e84f4b92180f97c8c81991 in term 0.
I20260810 15:25:44.325609 26537 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7bcf4a4052d94cf28e04710cedeefa31" candidate_uuid: "cd7decda01e84f4b92180f97c8c81991" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6433573d14f4240b5ab79d4cd0fc5cf" is_pre_election: true
I20260810 15:25:44.325742 26537 raft_consensus.cc:2454] T 7bcf4a4052d94cf28e04710cedeefa31 P f6433573d14f4240b5ab79d4cd0fc5cf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd7decda01e84f4b92180f97c8c81991 in term 0.
I20260810 15:25:44.325901 26644 leader_election.cc:302] T 7bcf4a4052d94cf28e04710cedeefa31 P cd7decda01e84f4b92180f97c8c81991 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd7decda01e84f4b92180f97c8c81991, d995649e22234a878339646b47fe6e71; no voters:
I20260810 15:25:44.326032 26877 raft_consensus.cc:2781] T 7bcf4a4052d94cf28e04710cedeefa31 P cd7decda01e84f4b92180f97c8c81991 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 15:25:44.326148 26877 raft_consensus.cc:482] T 7bcf4a4052d94cf28e04710cedeefa31 P cd7decda01e84f4b92180f97c8c81991 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 15:25:44.326188 26877 raft_consensus.cc:3037] T 7bcf4a4052d94cf28e04710cedeefa31 P cd7decda01e84f4b92180f97c8c81991 [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:25:44.326941 26877 raft_consensus.cc:504] T 7bcf4a4052d94cf28e04710cedeefa31 P cd7decda01e84f4b92180f97c8c81991 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd7decda01e84f4b92180f97c8c81991" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 46617 } } peers { permanent_uuid: "f6433573d14f4240b5ab79d4cd0fc5cf" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 32799 } } peers { permanent_uuid: "d995649e22234a878339646b47fe6e71" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35977 } }
I20260810 15:25:44.327095 26877 leader_election.cc:288] T 7bcf4a4052d94cf28e04710cedeefa31 P cd7decda01e84f4b92180f97c8c81991 [CANDIDATE]: Term 1 election: Requested vote from peers f6433573d14f4240b5ab79d4cd0fc5cf (127.18.68.130:32799), d995649e22234a878339646b47fe6e71 (127.18.68.129:35977)
I20260810 15:25:44.327317 26311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7bcf4a4052d94cf28e04710cedeefa31" candidate_uuid: "cd7decda01e84f4b92180f97c8c81991" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d995649e22234a878339646b47fe6e71"
I20260810 15:25:44.327314 26537 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7bcf4a4052d94cf28e04710cedeefa31" candidate_uuid: "cd7decda01e84f4b92180f97c8c81991" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6433573d14f4240b5ab79d4cd0fc5cf"
I20260810 15:25:44.327399 26311 raft_consensus.cc:3037] T 7bcf4a4052d94cf28e04710cedeefa31 P d995649e22234a878339646b47fe6e71 [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:25:44.327400 26537 raft_consensus.cc:3037] T 7bcf4a4052d94cf28e04710cedeefa31 P f6433573d14f4240b5ab79d4cd0fc5cf [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:25:44.328294 26311 raft_consensus.cc:2454] T 7bcf4a4052d94cf28e04710cedeefa31 P d995649e22234a878339646b47fe6e71 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd7decda01e84f4b92180f97c8c81991 in term 1.
I20260810 15:25:44.328294 26537 raft_consensus.cc:2454] T 7bcf4a4052d94cf28e04710cedeefa31 P f6433573d14f4240b5ab79d4cd0fc5cf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd7decda01e84f4b92180f97c8c81991 in term 1.
I20260810 15:25:44.328475 26644 leader_election.cc:302] T 7bcf4a4052d94cf28e04710cedeefa31 P cd7decda01e84f4b92180f97c8c81991 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd7decda01e84f4b92180f97c8c81991, d995649e22234a878339646b47fe6e71; no voters:
I20260810 15:25:44.328578 26877 raft_consensus.cc:2781] T 7bcf4a4052d94cf28e04710cedeefa31 P cd7decda01e84f4b92180f97c8c81991 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 15:25:44.328750 26877 raft_consensus.cc:686] T 7bcf4a4052d94cf28e04710cedeefa31 P cd7decda01e84f4b92180f97c8c81991 [term 1 LEADER]: Becoming Leader. State: Replica: cd7decda01e84f4b92180f97c8c81991, State: Running, Role: LEADER
I20260810 15:25:44.328886 26877 consensus_queue.cc:237] T 7bcf4a4052d94cf28e04710cedeefa31 P cd7decda01e84f4b92180f97c8c81991 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd7decda01e84f4b92180f97c8c81991" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 46617 } } peers { permanent_uuid: "f6433573d14f4240b5ab79d4cd0fc5cf" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 32799 } } peers { permanent_uuid: "d995649e22234a878339646b47fe6e71" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35977 } }
I20260810 15:25:44.329810 26052 catalog_manager.cc:5495] T 7bcf4a4052d94cf28e04710cedeefa31 P cd7decda01e84f4b92180f97c8c81991 reported cstate change: term changed from 0 to 1, leader changed from <none> to cd7decda01e84f4b92180f97c8c81991 (127.18.68.131). New cstate: current_term: 1 leader_uuid: "cd7decda01e84f4b92180f97c8c81991" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd7decda01e84f4b92180f97c8c81991" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 46617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6433573d14f4240b5ab79d4cd0fc5cf" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 32799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d995649e22234a878339646b47fe6e71" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35977 } health_report { overall_health: UNKNOWN } } }
W20260810 15:25:44.354034 26386 tablet.cc:2369] T 7bcf4a4052d94cf28e04710cedeefa31 P d995649e22234a878339646b47fe6e71: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 15:25:44.354931 26857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:44.352389 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39218 (local address 127.18.68.131:46617)
0810 15:25:44.352456 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:44.352458 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:44.352467 (+ 9us) server_negotiation.cc:407] Connection header received
0810 15:25:44.352503 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:44.352503 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:44.352524 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:44.352594 (+ 70us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 15:25:44.352740 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:44.353246 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:44.354134 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:44.354435 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:44.354496 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:44.354650 (+ 154us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 15:25:44.354743 (+ 93us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 15:25:44.354804 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:44.354843 (+ 39us) server_negotiation.cc:299] Negotiation successful
0810 15:25:44.354861 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260810 15:25:44.356854 26311 raft_consensus.cc:1261] T 7bcf4a4052d94cf28e04710cedeefa31 P d995649e22234a878339646b47fe6e71 [term 1 FOLLOWER]: Refusing update from remote peer cd7decda01e84f4b92180f97c8c81991: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 15:25:44.356856 26537 raft_consensus.cc:1261] T 7bcf4a4052d94cf28e04710cedeefa31 P f6433573d14f4240b5ab79d4cd0fc5cf [term 1 FOLLOWER]: Refusing update from remote peer cd7decda01e84f4b92180f97c8c81991: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 15:25:44.357216 26877 consensus_queue.cc:1035] T 7bcf4a4052d94cf28e04710cedeefa31 P cd7decda01e84f4b92180f97c8c81991 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d995649e22234a878339646b47fe6e71" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 15:25:44.357375 26881 consensus_queue.cc:1035] T 7bcf4a4052d94cf28e04710cedeefa31 P cd7decda01e84f4b92180f97c8c81991 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6433573d14f4240b5ab79d4cd0fc5cf" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 32799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 15:25:44.360353 26887 mvcc.cc:205] Tried to move back new op lower bound from 7316994229682757632 to 7316994229571764224. Current Snapshot: MvccSnapshot[applied={T|T < 7316994229682757632}]
I20260810 15:25:44.361066 26886 mvcc.cc:205] Tried to move back new op lower bound from 7316994229682757632 to 7316994229571764224. Current Snapshot: MvccSnapshot[applied={T|T < 7316994229682757632}]
I20260810 15:25:44.362624 26052 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54854:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 15:25:44.362716 26052 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54854:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 15:25:44.363528 26052 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1b4c584d7a3145a29a37cf2f5fbb02e0: Sending DeleteTablet for 3 replicas of tablet 7bcf4a4052d94cf28e04710cedeefa31
I20260810 15:25:44.363879 26273 tablet_service.cc:1514] Processing DeleteTablet for tablet 7bcf4a4052d94cf28e04710cedeefa31 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 15:25:44 UTC) from {username='kudu', principal='kudu/127.18.68.190@KRBTEST.COM'} at 127.0.0.1:54394
I20260810 15:25:44.363921 26506 tablet_service.cc:1514] Processing DeleteTablet for tablet 7bcf4a4052d94cf28e04710cedeefa31 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 15:25:44 UTC) from {username='kudu', principal='kudu/127.18.68.190@KRBTEST.COM'} at 127.0.0.1:54690
I20260810 15:25:44.363955 26720 tablet_service.cc:1514] Processing DeleteTablet for tablet 7bcf4a4052d94cf28e04710cedeefa31 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 15:25:44 UTC) from {username='kudu', principal='kudu/127.18.68.190@KRBTEST.COM'} at 127.0.0.1:39208
I20260810 15:25:44.364145 26903 tablet_replica.cc:330] T 7bcf4a4052d94cf28e04710cedeefa31 P f6433573d14f4240b5ab79d4cd0fc5cf: stopping tablet replica
I20260810 15:25:44.364166 26904 tablet_replica.cc:330] T 7bcf4a4052d94cf28e04710cedeefa31 P cd7decda01e84f4b92180f97c8c81991: stopping tablet replica
I20260810 15:25:44.364274 26904 raft_consensus.cc:2229] T 7bcf4a4052d94cf28e04710cedeefa31 P cd7decda01e84f4b92180f97c8c81991 [term 1 LEADER]: Raft consensus shutting down.
I20260810 15:25:44.364300 26903 raft_consensus.cc:2229] T 7bcf4a4052d94cf28e04710cedeefa31 P f6433573d14f4240b5ab79d4cd0fc5cf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 15:25:44.364382 26904 raft_consensus.cc:2258] T 7bcf4a4052d94cf28e04710cedeefa31 P cd7decda01e84f4b92180f97c8c81991 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 15:25:44.364550 26903 raft_consensus.cc:2258] T 7bcf4a4052d94cf28e04710cedeefa31 P f6433573d14f4240b5ab79d4cd0fc5cf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 15:25:44.364621 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 26149
I20260810 15:25:44.365425 26904 ts_tablet_manager.cc:1905] T 7bcf4a4052d94cf28e04710cedeefa31 P cd7decda01e84f4b92180f97c8c81991: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 15:25:44.367202 26904 ts_tablet_manager.cc:1918] T 7bcf4a4052d94cf28e04710cedeefa31 P cd7decda01e84f4b92180f97c8c81991: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 15:25:44.367271 26904 log.cc:1196] T 7bcf4a4052d94cf28e04710cedeefa31 P cd7decda01e84f4b92180f97c8c81991: Deleting WAL directory at /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786375520124696-18706-0/minicluster-data/ts-2/wal/wals/7bcf4a4052d94cf28e04710cedeefa31
I20260810 15:25:44.367548 26904 ts_tablet_manager.cc:1939] T 7bcf4a4052d94cf28e04710cedeefa31 P cd7decda01e84f4b92180f97c8c81991: Deleting consensus metadata
I20260810 15:25:44.369323 26903 ts_tablet_manager.cc:1905] T 7bcf4a4052d94cf28e04710cedeefa31 P f6433573d14f4240b5ab79d4cd0fc5cf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 15:25:44.371573 26903 ts_tablet_manager.cc:1918] T 7bcf4a4052d94cf28e04710cedeefa31 P f6433573d14f4240b5ab79d4cd0fc5cf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 15:25:44.371757 26903 log.cc:1196] T 7bcf4a4052d94cf28e04710cedeefa31 P f6433573d14f4240b5ab79d4cd0fc5cf: Deleting WAL directory at /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786375520124696-18706-0/minicluster-data/ts-1/wal/wals/7bcf4a4052d94cf28e04710cedeefa31
I20260810 15:25:44.371989 26027 catalog_manager.cc:4841] TS cd7decda01e84f4b92180f97c8c81991 (127.18.68.131:46617): tablet 7bcf4a4052d94cf28e04710cedeefa31 (table test-table [id=7c5e05c8df8c4b8592eae99712106bde]) successfully deleted
I20260810 15:25:44.372042 26903 ts_tablet_manager.cc:1939] T 7bcf4a4052d94cf28e04710cedeefa31 P f6433573d14f4240b5ab79d4cd0fc5cf: Deleting consensus metadata
I20260810 15:25:44.372502 26027 catalog_manager.cc:4841] TS f6433573d14f4240b5ab79d4cd0fc5cf (127.18.68.130:32799): tablet 7bcf4a4052d94cf28e04710cedeefa31 (table test-table [id=7c5e05c8df8c4b8592eae99712106bde]) successfully deleted
W20260810 15:25:44.377288 26026 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.18.68.129:35977 (error 108)
I20260810 15:25:44.377516 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 26393
I20260810 15:25:44.390887 26853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:44.390693 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.129:35977 (local address 127.0.0.1:54400)
0810 15:25:44.390763 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:44.390830 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.129:35977: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260810 15:25:44.391065 26026 catalog_manager.cc:4584] TS d995649e22234a878339646b47fe6e71 (127.18.68.129:35977): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 7bcf4a4052d94cf28e04710cedeefa31: Network error: Client connection negotiation failed: client connection to 127.18.68.129:35977: connect: Connection refused (error 111)
I20260810 15:25:44.395058 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 26620
I20260810 15:25:44.410691 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 26000
2026-08-10T15:25:44Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (2321 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-10T15:25:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T15:25:44Z Disabled control of system clock
I20260810 15:25:44.447609 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786375520124696-18706-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786375520124696-18706-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786375520124696-18706-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.190:36881
--webserver_interface=127.18.68.190
--webserver_port=0
--builtin_ntp_servers=127.18.68.148:35053
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.68.190:36881
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260810 15:25:44.529711 26909 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:25:44.529933 26909 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:25:44.529956 26909 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:25:44.531129 26909 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 15:25:44.531181 26909 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:25:44.531194 26909 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:25:44.531208 26909 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 15:25:44.531219 26909 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 15:25:44.532521 26909 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:35053
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786375520124696-18706-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786375520124696-18706-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.68.190:36881
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.190:36881
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.68.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26909
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786375520124696-18706-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:25:44.532718 26909 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:25:44.532974 26909 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:25:44.537993 26923 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:44.538136 26921 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:25:44.538271 26909 server_base.cc:1034] running on GCE node
W20260810 15:25:44.538360 26920 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:25:44.538628 26909 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:25:44.538936 26909 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:25:44.540079 26909 hybrid_clock.cc:648] HybridClock initialized: now 1786375544540057 us; error 39 us; skew 500 ppm
I20260810 15:25:44.544796 26909 webserver.cc:460] Webserver started at http://127.18.68.190:41915/ using document root <none> and password file <none>
I20260810 15:25:44.545132 26909 fs_manager.cc:359] Metadata directory not provided
I20260810 15:25:44.545217 26909 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:25:44.545382 26909 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:25:44.546590 26909 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786375520124696-18706-0/minicluster-data/master-0/data/instance:
uuid: "593fd1f5d1474ea3a5872a0a3ef04869"
format_stamp: "Formatted at 2026-08-10 15:25:44 on dist-test-slave-2p8l"
server_key: "7e1f2bbc984ad57e5fb31af10389eec1"
server_key_iv: "bb39963927bc1f064f2d00e31ba39d2d"
server_key_version: "encryptionkey@0"
I20260810 15:25:44.546978 26909 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786375520124696-18706-0/minicluster-data/master-0/wal/instance:
uuid: "593fd1f5d1474ea3a5872a0a3ef04869"
format_stamp: "Formatted at 2026-08-10 15:25:44 on dist-test-slave-2p8l"
server_key: "7e1f2bbc984ad57e5fb31af10389eec1"
server_key_iv: "bb39963927bc1f064f2d00e31ba39d2d"
server_key_version: "encryptionkey@0"
I20260810 15:25:44.548390 26909 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 15:25:44.549270 26933 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:44.549511 26909 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:25:44.549644 26909 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786375520124696-18706-0/minicluster-data/master-0/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786375520124696-18706-0/minicluster-data/master-0/wal
uuid: "593fd1f5d1474ea3a5872a0a3ef04869"
format_stamp: "Formatted at 2026-08-10 15:25:44 on dist-test-slave-2p8l"
server_key: "7e1f2bbc984ad57e5fb31af10389eec1"
server_key_iv: "bb39963927bc1f064f2d00e31ba39d2d"
server_key_version: "encryptionkey@0"
I20260810 15:25:44.549742 26909 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786375520124696-18706-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786375520124696-18706-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786375520124696-18706-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:25:44.553296 26909 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:25:44.553584 26909 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:25:44.553742 26909 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:25:44.557894 26909 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.190:36881
I20260810 15:25:44.557926 27023 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.190:36881 every 8 connection(s)
I20260810 15:25:44.558336 26909 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
I20260810 15:25:44.559039 27024 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:25:44.561985 27024 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 593fd1f5d1474ea3a5872a0a3ef04869: Bootstrap starting.
I20260810 15:25:44.562418 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 26909
I20260810 15:25:44.562534 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786375520124696-18706-0/minicluster-data/master-0/wal/instance
I20260810 15:25:44.562724 18706 external_mini_cluster.cc:1428] Setting key 54350196b260ff54759930db29a3c4eb
I20260810 15:25:44.562748 27024 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 593fd1f5d1474ea3a5872a0a3ef04869: Neither blocks nor log segments found. Creating new log.
I20260810 15:25:44.563041 27024 log.cc:824] T 00000000000000000000000000000000 P 593fd1f5d1474ea3a5872a0a3ef04869: Log is configured to *not* fsync() on all Append() calls
I20260810 15:25:44.563926 27024 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 593fd1f5d1474ea3a5872a0a3ef04869: No bootstrap required, opened a new log
I20260810 15:25:44.565227 27029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:44.563230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56852 (local address 127.18.68.190:36881)
0810 15:25:44.563394 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:44.563402 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:44.563437 (+ 35us) server_negotiation.cc:407] Connection header received
0810 15:25:44.563837 (+ 400us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:44.563843 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:44.563877 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:44.564026 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:44.564745 (+ 719us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:44.564748 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:44.564748 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 15:25:44.564752 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:44.564791 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 15:25:44.564801 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:44.564882 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:44.564949 (+ 67us) server_negotiation.cc:299] Negotiation successful
0810 15:25:44.565019 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91,"thread_start_us":66,"threads_started":1}
I20260810 15:25:44.565891 27024 raft_consensus.cc:348] T 00000000000000000000000000000000 P 593fd1f5d1474ea3a5872a0a3ef04869 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "593fd1f5d1474ea3a5872a0a3ef04869" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 36881 } }
I20260810 15:25:44.566102 27024 raft_consensus.cc:374] T 00000000000000000000000000000000 P 593fd1f5d1474ea3a5872a0a3ef04869 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:25:44.566152 27024 raft_consensus.cc:729] T 00000000000000000000000000000000 P 593fd1f5d1474ea3a5872a0a3ef04869 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 593fd1f5d1474ea3a5872a0a3ef04869, State: Initialized, Role: FOLLOWER
I20260810 15:25:44.566246 27024 consensus_queue.cc:260] T 00000000000000000000000000000000 P 593fd1f5d1474ea3a5872a0a3ef04869 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "593fd1f5d1474ea3a5872a0a3ef04869" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 36881 } }
I20260810 15:25:44.566313 27024 raft_consensus.cc:388] T 00000000000000000000000000000000 P 593fd1f5d1474ea3a5872a0a3ef04869 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 15:25:44.566335 27024 raft_consensus.cc:482] T 00000000000000000000000000000000 P 593fd1f5d1474ea3a5872a0a3ef04869 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 15:25:44.566362 27024 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 593fd1f5d1474ea3a5872a0a3ef04869 [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:25:44.567204 27024 raft_consensus.cc:504] T 00000000000000000000000000000000 P 593fd1f5d1474ea3a5872a0a3ef04869 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "593fd1f5d1474ea3a5872a0a3ef04869" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 36881 } }
I20260810 15:25:44.567296 27024 leader_election.cc:302] T 00000000000000000000000000000000 P 593fd1f5d1474ea3a5872a0a3ef04869 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 593fd1f5d1474ea3a5872a0a3ef04869; no voters:
I20260810 15:25:44.567422 27024 leader_election.cc:288] T 00000000000000000000000000000000 P 593fd1f5d1474ea3a5872a0a3ef04869 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 15:25:44.567497 27031 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 593fd1f5d1474ea3a5872a0a3ef04869 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 15:25:44.567692 27031 raft_consensus.cc:686] T 00000000000000000000000000000000 P 593fd1f5d1474ea3a5872a0a3ef04869 [term 1 LEADER]: Becoming Leader. State: Replica: 593fd1f5d1474ea3a5872a0a3ef04869, State: Running, Role: LEADER
I20260810 15:25:44.567747 27024 sys_catalog.cc:564] T 00000000000000000000000000000000 P 593fd1f5d1474ea3a5872a0a3ef04869 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 15:25:44.567801 27031 consensus_queue.cc:237] T 00000000000000000000000000000000 P 593fd1f5d1474ea3a5872a0a3ef04869 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "593fd1f5d1474ea3a5872a0a3ef04869" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 36881 } }
I20260810 15:25:44.568192 27032 sys_catalog.cc:455] T 00000000000000000000000000000000 P 593fd1f5d1474ea3a5872a0a3ef04869 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "593fd1f5d1474ea3a5872a0a3ef04869" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "593fd1f5d1474ea3a5872a0a3ef04869" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 36881 } } }
I20260810 15:25:44.568193 27033 sys_catalog.cc:455] T 00000000000000000000000000000000 P 593fd1f5d1474ea3a5872a0a3ef04869 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 593fd1f5d1474ea3a5872a0a3ef04869. Latest consensus state: current_term: 1 leader_uuid: "593fd1f5d1474ea3a5872a0a3ef04869" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "593fd1f5d1474ea3a5872a0a3ef04869" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 36881 } } }
I20260810 15:25:44.568323 27033 sys_catalog.cc:458] T 00000000000000000000000000000000 P 593fd1f5d1474ea3a5872a0a3ef04869 [sys.catalog]: This master's current role is: LEADER
I20260810 15:25:44.568514 27032 sys_catalog.cc:458] T 00000000000000000000000000000000 P 593fd1f5d1474ea3a5872a0a3ef04869 [sys.catalog]: This master's current role is: LEADER
I20260810 15:25:44.568867 27041 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 15:25:44.569337 27041 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 15:25:44.570950 27041 catalog_manager.cc:1347] Generated new cluster ID: bc77592bcefe4c7292c5b432a14915cb
I20260810 15:25:44.571012 27041 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 15:25:44.578210 27041 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 15:25:44.578368 27041 catalog_manager.cc:1504] Loading token signing keys...
I20260810 15:25:44.584204 27041 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 593fd1f5d1474ea3a5872a0a3ef04869: Generated new TSK 0
I20260810 15:25:44.584393 27041 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 15:25:44.591516 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786375520124696-18706-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786375520124696-18706-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786375520124696-18706-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786375520124696-18706-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.68.129:0
--local_ip_for_outbound_sockets=127.18.68.129
--webserver_interface=127.18.68.129
--webserver_port=0
--tserver_master_addrs=127.18.68.190:36881
--builtin_ntp_servers=127.18.68.148:35053
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260810 15:25:44.675732 27054 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:25:44.675978 27054 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:25:44.676015 27054 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:25:44.677179 27054 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:25:44.677243 27054 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:25:44.677286 27054 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.68.129
I20260810 15:25:44.678758 27054 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:35053
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786375520124696-18706-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786375520124696-18706-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.68.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786375520124696-18706-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.68.129
--webserver_port=0
--tserver_master_addrs=127.18.68.190:36881
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27054
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.68.129
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786375520124696-18706-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:25:44.679026 27054 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:25:44.679340 27054 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:25:44.685082 27064 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:44.685236 27065 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:44.685299 27068 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:25:44.685535 27054 server_base.cc:1034] running on GCE node
I20260810 15:25:44.685786 27054 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:25:44.686033 27054 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:25:44.687234 27054 hybrid_clock.cc:648] HybridClock initialized: now 1786375544687218 us; error 39 us; skew 500 ppm
I20260810 15:25:44.688657 27054 webserver.cc:460] Webserver started at http://127.18.68.129:44721/ using document root <none> and password file <none>
I20260810 15:25:44.688923 27054 fs_manager.cc:359] Metadata directory not provided
I20260810 15:25:44.688998 27054 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:25:44.689165 27054 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:25:44.690351 27054 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786375520124696-18706-0/minicluster-data/ts-0/data/instance:
uuid: "c722d3182a444a71816de7f28577d72c"
format_stamp: "Formatted at 2026-08-10 15:25:44 on dist-test-slave-2p8l"
server_key: "4976a01f03ab4e48ec74b43af099047b"
server_key_iv: "ea2f47a645bb829f03a746ef69851e19"
server_key_version: "encryptionkey@0"
I20260810 15:25:44.690733 27054 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786375520124696-18706-0/minicluster-data/ts-0/wal/instance:
uuid: "c722d3182a444a71816de7f28577d72c"
format_stamp: "Formatted at 2026-08-10 15:25:44 on dist-test-slave-2p8l"
server_key: "4976a01f03ab4e48ec74b43af099047b"
server_key_iv: "ea2f47a645bb829f03a746ef69851e19"
server_key_version: "encryptionkey@0"
I20260810 15:25:44.692194 27054 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 15:25:44.693140 27075 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:44.693361 27054 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:25:44.693487 27054 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786375520124696-18706-0/minicluster-data/ts-0/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786375520124696-18706-0/minicluster-data/ts-0/wal
uuid: "c722d3182a444a71816de7f28577d72c"
format_stamp: "Formatted at 2026-08-10 15:25:44 on dist-test-slave-2p8l"
server_key: "4976a01f03ab4e48ec74b43af099047b"
server_key_iv: "ea2f47a645bb829f03a746ef69851e19"
server_key_version: "encryptionkey@0"
I20260810 15:25:44.693570 27054 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786375520124696-18706-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786375520124696-18706-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786375520124696-18706-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:25:44.697129 27054 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:25:44.697408 27054 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:25:44.697556 27054 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:25:44.697780 27054 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 15:25:44.698158 27054 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 15:25:44.698223 27054 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:44.698262 27054 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 15:25:44.698289 27054 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:44.704267 27054 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.129:39945
I20260810 15:25:44.704341 27268 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.129:39945 every 8 connection(s)
I20260810 15:25:44.704722 27054 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786375520124696-18706-0/minicluster-data/ts-0/data/info.pb
I20260810 15:25:44.707319 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 27054
I20260810 15:25:44.707464 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786375520124696-18706-0/minicluster-data/ts-0/wal/instance
I20260810 15:25:44.707639 18706 external_mini_cluster.cc:1428] Setting key 635c8a3529816462c65e9e10dab32e51
I20260810 15:25:44.708148 27029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:44.705519 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.129:52141 (local address 127.18.68.190:36881)
0810 15:25:44.705595 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:44.705597 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:44.705857 (+ 260us) server_negotiation.cc:407] Connection header received
0810 15:25:44.706419 (+ 562us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:44.706421 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:44.706427 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:44.706481 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:44.707853 (+ 1372us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:44.707855 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:44.707856 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 15:25:44.707860 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:44.707878 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 15:25:44.707883 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:44.707942 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:44.708080 (+ 138us) server_negotiation.cc:299] Negotiation successful
0810 15:25:44.708093 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260810 15:25:44.708379 27272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:44.705516 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:36881 (local address 127.18.68.129:52141)
0810 15:25:44.705725 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:44.705758 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:44.706306 (+ 548us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:44.706570 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:44.706574 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:44.706582 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:25:44.707663 (+ 1081us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 15:25:44.707663 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:25:44.707692 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 15:25:44.707747 (+ 55us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:25:44.707966 (+ 219us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:25:44.707976 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:25:44.707979 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 15:25:44.708077 (+ 98us) client_negotiation.cc:240] Negotiation successful
0810 15:25:44.708144 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":90,"threads_started":1}
I20260810 15:25:44.708871 27270 heartbeater.cc:347] Connected to a master server at 127.18.68.190:36881
I20260810 15:25:44.708977 27270 heartbeater.cc:464] Registering TS with master...
I20260810 15:25:44.708963 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786375520124696-18706-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786375520124696-18706-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786375520124696-18706-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786375520124696-18706-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.68.130:0
--local_ip_for_outbound_sockets=127.18.68.130
--webserver_interface=127.18.68.130
--webserver_port=0
--tserver_master_addrs=127.18.68.190:36881
--builtin_ntp_servers=127.18.68.148:35053
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260810 15:25:44.709157 27270 heartbeater.cc:511] Master 127.18.68.190:36881 requested a full tablet report, sending...
I20260810 15:25:44.709640 26961 ts_manager.cc:194] Registered new tserver with Master: c722d3182a444a71816de7f28577d72c (127.18.68.129:39945)
W20260810 15:25:44.792512 27274 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:25:44.792865 27274 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:25:44.792912 27274 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:25:44.794569 27274 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:25:44.794636 27274 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:25:44.794682 27274 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.68.130
I20260810 15:25:44.796330 27274 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:35053
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786375520124696-18706-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786375520124696-18706-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.68.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786375520124696-18706-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.68.130
--webserver_port=0
--tserver_master_addrs=127.18.68.190:36881
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27274
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.68.130
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786375520124696-18706-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:25:44.796615 27274 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:25:44.796928 27274 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:25:44.802093 27286 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:44.802170 27281 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:44.802171 27282 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:25:44.802289 27274 server_base.cc:1034] running on GCE node
I20260810 15:25:44.802620 27274 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:25:44.802878 27274 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:25:44.804039 27274 hybrid_clock.cc:648] HybridClock initialized: now 1786375544804027 us; error 47 us; skew 500 ppm
I20260810 15:25:44.805332 27274 webserver.cc:460] Webserver started at http://127.18.68.130:41537/ using document root <none> and password file <none>
I20260810 15:25:44.805598 27274 fs_manager.cc:359] Metadata directory not provided
I20260810 15:25:44.805673 27274 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:25:44.805819 27274 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:25:44.806970 27274 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786375520124696-18706-0/minicluster-data/ts-1/data/instance:
uuid: "12e7bb025ee54e17a7d2a420b9c24dd9"
format_stamp: "Formatted at 2026-08-10 15:25:44 on dist-test-slave-2p8l"
server_key: "10a3364b027b4b24af92c4171260576d"
server_key_iv: "482d7f6599a10df0e7c9bb51877df9dd"
server_key_version: "encryptionkey@0"
I20260810 15:25:44.807356 27274 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786375520124696-18706-0/minicluster-data/ts-1/wal/instance:
uuid: "12e7bb025ee54e17a7d2a420b9c24dd9"
format_stamp: "Formatted at 2026-08-10 15:25:44 on dist-test-slave-2p8l"
server_key: "10a3364b027b4b24af92c4171260576d"
server_key_iv: "482d7f6599a10df0e7c9bb51877df9dd"
server_key_version: "encryptionkey@0"
I20260810 15:25:44.808698 27274 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260810 15:25:44.809527 27302 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:44.809734 27274 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 15:25:44.809839 27274 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786375520124696-18706-0/minicluster-data/ts-1/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786375520124696-18706-0/minicluster-data/ts-1/wal
uuid: "12e7bb025ee54e17a7d2a420b9c24dd9"
format_stamp: "Formatted at 2026-08-10 15:25:44 on dist-test-slave-2p8l"
server_key: "10a3364b027b4b24af92c4171260576d"
server_key_iv: "482d7f6599a10df0e7c9bb51877df9dd"
server_key_version: "encryptionkey@0"
I20260810 15:25:44.809926 27274 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786375520124696-18706-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786375520124696-18706-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786375520124696-18706-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:25:44.813292 27274 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:25:44.813566 27274 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:25:44.813714 27274 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:25:44.813926 27274 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 15:25:44.814286 27274 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 15:25:44.814343 27274 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:44.814384 27274 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 15:25:44.814419 27274 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:44.820549 27274 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.130:35299
I20260810 15:25:44.820596 27490 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.130:35299 every 8 connection(s)
I20260810 15:25:44.820932 27274 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786375520124696-18706-0/minicluster-data/ts-1/data/info.pb
I20260810 15:25:44.824025 27029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:44.821661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.130:42097 (local address 127.18.68.190:36881)
0810 15:25:44.821742 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:44.821744 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:44.822020 (+ 276us) server_negotiation.cc:407] Connection header received
0810 15:25:44.822574 (+ 554us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:44.822576 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:44.822582 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:44.822641 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:44.823757 (+ 1116us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:44.823758 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:44.823758 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 15:25:44.823763 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:44.823780 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 15:25:44.823784 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:44.823844 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:44.823938 (+ 94us) server_negotiation.cc:299] Negotiation successful
0810 15:25:44.823954 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260810 15:25:44.824250 27495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:44.821696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:36881 (local address 127.18.68.130:42097)
0810 15:25:44.821888 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:44.821922 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:44.822466 (+ 544us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:44.822714 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:44.822718 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:44.822734 (+ 16us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:25:44.823606 (+ 872us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 15:25:44.823607 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:25:44.823633 (+ 26us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 15:25:44.823662 (+ 29us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:25:44.823844 (+ 182us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:25:44.823850 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:25:44.823853 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 15:25:44.823949 (+ 96us) client_negotiation.cc:240] Negotiation successful
0810 15:25:44.824010 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":81,"threads_started":1}
I20260810 15:25:44.824760 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 27274
I20260810 15:25:44.824812 27491 heartbeater.cc:347] Connected to a master server at 127.18.68.190:36881
I20260810 15:25:44.824885 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786375520124696-18706-0/minicluster-data/ts-1/wal/instance
I20260810 15:25:44.824935 27491 heartbeater.cc:464] Registering TS with master...
I20260810 15:25:44.825083 27491 heartbeater.cc:511] Master 127.18.68.190:36881 requested a full tablet report, sending...
I20260810 15:25:44.825083 18706 external_mini_cluster.cc:1428] Setting key 3a891c612851610e85b8ee3d384a7d47
I20260810 15:25:44.825455 26961 ts_manager.cc:194] Registered new tserver with Master: 12e7bb025ee54e17a7d2a420b9c24dd9 (127.18.68.130:35299)
I20260810 15:25:44.826305 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786375520124696-18706-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786375520124696-18706-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786375520124696-18706-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786375520124696-18706-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.68.131:0
--local_ip_for_outbound_sockets=127.18.68.131
--webserver_interface=127.18.68.131
--webserver_port=0
--tserver_master_addrs=127.18.68.190:36881
--builtin_ntp_servers=127.18.68.148:35053
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260810 15:25:44.910490 27497 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:25:44.910697 27497 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:25:44.910719 27497 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:25:44.911926 27497 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:25:44.911970 27497 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:25:44.911996 27497 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.68.131
I20260810 15:25:44.913458 27497 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:35053
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786375520124696-18706-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786375520124696-18706-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.68.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786375520124696-18706-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.68.131
--webserver_port=0
--tserver_master_addrs=127.18.68.190:36881
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27497
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.68.131
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786375520124696-18706-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:25:44.913663 27497 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:25:44.913908 27497 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:25:44.919237 27512 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:44.919229 27516 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:44.919245 27511 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:25:44.919417 27497 server_base.cc:1034] running on GCE node
I20260810 15:25:44.919625 27497 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:25:44.919824 27497 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:25:44.920974 27497 hybrid_clock.cc:648] HybridClock initialized: now 1786375544920961 us; error 26 us; skew 500 ppm
I20260810 15:25:44.922478 27497 webserver.cc:460] Webserver started at http://127.18.68.131:38483/ using document root <none> and password file <none>
I20260810 15:25:44.922751 27497 fs_manager.cc:359] Metadata directory not provided
I20260810 15:25:44.922803 27497 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:25:44.922987 27497 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:25:44.924114 27497 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786375520124696-18706-0/minicluster-data/ts-2/data/instance:
uuid: "f42a6c1651cd449ca6dfc12315b95782"
format_stamp: "Formatted at 2026-08-10 15:25:44 on dist-test-slave-2p8l"
server_key: "6693fe323e07266e4d93925524cddb6c"
server_key_iv: "36bf138c736fd3c05744f86402723105"
server_key_version: "encryptionkey@0"
I20260810 15:25:44.924479 27497 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786375520124696-18706-0/minicluster-data/ts-2/wal/instance:
uuid: "f42a6c1651cd449ca6dfc12315b95782"
format_stamp: "Formatted at 2026-08-10 15:25:44 on dist-test-slave-2p8l"
server_key: "6693fe323e07266e4d93925524cddb6c"
server_key_iv: "36bf138c736fd3c05744f86402723105"
server_key_version: "encryptionkey@0"
I20260810 15:25:44.925928 27497 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 15:25:44.926774 27523 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:44.926954 27497 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:25:44.927052 27497 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786375520124696-18706-0/minicluster-data/ts-2/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786375520124696-18706-0/minicluster-data/ts-2/wal
uuid: "f42a6c1651cd449ca6dfc12315b95782"
format_stamp: "Formatted at 2026-08-10 15:25:44 on dist-test-slave-2p8l"
server_key: "6693fe323e07266e4d93925524cddb6c"
server_key_iv: "36bf138c736fd3c05744f86402723105"
server_key_version: "encryptionkey@0"
I20260810 15:25:44.927119 27497 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786375520124696-18706-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786375520124696-18706-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786375520124696-18706-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:25:44.930543 27497 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:25:44.930783 27497 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:25:44.930882 27497 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:25:44.931038 27497 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 15:25:44.931293 27497 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 15:25:44.931324 27497 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:44.931344 27497 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 15:25:44.931356 27497 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:44.937660 27497 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.131:33299
I20260810 15:25:44.937780 27724 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.131:33299 every 8 connection(s)
I20260810 15:25:44.938154 27497 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786375520124696-18706-0/minicluster-data/ts-2/data/info.pb
I20260810 15:25:44.941390 27029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:44.938977 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.131:38199 (local address 127.18.68.190:36881)
0810 15:25:44.939068 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:44.939070 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:44.939303 (+ 233us) server_negotiation.cc:407] Connection header received
0810 15:25:44.939758 (+ 455us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:44.939759 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:44.939764 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:44.939834 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:44.941116 (+ 1282us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:44.941118 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:44.941118 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 15:25:44.941122 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:44.941140 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 15:25:44.941145 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:44.941200 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:44.941320 (+ 120us) server_negotiation.cc:299] Negotiation successful
0810 15:25:44.941334 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260810 15:25:44.941653 27730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:44.938961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:36881 (local address 127.18.68.131:38199)
0810 15:25:44.939167 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:44.939209 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:44.939676 (+ 467us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:44.939885 (+ 209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:44.939888 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:44.939896 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:25:44.940943 (+ 1047us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 15:25:44.940943 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:25:44.940976 (+ 33us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 15:25:44.941011 (+ 35us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:25:44.941230 (+ 219us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:25:44.941238 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:25:44.941241 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 15:25:44.941330 (+ 89us) client_negotiation.cc:240] Negotiation successful
0810 15:25:44.941383 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":91,"threads_started":1}
I20260810 15:25:44.941717 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 27497
I20260810 15:25:44.941848 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786375520124696-18706-0/minicluster-data/ts-2/wal/instance
I20260810 15:25:44.942065 18706 external_mini_cluster.cc:1428] Setting key 4cb9d418142d0c4467b9b87f0ee7f146
I20260810 15:25:44.942239 27725 heartbeater.cc:347] Connected to a master server at 127.18.68.190:36881
I20260810 15:25:44.942338 27725 heartbeater.cc:464] Registering TS with master...
I20260810 15:25:44.942499 27725 heartbeater.cc:511] Master 127.18.68.190:36881 requested a full tablet report, sending...
I20260810 15:25:44.942948 26961 ts_manager.cc:194] Registered new tserver with Master: f42a6c1651cd449ca6dfc12315b95782 (127.18.68.131:33299)
I20260810 15:25:44.954008 18706 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 15:25:44.956487 27029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:44.955485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56854 (local address 127.18.68.190:36881)
0810 15:25:44.955541 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:44.955544 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:44.955657 (+ 113us) server_negotiation.cc:407] Connection header received
0810 15:25:44.955696 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:44.955697 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:44.955702 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:44.955748 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:44.956269 (+ 521us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:44.956270 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:44.956271 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 15:25:44.956274 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:44.956288 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 15:25:44.956292 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:44.956336 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:44.956364 (+ 28us) server_negotiation.cc:299] Negotiation successful
0810 15:25:44.956375 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260810 15:25:44.957929 26961 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56854:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 15:25:44.959646 26961 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 15:25:44.963920 27740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:44.961889 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.131:33299 (local address 127.0.0.1:52334)
0810 15:25:44.962084 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:44.962123 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:44.962178 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:44.962831 (+ 653us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:44.962838 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:44.962844 (+ 6us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:25:44.963535 (+ 691us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 15:25:44.963536 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:25:44.963541 (+ 5us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 15:25:44.963552 (+ 11us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:25:44.963786 (+ 234us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:25:44.963787 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:25:44.963787 (+ 0us) client_negotiation.cc:769] Sending connection context
0810 15:25:44.963819 (+ 32us) client_negotiation.cc:240] Negotiation successful
0810 15:25:44.963835 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":81,"threads_started":1}
I20260810 15:25:44.963970 27744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:44.962268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44918 (local address 127.18.68.130:35299)
0810 15:25:44.962453 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:44.962457 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:44.962466 (+ 9us) server_negotiation.cc:407] Connection header received
0810 15:25:44.962489 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:44.962491 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:44.962498 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:44.962599 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:44.963589 (+ 990us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:44.963597 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:44.963597 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 15:25:44.963602 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:44.963644 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 15:25:44.963669 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:44.963739 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:44.963857 (+ 118us) server_negotiation.cc:299] Negotiation successful
0810 15:25:44.963876 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154,"thread_start_us":104,"threads_started":1}
I20260810 15:25:44.964212 27742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:44.961994 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52334 (local address 127.18.68.131:33299)
0810 15:25:44.962669 (+ 675us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:44.962674 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:44.962685 (+ 11us) server_negotiation.cc:407] Connection header received
0810 15:25:44.962712 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:44.962715 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:44.962725 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:44.963051 (+ 326us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:44.963620 (+ 569us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:44.963627 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:44.963627 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 15:25:44.963631 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:44.963671 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 15:25:44.963688 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:44.964054 (+ 366us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:44.964084 (+ 30us) server_negotiation.cc:299] Negotiation successful
0810 15:25:44.964101 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":622,"thread_start_us":143,"threads_started":1}
I20260810 15:25:44.964306 27745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:44.962448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.129:39945 (local address 127.0.0.1:38126)
0810 15:25:44.962703 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:44.962713 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:44.962759 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:44.963250 (+ 491us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:44.963251 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:44.963253 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:25:44.963786 (+ 533us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 15:25:44.963787 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:25:44.963792 (+ 5us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 15:25:44.963827 (+ 35us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:25:44.964178 (+ 351us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:25:44.964179 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:25:44.964180 (+ 1us) client_negotiation.cc:769] Sending connection context
0810 15:25:44.964229 (+ 49us) client_negotiation.cc:240] Negotiation successful
0810 15:25:44.964242 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":237,"thread_start_us":83,"threads_started":1}
I20260810 15:25:44.964334 27741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:44.961891 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.130:35299 (local address 127.0.0.1:44918)
0810 15:25:44.962273 (+ 382us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:44.962283 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:44.962317 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:44.962894 (+ 577us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:44.962895 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:44.962896 (+ 1us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:25:44.963441 (+ 545us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 15:25:44.963442 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:25:44.963456 (+ 14us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 15:25:44.963474 (+ 18us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:25:44.963743 (+ 269us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:25:44.963751 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:25:44.963754 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 15:25:44.963826 (+ 72us) client_negotiation.cc:240] Negotiation successful
0810 15:25:44.963836 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":367,"thread_start_us":72,"threads_started":1}
I20260810 15:25:44.964535 27746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:44.962429 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38126 (local address 127.18.68.129:39945)
0810 15:25:44.962639 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:44.962643 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:44.962815 (+ 172us) server_negotiation.cc:407] Connection header received
0810 15:25:44.962845 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:44.962848 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:44.962857 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:44.962927 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:44.963904 (+ 977us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:44.963911 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:44.963912 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 15:25:44.963916 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:44.963955 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 15:25:44.964120 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:44.964182 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:44.964421 (+ 239us) server_negotiation.cc:299] Negotiation successful
0810 15:25:44.964439 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":166,"thread_start_us":100,"threads_started":1}
I20260810 15:25:44.964895 27612 tablet_service.cc:1467] Processing CreateTablet for tablet 5fa1129f7159436d8b65deed92d5db55 (DEFAULT_TABLE table=test-table [id=5ddc6c2dcfba472bba2d6b2e82e9e7c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 15:25:44.965197 27612 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5fa1129f7159436d8b65deed92d5db55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:25:44.965085 27390 tablet_service.cc:1467] Processing CreateTablet for tablet 5fa1129f7159436d8b65deed92d5db55 (DEFAULT_TABLE table=test-table [id=5ddc6c2dcfba472bba2d6b2e82e9e7c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 15:25:44.965442 27390 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5fa1129f7159436d8b65deed92d5db55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:25:44.967978 27747 tablet_bootstrap.cc:492] T 5fa1129f7159436d8b65deed92d5db55 P f42a6c1651cd449ca6dfc12315b95782: Bootstrap starting.
I20260810 15:25:44.968609 27748 tablet_bootstrap.cc:492] T 5fa1129f7159436d8b65deed92d5db55 P 12e7bb025ee54e17a7d2a420b9c24dd9: Bootstrap starting.
I20260810 15:25:44.968571 27165 tablet_service.cc:1467] Processing CreateTablet for tablet 5fa1129f7159436d8b65deed92d5db55 (DEFAULT_TABLE table=test-table [id=5ddc6c2dcfba472bba2d6b2e82e9e7c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 15:25:44.968781 27747 tablet_bootstrap.cc:654] T 5fa1129f7159436d8b65deed92d5db55 P f42a6c1651cd449ca6dfc12315b95782: Neither blocks nor log segments found. Creating new log.
I20260810 15:25:44.968924 27165 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5fa1129f7159436d8b65deed92d5db55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:25:44.969197 27747 log.cc:824] T 5fa1129f7159436d8b65deed92d5db55 P f42a6c1651cd449ca6dfc12315b95782: Log is configured to *not* fsync() on all Append() calls
I20260810 15:25:44.969347 27748 tablet_bootstrap.cc:654] T 5fa1129f7159436d8b65deed92d5db55 P 12e7bb025ee54e17a7d2a420b9c24dd9: Neither blocks nor log segments found. Creating new log.
I20260810 15:25:44.969683 27748 log.cc:824] T 5fa1129f7159436d8b65deed92d5db55 P 12e7bb025ee54e17a7d2a420b9c24dd9: Log is configured to *not* fsync() on all Append() calls
I20260810 15:25:44.970019 27747 tablet_bootstrap.cc:492] T 5fa1129f7159436d8b65deed92d5db55 P f42a6c1651cd449ca6dfc12315b95782: No bootstrap required, opened a new log
I20260810 15:25:44.970211 27747 ts_tablet_manager.cc:1397] T 5fa1129f7159436d8b65deed92d5db55 P f42a6c1651cd449ca6dfc12315b95782: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 15:25:44.970513 27748 tablet_bootstrap.cc:492] T 5fa1129f7159436d8b65deed92d5db55 P 12e7bb025ee54e17a7d2a420b9c24dd9: No bootstrap required, opened a new log
I20260810 15:25:44.970598 27748 ts_tablet_manager.cc:1397] T 5fa1129f7159436d8b65deed92d5db55 P 12e7bb025ee54e17a7d2a420b9c24dd9: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 15:25:44.972186 27751 tablet_bootstrap.cc:492] T 5fa1129f7159436d8b65deed92d5db55 P c722d3182a444a71816de7f28577d72c: Bootstrap starting.
I20260810 15:25:44.972599 27748 raft_consensus.cc:348] T 5fa1129f7159436d8b65deed92d5db55 P 12e7bb025ee54e17a7d2a420b9c24dd9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12e7bb025ee54e17a7d2a420b9c24dd9" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 35299 } } peers { permanent_uuid: "f42a6c1651cd449ca6dfc12315b95782" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 33299 } } peers { permanent_uuid: "c722d3182a444a71816de7f28577d72c" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 39945 } }
I20260810 15:25:44.972769 27748 raft_consensus.cc:374] T 5fa1129f7159436d8b65deed92d5db55 P 12e7bb025ee54e17a7d2a420b9c24dd9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:25:44.972827 27748 raft_consensus.cc:729] T 5fa1129f7159436d8b65deed92d5db55 P 12e7bb025ee54e17a7d2a420b9c24dd9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12e7bb025ee54e17a7d2a420b9c24dd9, State: Initialized, Role: FOLLOWER
I20260810 15:25:44.972865 27751 tablet_bootstrap.cc:654] T 5fa1129f7159436d8b65deed92d5db55 P c722d3182a444a71816de7f28577d72c: Neither blocks nor log segments found. Creating new log.
I20260810 15:25:44.972790 27747 raft_consensus.cc:348] T 5fa1129f7159436d8b65deed92d5db55 P f42a6c1651cd449ca6dfc12315b95782 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12e7bb025ee54e17a7d2a420b9c24dd9" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 35299 } } peers { permanent_uuid: "f42a6c1651cd449ca6dfc12315b95782" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 33299 } } peers { permanent_uuid: "c722d3182a444a71816de7f28577d72c" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 39945 } }
I20260810 15:25:44.972950 27747 raft_consensus.cc:374] T 5fa1129f7159436d8b65deed92d5db55 P f42a6c1651cd449ca6dfc12315b95782 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:25:44.972994 27747 raft_consensus.cc:729] T 5fa1129f7159436d8b65deed92d5db55 P f42a6c1651cd449ca6dfc12315b95782 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f42a6c1651cd449ca6dfc12315b95782, State: Initialized, Role: FOLLOWER
I20260810 15:25:44.972971 27748 consensus_queue.cc:260] T 5fa1129f7159436d8b65deed92d5db55 P 12e7bb025ee54e17a7d2a420b9c24dd9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12e7bb025ee54e17a7d2a420b9c24dd9" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 35299 } } peers { permanent_uuid: "f42a6c1651cd449ca6dfc12315b95782" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 33299 } } peers { permanent_uuid: "c722d3182a444a71816de7f28577d72c" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 39945 } }
I20260810 15:25:44.973179 27751 log.cc:824] T 5fa1129f7159436d8b65deed92d5db55 P c722d3182a444a71816de7f28577d72c: Log is configured to *not* fsync() on all Append() calls
I20260810 15:25:44.973268 27748 ts_tablet_manager.cc:1428] T 5fa1129f7159436d8b65deed92d5db55 P 12e7bb025ee54e17a7d2a420b9c24dd9: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 15:25:44.973286 27747 consensus_queue.cc:260] T 5fa1129f7159436d8b65deed92d5db55 P f42a6c1651cd449ca6dfc12315b95782 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12e7bb025ee54e17a7d2a420b9c24dd9" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 35299 } } peers { permanent_uuid: "f42a6c1651cd449ca6dfc12315b95782" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 33299 } } peers { permanent_uuid: "c722d3182a444a71816de7f28577d72c" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 39945 } }
I20260810 15:25:44.973397 27491 heartbeater.cc:503] Master 127.18.68.190:36881 was elected leader, sending a full tablet report...
I20260810 15:25:44.973582 27725 heartbeater.cc:503] Master 127.18.68.190:36881 was elected leader, sending a full tablet report...
I20260810 15:25:44.973943 27747 ts_tablet_manager.cc:1428] T 5fa1129f7159436d8b65deed92d5db55 P f42a6c1651cd449ca6dfc12315b95782: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260810 15:25:44.974742 27751 tablet_bootstrap.cc:492] T 5fa1129f7159436d8b65deed92d5db55 P c722d3182a444a71816de7f28577d72c: No bootstrap required, opened a new log
I20260810 15:25:44.974815 27751 ts_tablet_manager.cc:1397] T 5fa1129f7159436d8b65deed92d5db55 P c722d3182a444a71816de7f28577d72c: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260810 15:25:44.976562 27751 raft_consensus.cc:348] T 5fa1129f7159436d8b65deed92d5db55 P c722d3182a444a71816de7f28577d72c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12e7bb025ee54e17a7d2a420b9c24dd9" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 35299 } } peers { permanent_uuid: "f42a6c1651cd449ca6dfc12315b95782" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 33299 } } peers { permanent_uuid: "c722d3182a444a71816de7f28577d72c" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 39945 } }
I20260810 15:25:44.976684 27751 raft_consensus.cc:374] T 5fa1129f7159436d8b65deed92d5db55 P c722d3182a444a71816de7f28577d72c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:25:44.976706 27751 raft_consensus.cc:729] T 5fa1129f7159436d8b65deed92d5db55 P c722d3182a444a71816de7f28577d72c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c722d3182a444a71816de7f28577d72c, State: Initialized, Role: FOLLOWER
I20260810 15:25:44.976840 27751 consensus_queue.cc:260] T 5fa1129f7159436d8b65deed92d5db55 P c722d3182a444a71816de7f28577d72c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12e7bb025ee54e17a7d2a420b9c24dd9" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 35299 } } peers { permanent_uuid: "f42a6c1651cd449ca6dfc12315b95782" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 33299 } } peers { permanent_uuid: "c722d3182a444a71816de7f28577d72c" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 39945 } }
I20260810 15:25:44.977118 27751 ts_tablet_manager.cc:1428] T 5fa1129f7159436d8b65deed92d5db55 P c722d3182a444a71816de7f28577d72c: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260810 15:25:44.977139 27270 heartbeater.cc:503] Master 127.18.68.190:36881 was elected leader, sending a full tablet report...
W20260810 15:25:45.074185 27492 tablet.cc:2369] T 5fa1129f7159436d8b65deed92d5db55 P 12e7bb025ee54e17a7d2a420b9c24dd9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 15:25:45.157990 27759 raft_consensus.cc:482] T 5fa1129f7159436d8b65deed92d5db55 P c722d3182a444a71816de7f28577d72c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 15:25:45.158192 27759 raft_consensus.cc:504] T 5fa1129f7159436d8b65deed92d5db55 P c722d3182a444a71816de7f28577d72c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12e7bb025ee54e17a7d2a420b9c24dd9" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 35299 } } peers { permanent_uuid: "f42a6c1651cd449ca6dfc12315b95782" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 33299 } } peers { permanent_uuid: "c722d3182a444a71816de7f28577d72c" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 39945 } }
I20260810 15:25:45.158675 27759 leader_election.cc:288] T 5fa1129f7159436d8b65deed92d5db55 P c722d3182a444a71816de7f28577d72c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 12e7bb025ee54e17a7d2a420b9c24dd9 (127.18.68.130:35299), f42a6c1651cd449ca6dfc12315b95782 (127.18.68.131:33299)
I20260810 15:25:45.160073 27742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:45.158995 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.129:46649 (local address 127.18.68.131:33299)
0810 15:25:45.159062 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:45.159064 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:45.159075 (+ 11us) server_negotiation.cc:407] Connection header received
0810 15:25:45.159106 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:45.159108 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:45.159114 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:45.159220 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:45.159822 (+ 602us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:45.159824 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:45.159824 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 15:25:45.159829 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:45.159855 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 15:25:45.159860 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:45.159932 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:45.159983 (+ 51us) server_negotiation.cc:299] Negotiation successful
0810 15:25:45.159998 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260810 15:25:45.160068 27272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:45.158886 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.131:33299 (local address 127.18.68.129:46649)
0810 15:25:45.158958 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:45.158973 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:45.159024 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:45.159229 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:45.159230 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:45.159233 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:25:45.159689 (+ 456us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 15:25:45.159689 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:25:45.159697 (+ 8us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 15:25:45.159709 (+ 12us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:25:45.159928 (+ 219us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:25:45.159929 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:25:45.159930 (+ 1us) client_negotiation.cc:769] Sending connection context
0810 15:25:45.159983 (+ 53us) client_negotiation.cc:240] Negotiation successful
0810 15:25:45.159998 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46}
I20260810 15:25:45.160252 27760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:45.158895 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.130:35299 (local address 127.18.68.129:40003)
0810 15:25:45.159118 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:45.159129 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:45.159171 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:45.159322 (+ 151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:45.159323 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:45.159325 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:25:45.159870 (+ 545us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 15:25:45.159870 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:25:45.159877 (+ 7us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 15:25:45.159888 (+ 11us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:25:45.160077 (+ 189us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:25:45.160078 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:25:45.160078 (+ 0us) client_negotiation.cc:769] Sending connection context
0810 15:25:45.160131 (+ 53us) client_negotiation.cc:240] Negotiation successful
0810 15:25:45.160145 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":209,"mutex_wait_us":40,"thread_start_us":99,"threads_started":1}
I20260810 15:25:45.160343 27744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:45.159077 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.129:40003 (local address 127.18.68.130:35299)
0810 15:25:45.159156 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:45.159158 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:45.159168 (+ 10us) server_negotiation.cc:407] Connection header received
0810 15:25:45.159231 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:45.159232 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:45.159237 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:45.159315 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:45.159979 (+ 664us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:45.159981 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:45.159982 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 15:25:45.159986 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:45.160001 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 15:25:45.160005 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:45.160079 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:45.160255 (+ 176us) server_negotiation.cc:299] Negotiation successful
0810 15:25:45.160270 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260810 15:25:45.160538 27645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fa1129f7159436d8b65deed92d5db55" candidate_uuid: "c722d3182a444a71816de7f28577d72c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f42a6c1651cd449ca6dfc12315b95782" is_pre_election: true
I20260810 15:25:45.160719 27645 raft_consensus.cc:2454] T 5fa1129f7159436d8b65deed92d5db55 P f42a6c1651cd449ca6dfc12315b95782 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c722d3182a444a71816de7f28577d72c in term 0.
I20260810 15:25:45.160668 27427 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fa1129f7159436d8b65deed92d5db55" candidate_uuid: "c722d3182a444a71816de7f28577d72c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12e7bb025ee54e17a7d2a420b9c24dd9" is_pre_election: true
I20260810 15:25:45.160825 27427 raft_consensus.cc:2454] T 5fa1129f7159436d8b65deed92d5db55 P 12e7bb025ee54e17a7d2a420b9c24dd9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c722d3182a444a71816de7f28577d72c in term 0.
I20260810 15:25:45.161043 27079 leader_election.cc:302] T 5fa1129f7159436d8b65deed92d5db55 P c722d3182a444a71816de7f28577d72c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c722d3182a444a71816de7f28577d72c, f42a6c1651cd449ca6dfc12315b95782; no voters:
I20260810 15:25:45.161223 27759 raft_consensus.cc:2781] T 5fa1129f7159436d8b65deed92d5db55 P c722d3182a444a71816de7f28577d72c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 15:25:45.161273 27759 raft_consensus.cc:482] T 5fa1129f7159436d8b65deed92d5db55 P c722d3182a444a71816de7f28577d72c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 15:25:45.161289 27759 raft_consensus.cc:3037] T 5fa1129f7159436d8b65deed92d5db55 P c722d3182a444a71816de7f28577d72c [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:25:45.162048 27759 raft_consensus.cc:504] T 5fa1129f7159436d8b65deed92d5db55 P c722d3182a444a71816de7f28577d72c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12e7bb025ee54e17a7d2a420b9c24dd9" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 35299 } } peers { permanent_uuid: "f42a6c1651cd449ca6dfc12315b95782" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 33299 } } peers { permanent_uuid: "c722d3182a444a71816de7f28577d72c" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 39945 } }
I20260810 15:25:45.162238 27759 leader_election.cc:288] T 5fa1129f7159436d8b65deed92d5db55 P c722d3182a444a71816de7f28577d72c [CANDIDATE]: Term 1 election: Requested vote from peers 12e7bb025ee54e17a7d2a420b9c24dd9 (127.18.68.130:35299), f42a6c1651cd449ca6dfc12315b95782 (127.18.68.131:33299)
I20260810 15:25:45.162410 27645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fa1129f7159436d8b65deed92d5db55" candidate_uuid: "c722d3182a444a71816de7f28577d72c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f42a6c1651cd449ca6dfc12315b95782"
I20260810 15:25:45.162504 27427 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fa1129f7159436d8b65deed92d5db55" candidate_uuid: "c722d3182a444a71816de7f28577d72c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12e7bb025ee54e17a7d2a420b9c24dd9"
I20260810 15:25:45.162516 27645 raft_consensus.cc:3037] T 5fa1129f7159436d8b65deed92d5db55 P f42a6c1651cd449ca6dfc12315b95782 [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:25:45.162611 27427 raft_consensus.cc:3037] T 5fa1129f7159436d8b65deed92d5db55 P 12e7bb025ee54e17a7d2a420b9c24dd9 [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:25:45.163282 27645 raft_consensus.cc:2454] T 5fa1129f7159436d8b65deed92d5db55 P f42a6c1651cd449ca6dfc12315b95782 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c722d3182a444a71816de7f28577d72c in term 1.
I20260810 15:25:45.163419 27427 raft_consensus.cc:2454] T 5fa1129f7159436d8b65deed92d5db55 P 12e7bb025ee54e17a7d2a420b9c24dd9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c722d3182a444a71816de7f28577d72c in term 1.
I20260810 15:25:45.163456 27079 leader_election.cc:302] T 5fa1129f7159436d8b65deed92d5db55 P c722d3182a444a71816de7f28577d72c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c722d3182a444a71816de7f28577d72c, f42a6c1651cd449ca6dfc12315b95782; no voters:
I20260810 15:25:45.163566 27759 raft_consensus.cc:2781] T 5fa1129f7159436d8b65deed92d5db55 P c722d3182a444a71816de7f28577d72c [term 1 FOLLOWER]: Leader election won for term 1
I20260810 15:25:45.163753 27759 raft_consensus.cc:686] T 5fa1129f7159436d8b65deed92d5db55 P c722d3182a444a71816de7f28577d72c [term 1 LEADER]: Becoming Leader. State: Replica: c722d3182a444a71816de7f28577d72c, State: Running, Role: LEADER
I20260810 15:25:45.163872 27759 consensus_queue.cc:237] T 5fa1129f7159436d8b65deed92d5db55 P c722d3182a444a71816de7f28577d72c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12e7bb025ee54e17a7d2a420b9c24dd9" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 35299 } } peers { permanent_uuid: "f42a6c1651cd449ca6dfc12315b95782" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 33299 } } peers { permanent_uuid: "c722d3182a444a71816de7f28577d72c" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 39945 } }
I20260810 15:25:45.164876 26960 catalog_manager.cc:5495] T 5fa1129f7159436d8b65deed92d5db55 P c722d3182a444a71816de7f28577d72c reported cstate change: term changed from 0 to 1, leader changed from <none> to c722d3182a444a71816de7f28577d72c (127.18.68.129). New cstate: current_term: 1 leader_uuid: "c722d3182a444a71816de7f28577d72c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12e7bb025ee54e17a7d2a420b9c24dd9" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 35299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f42a6c1651cd449ca6dfc12315b95782" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 33299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c722d3182a444a71816de7f28577d72c" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 39945 } health_report { overall_health: HEALTHY } } }
W20260810 15:25:45.188874 27726 tablet.cc:2369] T 5fa1129f7159436d8b65deed92d5db55 P f42a6c1651cd449ca6dfc12315b95782: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 15:25:45.192278 27746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:45.191305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38138 (local address 127.18.68.129:39945)
0810 15:25:45.191368 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:45.191370 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:45.191377 (+ 7us) server_negotiation.cc:407] Connection header received
0810 15:25:45.191421 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:45.191422 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:45.191434 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:45.191503 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:45.192050 (+ 547us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:45.192051 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:45.192052 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 15:25:45.192056 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:45.192072 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 15:25:45.192076 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:45.192124 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:45.192187 (+ 63us) server_negotiation.cc:299] Negotiation successful
0810 15:25:45.192201 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260810 15:25:45.194248 27645 raft_consensus.cc:1261] T 5fa1129f7159436d8b65deed92d5db55 P f42a6c1651cd449ca6dfc12315b95782 [term 1 FOLLOWER]: Refusing update from remote peer c722d3182a444a71816de7f28577d72c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 15:25:45.194250 27427 raft_consensus.cc:1261] T 5fa1129f7159436d8b65deed92d5db55 P 12e7bb025ee54e17a7d2a420b9c24dd9 [term 1 FOLLOWER]: Refusing update from remote peer c722d3182a444a71816de7f28577d72c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 15:25:45.194623 27763 consensus_queue.cc:1035] T 5fa1129f7159436d8b65deed92d5db55 P c722d3182a444a71816de7f28577d72c [LEADER]: Connected to new peer: Peer: permanent_uuid: "12e7bb025ee54e17a7d2a420b9c24dd9" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 35299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 15:25:45.194725 27759 consensus_queue.cc:1035] T 5fa1129f7159436d8b65deed92d5db55 P c722d3182a444a71816de7f28577d72c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f42a6c1651cd449ca6dfc12315b95782" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 33299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 15:25:45.197427 27767 mvcc.cc:205] Tried to move back new op lower bound from 7316994233112506368 to 7316994232991830016. Current Snapshot: MvccSnapshot[applied={T|T < 7316994233112506368}]
I20260810 15:25:45.197631 27774 mvcc.cc:205] Tried to move back new op lower bound from 7316994233112506368 to 7316994232991830016. Current Snapshot: MvccSnapshot[applied={T|T < 7316994233112506368}]
I20260810 15:25:45.199992 26961 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56854:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 15:25:45.200109 26961 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56854:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 15:25:45.201012 26961 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 593fd1f5d1474ea3a5872a0a3ef04869: Sending DeleteTablet for 3 replicas of tablet 5fa1129f7159436d8b65deed92d5db55
I20260810 15:25:45.201422 27165 tablet_service.cc:1514] Processing DeleteTablet for tablet 5fa1129f7159436d8b65deed92d5db55 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 15:25:45 UTC) from {username='slave'} at 127.0.0.1:38126
I20260810 15:25:45.201411 27390 tablet_service.cc:1514] Processing DeleteTablet for tablet 5fa1129f7159436d8b65deed92d5db55 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 15:25:45 UTC) from {username='slave'} at 127.0.0.1:44918
I20260810 15:25:45.201452 27612 tablet_service.cc:1514] Processing DeleteTablet for tablet 5fa1129f7159436d8b65deed92d5db55 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 15:25:45 UTC) from {username='slave'} at 127.0.0.1:52334
I20260810 15:25:45.201654 27785 tablet_replica.cc:330] T 5fa1129f7159436d8b65deed92d5db55 P c722d3182a444a71816de7f28577d72c: stopping tablet replica
I20260810 15:25:45.201748 27785 raft_consensus.cc:2229] T 5fa1129f7159436d8b65deed92d5db55 P c722d3182a444a71816de7f28577d72c [term 1 LEADER]: Raft consensus shutting down.
I20260810 15:25:45.201851 27785 raft_consensus.cc:2258] T 5fa1129f7159436d8b65deed92d5db55 P c722d3182a444a71816de7f28577d72c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 15:25:45.201980 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 27054
I20260810 15:25:45.215253 27786 tablet_replica.cc:330] T 5fa1129f7159436d8b65deed92d5db55 P f42a6c1651cd449ca6dfc12315b95782: stopping tablet replica
I20260810 15:25:45.215451 27786 raft_consensus.cc:2229] T 5fa1129f7159436d8b65deed92d5db55 P f42a6c1651cd449ca6dfc12315b95782 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 15:25:45.215623 27786 raft_consensus.cc:2258] T 5fa1129f7159436d8b65deed92d5db55 P f42a6c1651cd449ca6dfc12315b95782 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 15:25:45.215915 27784 tablet_replica.cc:330] T 5fa1129f7159436d8b65deed92d5db55 P 12e7bb025ee54e17a7d2a420b9c24dd9: stopping tablet replica
I20260810 15:25:45.216065 27784 raft_consensus.cc:2229] T 5fa1129f7159436d8b65deed92d5db55 P 12e7bb025ee54e17a7d2a420b9c24dd9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 15:25:45.216202 27784 raft_consensus.cc:2258] T 5fa1129f7159436d8b65deed92d5db55 P 12e7bb025ee54e17a7d2a420b9c24dd9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 15:25:45.216375 27786 ts_tablet_manager.cc:1905] T 5fa1129f7159436d8b65deed92d5db55 P f42a6c1651cd449ca6dfc12315b95782: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 15:25:45.218465 27784 ts_tablet_manager.cc:1905] T 5fa1129f7159436d8b65deed92d5db55 P 12e7bb025ee54e17a7d2a420b9c24dd9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 15:25:45.218833 27786 ts_tablet_manager.cc:1918] T 5fa1129f7159436d8b65deed92d5db55 P f42a6c1651cd449ca6dfc12315b95782: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 15:25:45.218938 27786 log.cc:1196] T 5fa1129f7159436d8b65deed92d5db55 P f42a6c1651cd449ca6dfc12315b95782: Deleting WAL directory at /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786375520124696-18706-0/minicluster-data/ts-2/wal/wals/5fa1129f7159436d8b65deed92d5db55
I20260810 15:25:45.219194 27786 ts_tablet_manager.cc:1939] T 5fa1129f7159436d8b65deed92d5db55 P f42a6c1651cd449ca6dfc12315b95782: Deleting consensus metadata
I20260810 15:25:45.219698 26942 catalog_manager.cc:4841] TS f42a6c1651cd449ca6dfc12315b95782 (127.18.68.131:33299): tablet 5fa1129f7159436d8b65deed92d5db55 (table test-table [id=5ddc6c2dcfba472bba2d6b2e82e9e7c4]) successfully deleted
I20260810 15:25:45.220726 27784 ts_tablet_manager.cc:1918] T 5fa1129f7159436d8b65deed92d5db55 P 12e7bb025ee54e17a7d2a420b9c24dd9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 15:25:45.220824 27784 log.cc:1196] T 5fa1129f7159436d8b65deed92d5db55 P 12e7bb025ee54e17a7d2a420b9c24dd9: Deleting WAL directory at /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786375520124696-18706-0/minicluster-data/ts-1/wal/wals/5fa1129f7159436d8b65deed92d5db55
I20260810 15:25:45.221123 27784 ts_tablet_manager.cc:1939] T 5fa1129f7159436d8b65deed92d5db55 P 12e7bb025ee54e17a7d2a420b9c24dd9: Deleting consensus metadata
I20260810 15:25:45.221611 26938 catalog_manager.cc:4841] TS 12e7bb025ee54e17a7d2a420b9c24dd9 (127.18.68.130:35299): tablet 5fa1129f7159436d8b65deed92d5db55 (table test-table [id=5ddc6c2dcfba472bba2d6b2e82e9e7c4]) successfully deleted
W20260810 15:25:45.223878 26942 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.18.68.129:39945 (error 108)
I20260810 15:25:45.224115 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 27274
I20260810 15:25:45.229044 27741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:45.224269 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.129:39945 (local address 127.0.0.1:38148)
0810 15:25:45.226879 (+ 2610us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:45.228990 (+ 2111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.129:39945: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2582}
W20260810 15:25:45.229224 26942 catalog_manager.cc:4584] TS c722d3182a444a71816de7f28577d72c (127.18.68.129:39945): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 5fa1129f7159436d8b65deed92d5db55: Network error: Client connection negotiation failed: client connection to 127.18.68.129:39945: connect: Connection refused (error 111)
I20260810 15:25:45.235945 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 27497
I20260810 15:25:45.251658 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 26909
2026-08-10T15:25:45Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (840 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260810 15:25:45.279582 18706 mini_oidc.cc:152] Starting JWKS server
I20260810 15:25:45.280784 18706 webserver.cc:460] Webserver started at https://127.0.0.1:45701/ using document root <none> and password file <none>
I20260810 15:25:45.280864 18706 mini_oidc.cc:189] Starting OIDC Discovery server
I20260810 15:25:45.281049 18706 webserver.cc:460] Webserver started at http://127.0.0.1:46451/ using document root <none> and password file <none>
2026-08-10T15:25:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T15:25:45Z Disabled control of system clock
I20260810 15:25:45.290563 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786375520124696-18706-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786375520124696-18706-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786375520124696-18706-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.190:45205
--webserver_interface=127.18.68.190
--webserver_port=0
--builtin_ntp_servers=127.18.68.148:39017
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.68.190:45205
--enable_jwt_token_auth=true
--jwks_url=https://localhost:45701/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786375520124696-18706-0/testchainca.cert with env {}
W20260810 15:25:45.372112 27800 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:25:45.372342 27800 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:25:45.372364 27800 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:25:45.373567 27800 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 15:25:45.373610 27800 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:25:45.373623 27800 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:25:45.373636 27800 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 15:25:45.373647 27800 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260810 15:25:45.373663 27800 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260810 15:25:45.373719 27800 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:45701/jwks.json
I20260810 15:25:45.375350 27800 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:39017
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786375520124696-18706-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786375520124696-18706-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.68.190:45205
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.190:45205
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:45701/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.68.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786375520124696-18706-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27800
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786375520124696-18706-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:25:45.375627 27800 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:25:45.375869 27800 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:25:45.381031 27806 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:45.381031 27811 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:45.381065 27807 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:25:45.381189 27800 server_base.cc:1034] running on GCE node
I20260810 15:25:45.381508 27800 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:25:45.381855 27800 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:25:45.383028 27800 hybrid_clock.cc:648] HybridClock initialized: now 1786375545383019 us; error 35 us; skew 500 ppm
I20260810 15:25:45.384262 27800 webserver.cc:460] Webserver started at http://127.18.68.190:41711/ using document root <none> and password file <none>
I20260810 15:25:45.384538 27800 fs_manager.cc:359] Metadata directory not provided
I20260810 15:25:45.384613 27800 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:25:45.384799 27800 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:25:45.385876 27800 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786375520124696-18706-0/minicluster-data/master-0/data/instance:
uuid: "3e2aa5ba7779451a916e6fd610baa784"
format_stamp: "Formatted at 2026-08-10 15:25:45 on dist-test-slave-2p8l"
server_key: "854f12b669838e53fa9177676233882c"
server_key_iv: "2378052f3ff6182378289ab211f67321"
server_key_version: "encryptionkey@0"
I20260810 15:25:45.386287 27800 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786375520124696-18706-0/minicluster-data/master-0/wal/instance:
uuid: "3e2aa5ba7779451a916e6fd610baa784"
format_stamp: "Formatted at 2026-08-10 15:25:45 on dist-test-slave-2p8l"
server_key: "854f12b669838e53fa9177676233882c"
server_key_iv: "2378052f3ff6182378289ab211f67321"
server_key_version: "encryptionkey@0"
I20260810 15:25:45.387619 27800 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260810 15:25:45.388407 27820 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:45.388619 27800 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 15:25:45.388752 27800 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786375520124696-18706-0/minicluster-data/master-0/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786375520124696-18706-0/minicluster-data/master-0/wal
uuid: "3e2aa5ba7779451a916e6fd610baa784"
format_stamp: "Formatted at 2026-08-10 15:25:45 on dist-test-slave-2p8l"
server_key: "854f12b669838e53fa9177676233882c"
server_key_iv: "2378052f3ff6182378289ab211f67321"
server_key_version: "encryptionkey@0"
I20260810 15:25:45.388830 27800 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786375520124696-18706-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786375520124696-18706-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786375520124696-18706-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:25:45.397972 27800 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:25:45.398311 27800 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:25:45.398468 27800 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:25:45.402827 27800 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.190:45205
I20260810 15:25:45.402863 27902 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.190:45205 every 8 connection(s)
I20260810 15:25:45.403218 27800 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
I20260810 15:25:45.404259 27903 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:25:45.405123 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 27800
I20260810 15:25:45.405233 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786375520124696-18706-0/minicluster-data/master-0/wal/instance
I20260810 15:25:45.405421 18706 external_mini_cluster.cc:1428] Setting key af65389c43a9a479d0bb5d4d4819a206
I20260810 15:25:45.407485 27903 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3e2aa5ba7779451a916e6fd610baa784: Bootstrap starting.
I20260810 15:25:45.408129 27903 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3e2aa5ba7779451a916e6fd610baa784: Neither blocks nor log segments found. Creating new log.
I20260810 15:25:45.408442 27903 log.cc:824] T 00000000000000000000000000000000 P 3e2aa5ba7779451a916e6fd610baa784: Log is configured to *not* fsync() on all Append() calls
I20260810 15:25:45.409150 27903 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3e2aa5ba7779451a916e6fd610baa784: No bootstrap required, opened a new log
I20260810 15:25:45.411017 27906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:45.406025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40562 (local address 127.18.68.190:45205)
0810 15:25:45.406291 (+ 266us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:45.406299 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:45.406324 (+ 25us) server_negotiation.cc:407] Connection header received
0810 15:25:45.406745 (+ 421us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:45.406752 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:45.406813 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:45.406970 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:45.407176 (+ 206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:45.408099 (+ 923us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:45.408981 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:45.409439 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:45.409581 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:45.410379 (+ 798us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:45.410387 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:45.410387 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 15:25:45.410556 (+ 169us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:45.410605 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 15:25:45.410617 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:45.410697 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:45.410774 (+ 77us) server_negotiation.cc:299] Negotiation successful
0810 15:25:45.410854 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":182,"thread_start_us":121,"threads_started":1}
I20260810 15:25:45.411393 27903 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3e2aa5ba7779451a916e6fd610baa784 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e2aa5ba7779451a916e6fd610baa784" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 45205 } }
I20260810 15:25:45.411550 27903 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3e2aa5ba7779451a916e6fd610baa784 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:25:45.411590 27903 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3e2aa5ba7779451a916e6fd610baa784 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e2aa5ba7779451a916e6fd610baa784, State: Initialized, Role: FOLLOWER
I20260810 15:25:45.411713 27903 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3e2aa5ba7779451a916e6fd610baa784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e2aa5ba7779451a916e6fd610baa784" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 45205 } }
I20260810 15:25:45.411799 27903 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3e2aa5ba7779451a916e6fd610baa784 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 15:25:45.411836 27903 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3e2aa5ba7779451a916e6fd610baa784 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 15:25:45.411893 27903 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3e2aa5ba7779451a916e6fd610baa784 [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:25:45.412110 18706 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 15:25:45.412547 27903 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3e2aa5ba7779451a916e6fd610baa784 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e2aa5ba7779451a916e6fd610baa784" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 45205 } }
I20260810 15:25:45.412660 27903 leader_election.cc:302] T 00000000000000000000000000000000 P 3e2aa5ba7779451a916e6fd610baa784 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3e2aa5ba7779451a916e6fd610baa784; no voters:
I20260810 15:25:45.412853 27903 leader_election.cc:288] T 00000000000000000000000000000000 P 3e2aa5ba7779451a916e6fd610baa784 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 15:25:45.412926 27910 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3e2aa5ba7779451a916e6fd610baa784 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 15:25:45.413084 27910 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3e2aa5ba7779451a916e6fd610baa784 [term 1 LEADER]: Becoming Leader. State: Replica: 3e2aa5ba7779451a916e6fd610baa784, State: Running, Role: LEADER
I20260810 15:25:45.413127 27903 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3e2aa5ba7779451a916e6fd610baa784 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 15:25:45.413193 27910 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3e2aa5ba7779451a916e6fd610baa784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e2aa5ba7779451a916e6fd610baa784" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 45205 } }
I20260810 15:25:45.413525 27913 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3e2aa5ba7779451a916e6fd610baa784 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3e2aa5ba7779451a916e6fd610baa784. Latest consensus state: current_term: 1 leader_uuid: "3e2aa5ba7779451a916e6fd610baa784" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e2aa5ba7779451a916e6fd610baa784" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 45205 } } }
I20260810 15:25:45.413540 27912 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3e2aa5ba7779451a916e6fd610baa784 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3e2aa5ba7779451a916e6fd610baa784" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e2aa5ba7779451a916e6fd610baa784" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 45205 } } }
I20260810 15:25:45.413636 27912 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3e2aa5ba7779451a916e6fd610baa784 [sys.catalog]: This master's current role is: LEADER
I20260810 15:25:45.413805 27913 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3e2aa5ba7779451a916e6fd610baa784 [sys.catalog]: This master's current role is: LEADER
I20260810 15:25:45.413851 27923 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 15:25:45.414387 27923 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 15:25:45.416136 27923 catalog_manager.cc:1347] Generated new cluster ID: 6a399c81649142eeb338358c8c12d34d
I20260810 15:25:45.416203 27923 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 15:25:45.437321 27923 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 15:25:45.438117 27923 catalog_manager.cc:1504] Loading token signing keys...
I20260810 15:25:45.450790 27923 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3e2aa5ba7779451a916e6fd610baa784: Generated new TSK 0
I20260810 15:25:45.451004 27923 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260810 15:25:45.489364 27950 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260810 15:25:45.489530 27950 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260810 15:25:45.489629 27906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:45.467269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40568 (local address 127.18.68.190:45205)
0810 15:25:45.467346 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:45.467348 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:45.467511 (+ 163us) server_negotiation.cc:407] Connection header received
0810 15:25:45.467618 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:45.467619 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:45.467630 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:45.467693 (+ 63us) server_negotiation.cc:226] Negotiated authn=JWT
0810 15:25:45.467900 (+ 207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:45.468435 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:45.469560 (+ 1125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:45.469756 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:45.469819 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:45.470151 (+ 332us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0810 15:25:45.489322 (+ 19171us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45701/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0810 15:25:45.489547 (+ 225us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:40568: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45701/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":47}
W20260810 15:25:45.489701 27906 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:40568: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45701/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260810 15:25:45.490020 27948 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 15:25:45.467202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:45205 (local address 127.0.0.1:40568)
0810 15:25:45.467432 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:45.467445 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:45.467523 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:45.467760 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:45.467761 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:45.467764 (+ 3us) client_negotiation.cc:189] Negotiated authn=JWT
0810 15:25:45.467831 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:45.467833 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:45.468523 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:45.468524 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:45.469454 (+ 930us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:45.469458 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:45.469853 (+ 395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:45.469854 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:45.469918 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:45.469940 (+ 22us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0810 15:25:45.489490 (+ 19550us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45701/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0810 15:25:45.489695 (+ 205us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.18.68.190:45205: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45701/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":119,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.18.68.190:45205: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45701/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260810 15:25:45.490705 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 27800
2026-08-10T15:25:45Z chronyd exiting
I20260810 15:25:45.541970 18706 test_util.cc:175] -----------------------------------------------
I20260810 15:25:45.542124 18706 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786375520124696-18706-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (263 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260810 15:25:45.542976 18706 mini_oidc.cc:152] Starting JWKS server
I20260810 15:25:45.543717 18706 webserver.cc:460] Webserver started at https://127.0.0.1:38597/ using document root <none> and password file <none>
I20260810 15:25:45.543763 18706 mini_oidc.cc:189] Starting OIDC Discovery server
I20260810 15:25:45.544071 18706 webserver.cc:460] Webserver started at http://127.0.0.1:40911/ using document root <none> and password file <none>
2026-08-10T15:25:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T15:25:45Z Disabled control of system clock
I20260810 15:25:45.553221 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786375520124696-18706-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786375520124696-18706-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786375520124696-18706-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.190:45419
--webserver_interface=127.18.68.190
--webserver_port=0
--builtin_ntp_servers=127.18.68.148:46847
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.68.190:45419
--enable_jwt_token_auth=true
--jwks_url=https://localhost:38597/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786375520124696-18706-0/testchainca.cert with env {}
W20260810 15:25:45.636788 27962 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:25:45.637058 27962 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:25:45.637096 27962 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:25:45.638319 27962 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 15:25:45.638397 27962 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:25:45.638419 27962 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:25:45.638440 27962 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 15:25:45.638473 27962 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260810 15:25:45.638504 27962 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260810 15:25:45.638533 27962 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:38597/jwks.json
I20260810 15:25:45.640106 27962 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:46847
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786375520124696-18706-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786375520124696-18706-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.68.190:45419
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.190:45419
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:38597/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.68.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786375520124696-18706-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27962
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786375520124696-18706-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:25:45.640429 27962 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:25:45.640664 27962 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:25:45.646238 27978 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:45.646260 27975 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:45.646277 27974 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:25:45.646551 27962 server_base.cc:1034] running on GCE node
I20260810 15:25:45.646888 27962 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:25:45.647209 27962 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:25:45.648383 27962 hybrid_clock.cc:648] HybridClock initialized: now 1786375545648366 us; error 45 us; skew 500 ppm
I20260810 15:25:45.649704 27962 webserver.cc:460] Webserver started at http://127.18.68.190:45223/ using document root <none> and password file <none>
I20260810 15:25:45.649972 27962 fs_manager.cc:359] Metadata directory not provided
I20260810 15:25:45.650045 27962 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:25:45.650247 27962 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:25:45.651361 27962 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786375520124696-18706-0/minicluster-data/master-0/data/instance:
uuid: "8cb6f63ec91847e3b46af36917a7772f"
format_stamp: "Formatted at 2026-08-10 15:25:45 on dist-test-slave-2p8l"
server_key: "7eb1b5752a3b1ab0701925d73f341cd6"
server_key_iv: "1d5f26d7798ab1f596f7c629a71fe628"
server_key_version: "encryptionkey@0"
I20260810 15:25:45.651753 27962 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786375520124696-18706-0/minicluster-data/master-0/wal/instance:
uuid: "8cb6f63ec91847e3b46af36917a7772f"
format_stamp: "Formatted at 2026-08-10 15:25:45 on dist-test-slave-2p8l"
server_key: "7eb1b5752a3b1ab0701925d73f341cd6"
server_key_iv: "1d5f26d7798ab1f596f7c629a71fe628"
server_key_version: "encryptionkey@0"
I20260810 15:25:45.653172 27962 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 15:25:45.654026 27987 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:45.654268 27962 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:25:45.654381 27962 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786375520124696-18706-0/minicluster-data/master-0/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786375520124696-18706-0/minicluster-data/master-0/wal
uuid: "8cb6f63ec91847e3b46af36917a7772f"
format_stamp: "Formatted at 2026-08-10 15:25:45 on dist-test-slave-2p8l"
server_key: "7eb1b5752a3b1ab0701925d73f341cd6"
server_key_iv: "1d5f26d7798ab1f596f7c629a71fe628"
server_key_version: "encryptionkey@0"
I20260810 15:25:45.654465 27962 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786375520124696-18706-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786375520124696-18706-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786375520124696-18706-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:25:45.680766 27962 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:25:45.681141 27962 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:25:45.681317 27962 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:25:45.685746 27962 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.190:45419
I20260810 15:25:45.685786 28069 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.190:45419 every 8 connection(s)
I20260810 15:25:45.686194 27962 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
I20260810 15:25:45.686998 28075 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:25:45.688462 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 27962
I20260810 15:25:45.688570 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786375520124696-18706-0/minicluster-data/master-0/wal/instance
I20260810 15:25:45.688752 18706 external_mini_cluster.cc:1428] Setting key 549b9f5f0011309a5a330ffd151e36fc
I20260810 15:25:45.690981 28075 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8cb6f63ec91847e3b46af36917a7772f: Bootstrap starting.
I20260810 15:25:45.691675 28075 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8cb6f63ec91847e3b46af36917a7772f: Neither blocks nor log segments found. Creating new log.
I20260810 15:25:45.691995 28075 log.cc:824] T 00000000000000000000000000000000 P 8cb6f63ec91847e3b46af36917a7772f: Log is configured to *not* fsync() on all Append() calls
I20260810 15:25:45.692767 28075 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8cb6f63ec91847e3b46af36917a7772f: No bootstrap required, opened a new log
I20260810 15:25:45.694581 28078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:45.689353 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36954 (local address 127.18.68.190:45419)
0810 15:25:45.689582 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:45.689590 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:45.689618 (+ 28us) server_negotiation.cc:407] Connection header received
0810 15:25:45.690112 (+ 494us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:45.690126 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:45.690200 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:45.690324 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:45.690602 (+ 278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:45.691538 (+ 936us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:45.692584 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:45.693060 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:45.693155 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:45.693872 (+ 717us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:45.693876 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:45.693876 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 15:25:45.694035 (+ 159us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:45.694121 (+ 86us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 15:25:45.694142 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:45.694196 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:45.694292 (+ 96us) server_negotiation.cc:299] Negotiation successful
0810 15:25:45.694374 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":103,"threads_started":1}
I20260810 15:25:45.695283 28075 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8cb6f63ec91847e3b46af36917a7772f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cb6f63ec91847e3b46af36917a7772f" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 45419 } }
I20260810 15:25:45.695453 28075 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8cb6f63ec91847e3b46af36917a7772f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:25:45.695515 28075 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8cb6f63ec91847e3b46af36917a7772f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cb6f63ec91847e3b46af36917a7772f, State: Initialized, Role: FOLLOWER
I20260810 15:25:45.695652 28075 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8cb6f63ec91847e3b46af36917a7772f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cb6f63ec91847e3b46af36917a7772f" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 45419 } }
I20260810 15:25:45.695746 28075 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8cb6f63ec91847e3b46af36917a7772f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 15:25:45.695719 18706 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 15:25:45.695796 28075 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8cb6f63ec91847e3b46af36917a7772f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 15:25:45.695848 28075 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8cb6f63ec91847e3b46af36917a7772f [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:25:45.696506 28075 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8cb6f63ec91847e3b46af36917a7772f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cb6f63ec91847e3b46af36917a7772f" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 45419 } }
I20260810 15:25:45.696625 28075 leader_election.cc:302] T 00000000000000000000000000000000 P 8cb6f63ec91847e3b46af36917a7772f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8cb6f63ec91847e3b46af36917a7772f; no voters:
I20260810 15:25:45.696794 28075 leader_election.cc:288] T 00000000000000000000000000000000 P 8cb6f63ec91847e3b46af36917a7772f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 15:25:45.696832 28080 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8cb6f63ec91847e3b46af36917a7772f [term 1 FOLLOWER]: Leader election won for term 1
I20260810 15:25:45.697012 28080 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8cb6f63ec91847e3b46af36917a7772f [term 1 LEADER]: Becoming Leader. State: Replica: 8cb6f63ec91847e3b46af36917a7772f, State: Running, Role: LEADER
I20260810 15:25:45.697082 28075 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8cb6f63ec91847e3b46af36917a7772f [sys.catalog]: configured and running, proceeding with master startup.
I20260810 15:25:45.697099 28080 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8cb6f63ec91847e3b46af36917a7772f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cb6f63ec91847e3b46af36917a7772f" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 45419 } }
I20260810 15:25:45.697517 28082 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8cb6f63ec91847e3b46af36917a7772f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8cb6f63ec91847e3b46af36917a7772f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cb6f63ec91847e3b46af36917a7772f" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 45419 } } }
I20260810 15:25:45.697616 28082 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8cb6f63ec91847e3b46af36917a7772f [sys.catalog]: This master's current role is: LEADER
I20260810 15:25:45.698129 28083 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8cb6f63ec91847e3b46af36917a7772f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8cb6f63ec91847e3b46af36917a7772f. Latest consensus state: current_term: 1 leader_uuid: "8cb6f63ec91847e3b46af36917a7772f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cb6f63ec91847e3b46af36917a7772f" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 45419 } } }
I20260810 15:25:45.698210 28083 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8cb6f63ec91847e3b46af36917a7772f [sys.catalog]: This master's current role is: LEADER
I20260810 15:25:45.698342 28093 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 15:25:45.698789 28093 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 15:25:45.700419 28093 catalog_manager.cc:1347] Generated new cluster ID: 6bc4d219fdf4466e89466f5b00a353c1
I20260810 15:25:45.700477 28093 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 15:25:45.707556 28093 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 15:25:45.708287 28093 catalog_manager.cc:1504] Loading token signing keys...
I20260810 15:25:45.712790 28093 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8cb6f63ec91847e3b46af36917a7772f: Generated new TSK 0
I20260810 15:25:45.712984 28093 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260810 15:25:45.740945 28123 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260810 15:25:45.741060 28123 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260810 15:25:45.741472 28078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:45.726391 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36960 (local address 127.18.68.190:45419)
0810 15:25:45.726460 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:45.726463 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:45.726612 (+ 149us) server_negotiation.cc:407] Connection header received
0810 15:25:45.726701 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:45.726702 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:45.726720 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:45.726800 (+ 80us) server_negotiation.cc:226] Negotiated authn=JWT
0810 15:25:45.726937 (+ 137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:45.727459 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:45.728240 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:45.728441 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:45.728521 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:45.728715 (+ 194us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0810 15:25:45.741197 (+ 12482us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38597/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0810 15:25:45.741383 (+ 186us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:36960: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38597/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":40}
W20260810 15:25:45.741555 28078 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:36960: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38597/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260810 15:25:45.741566 28122 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 15:25:45.726311 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:45419 (local address 127.0.0.1:36960)
0810 15:25:45.726494 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:45.726554 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:45.726632 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:45.726800 (+ 168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:45.726801 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:45.726803 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0810 15:25:45.726865 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:45.726866 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:45.727554 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:45.727556 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:45.728148 (+ 592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:45.728149 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:45.728527 (+ 378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:45.728529 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:45.728587 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:45.728593 (+ 6us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0810 15:25:45.741324 (+ 12731us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38597/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0810 15:25:45.741447 (+ 123us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.18.68.190:45419: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38597/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":113,"threads_started":1}
I20260810 15:25:45.741948 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 27962
2026-08-10T15:25:45Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (256 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260810 15:25:45.799750 18706 mini_oidc.cc:152] Starting JWKS server
I20260810 15:25:45.800457 18706 webserver.cc:460] Webserver started at https://127.0.0.1:38661/ using document root <none> and password file <none>
I20260810 15:25:45.800506 18706 mini_oidc.cc:189] Starting OIDC Discovery server
I20260810 15:25:45.800657 18706 webserver.cc:460] Webserver started at http://127.0.0.1:45875/ using document root <none> and password file <none>
2026-08-10T15:25:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T15:25:45Z Disabled control of system clock
I20260810 15:25:45.809787 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786375520124696-18706-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786375520124696-18706-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786375520124696-18706-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.190:46711
--webserver_interface=127.18.68.190
--webserver_port=0
--builtin_ntp_servers=127.18.68.148:41235
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.68.190:46711
--enable_jwt_token_auth=true
--jwks_url=https://localhost:38661/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260810 15:25:45.897655 28139 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:25:45.897933 28139 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:25:45.897974 28139 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:25:45.899206 28139 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 15:25:45.899287 28139 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:25:45.899312 28139 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:25:45.899343 28139 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 15:25:45.899370 28139 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260810 15:25:45.899392 28139 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260810 15:25:45.899422 28139 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:38661/jwks.json
I20260810 15:25:45.900818 28139 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:41235
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786375520124696-18706-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786375520124696-18706-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.68.190:46711
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.190:46711
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:38661/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.68.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28139
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786375520124696-18706-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:25:45.901108 28139 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:25:45.901420 28139 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:25:45.906451 28148 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:45.906476 28151 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:45.906508 28149 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:25:45.906726 28139 server_base.cc:1034] running on GCE node
I20260810 15:25:45.906966 28139 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:25:45.907277 28139 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:25:45.908442 28139 hybrid_clock.cc:648] HybridClock initialized: now 1786375545908401 us; error 50 us; skew 500 ppm
I20260810 15:25:45.909829 28139 webserver.cc:460] Webserver started at http://127.18.68.190:40541/ using document root <none> and password file <none>
I20260810 15:25:45.910137 28139 fs_manager.cc:359] Metadata directory not provided
I20260810 15:25:45.910218 28139 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:25:45.910383 28139 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:25:45.911515 28139 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786375520124696-18706-0/minicluster-data/master-0/data/instance:
uuid: "ada60c10bbe14377813b2c335d5efcf3"
format_stamp: "Formatted at 2026-08-10 15:25:45 on dist-test-slave-2p8l"
server_key: "b57b0def1db834af5db6a852c1332e65"
server_key_iv: "b69e3a405cd89a1273b09d67cb99fdf8"
server_key_version: "encryptionkey@0"
I20260810 15:25:45.911900 28139 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786375520124696-18706-0/minicluster-data/master-0/wal/instance:
uuid: "ada60c10bbe14377813b2c335d5efcf3"
format_stamp: "Formatted at 2026-08-10 15:25:45 on dist-test-slave-2p8l"
server_key: "b57b0def1db834af5db6a852c1332e65"
server_key_iv: "b69e3a405cd89a1273b09d67cb99fdf8"
server_key_version: "encryptionkey@0"
I20260810 15:25:45.913257 28139 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 15:25:45.914119 28161 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:45.914321 28139 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 15:25:45.914424 28139 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786375520124696-18706-0/minicluster-data/master-0/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786375520124696-18706-0/minicluster-data/master-0/wal
uuid: "ada60c10bbe14377813b2c335d5efcf3"
format_stamp: "Formatted at 2026-08-10 15:25:45 on dist-test-slave-2p8l"
server_key: "b57b0def1db834af5db6a852c1332e65"
server_key_iv: "b69e3a405cd89a1273b09d67cb99fdf8"
server_key_version: "encryptionkey@0"
I20260810 15:25:45.914515 28139 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786375520124696-18706-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786375520124696-18706-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786375520124696-18706-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:25:45.935210 28139 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:25:45.935591 28139 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:25:45.935809 28139 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:25:45.940207 28139 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.190:46711
I20260810 15:25:45.940305 28252 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.190:46711 every 8 connection(s)
I20260810 15:25:45.940673 28139 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
I20260810 15:25:45.941589 28253 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:25:45.944643 28253 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ada60c10bbe14377813b2c335d5efcf3: Bootstrap starting.
I20260810 15:25:45.944953 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 28139
I20260810 15:25:45.945078 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786375520124696-18706-0/minicluster-data/master-0/wal/instance
I20260810 15:25:45.945274 18706 external_mini_cluster.cc:1428] Setting key 9f5127c537921e85779c8278eb19044f
I20260810 15:25:45.945458 28253 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ada60c10bbe14377813b2c335d5efcf3: Neither blocks nor log segments found. Creating new log.
I20260810 15:25:45.945845 28253 log.cc:824] T 00000000000000000000000000000000 P ada60c10bbe14377813b2c335d5efcf3: Log is configured to *not* fsync() on all Append() calls
I20260810 15:25:45.946619 28253 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ada60c10bbe14377813b2c335d5efcf3: No bootstrap required, opened a new log
I20260810 15:25:45.948788 28253 raft_consensus.cc:348] T 00000000000000000000000000000000 P ada60c10bbe14377813b2c335d5efcf3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ada60c10bbe14377813b2c335d5efcf3" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46711 } }
I20260810 15:25:45.948964 28253 raft_consensus.cc:374] T 00000000000000000000000000000000 P ada60c10bbe14377813b2c335d5efcf3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:25:45.948997 28253 raft_consensus.cc:729] T 00000000000000000000000000000000 P ada60c10bbe14377813b2c335d5efcf3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ada60c10bbe14377813b2c335d5efcf3, State: Initialized, Role: FOLLOWER
I20260810 15:25:45.949134 28253 consensus_queue.cc:260] T 00000000000000000000000000000000 P ada60c10bbe14377813b2c335d5efcf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ada60c10bbe14377813b2c335d5efcf3" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46711 } }
I20260810 15:25:45.949229 28253 raft_consensus.cc:388] T 00000000000000000000000000000000 P ada60c10bbe14377813b2c335d5efcf3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 15:25:45.949260 28253 raft_consensus.cc:482] T 00000000000000000000000000000000 P ada60c10bbe14377813b2c335d5efcf3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 15:25:45.949306 28253 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ada60c10bbe14377813b2c335d5efcf3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:25:45.950032 28253 raft_consensus.cc:504] T 00000000000000000000000000000000 P ada60c10bbe14377813b2c335d5efcf3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ada60c10bbe14377813b2c335d5efcf3" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46711 } }
I20260810 15:25:45.950210 28253 leader_election.cc:302] T 00000000000000000000000000000000 P ada60c10bbe14377813b2c335d5efcf3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ada60c10bbe14377813b2c335d5efcf3; no voters:
I20260810 15:25:45.950395 28253 leader_election.cc:288] T 00000000000000000000000000000000 P ada60c10bbe14377813b2c335d5efcf3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 15:25:45.950436 28260 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ada60c10bbe14377813b2c335d5efcf3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 15:25:45.950680 28253 sys_catalog.cc:564] T 00000000000000000000000000000000 P ada60c10bbe14377813b2c335d5efcf3 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 15:25:45.950811 28260 raft_consensus.cc:686] T 00000000000000000000000000000000 P ada60c10bbe14377813b2c335d5efcf3 [term 1 LEADER]: Becoming Leader. State: Replica: ada60c10bbe14377813b2c335d5efcf3, State: Running, Role: LEADER
I20260810 15:25:45.950920 28260 consensus_queue.cc:237] T 00000000000000000000000000000000 P ada60c10bbe14377813b2c335d5efcf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ada60c10bbe14377813b2c335d5efcf3" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46711 } }
I20260810 15:25:45.951298 28260 sys_catalog.cc:455] T 00000000000000000000000000000000 P ada60c10bbe14377813b2c335d5efcf3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ada60c10bbe14377813b2c335d5efcf3. Latest consensus state: current_term: 1 leader_uuid: "ada60c10bbe14377813b2c335d5efcf3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ada60c10bbe14377813b2c335d5efcf3" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46711 } } }
I20260810 15:25:45.951377 28260 sys_catalog.cc:458] T 00000000000000000000000000000000 P ada60c10bbe14377813b2c335d5efcf3 [sys.catalog]: This master's current role is: LEADER
I20260810 15:25:45.951727 28258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:45.945865 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42532 (local address 127.18.68.190:46711)
0810 15:25:45.946129 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:45.946136 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:45.946163 (+ 27us) server_negotiation.cc:407] Connection header received
0810 15:25:45.946618 (+ 455us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:45.946624 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:45.946720 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:45.946851 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:45.947125 (+ 274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:45.948007 (+ 882us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:45.949171 (+ 1164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:45.949804 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:45.949942 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:45.950753 (+ 811us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:45.950758 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:45.950758 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 15:25:45.950975 (+ 217us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:45.951019 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 15:25:45.951033 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:45.951102 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:45.951409 (+ 307us) server_negotiation.cc:299] Negotiation successful
0810 15:25:45.951508 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":123,"threads_started":1}
I20260810 15:25:45.952318 28261 sys_catalog.cc:455] T 00000000000000000000000000000000 P ada60c10bbe14377813b2c335d5efcf3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ada60c10bbe14377813b2c335d5efcf3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ada60c10bbe14377813b2c335d5efcf3" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46711 } } }
I20260810 15:25:45.952406 28261 sys_catalog.cc:458] T 00000000000000000000000000000000 P ada60c10bbe14377813b2c335d5efcf3 [sys.catalog]: This master's current role is: LEADER
W20260810 15:25:45.952615 28285 catalog_manager.cc:1558] T 00000000000000000000000000000000 P ada60c10bbe14377813b2c335d5efcf3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260810 15:25:45.952649 18706 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260810 15:25:45.952668 28285 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 15:25:45.952886 28274 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 15:25:45.953061 28274 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 15:25:45.954643 28274 catalog_manager.cc:1347] Generated new cluster ID: 5fd758608a30400fb9a76650a8d02ede
I20260810 15:25:45.954698 28274 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 15:25:45.965925 28274 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 15:25:45.966478 28274 catalog_manager.cc:1504] Loading token signing keys...
I20260810 15:25:45.974104 28274 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ada60c10bbe14377813b2c335d5efcf3: Generated new TSK 0
I20260810 15:25:45.974336 28274 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 15:25:45.985559 28258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:45.981453 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42534 (local address 127.18.68.190:46711)
0810 15:25:45.981507 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:45.981509 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:45.981613 (+ 104us) server_negotiation.cc:407] Connection header received
0810 15:25:45.981683 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:45.981684 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:45.981695 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:45.981761 (+ 66us) server_negotiation.cc:226] Negotiated authn=JWT
0810 15:25:45.981937 (+ 176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:45.982535 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:45.983706 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:45.983933 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:45.983996 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:45.984235 (+ 239us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0810 15:25:45.985323 (+ 1088us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38661/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0810 15:25:45.985480 (+ 157us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:42534: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38661/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":30}
W20260810 15:25:45.985632 28258 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:42534: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38661/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260810 15:25:45.985926 28298 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 15:25:45.981341 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46711 (local address 127.0.0.1:42534)
0810 15:25:45.981527 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:45.981539 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:45.981608 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:45.981781 (+ 173us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:45.981782 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:45.981784 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0810 15:25:45.981841 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:45.981843 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:45.982659 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:45.982660 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:45.983611 (+ 951us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:45.983614 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:45.984024 (+ 410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:45.984025 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:45.984093 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:45.984099 (+ 6us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0810 15:25:45.985433 (+ 1334us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38661/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0810 15:25:45.985549 (+ 116us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.18.68.190:46711: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38661/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":122,"threads_started":1}
I20260810 15:25:45.986217 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 28139
E20260810 15:25:46.004952 28299 webserver.cc:533] Webserver: sslize failed:
E20260810 15:25:46.005054 28299 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-10T15:25:46Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (233 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-10T15:25:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T15:25:46Z Disabled control of system clock
I20260810 15:25:46.042625 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786375520124696-18706-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786375520124696-18706-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786375520124696-18706-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.190:46143
--webserver_interface=127.18.68.190
--webserver_port=0
--builtin_ntp_servers=127.18.68.148:32947
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.68.190:46143
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786375520124696-18706-0/testchainca.cert with env {}
W20260810 15:25:46.127748 28308 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:25:46.127964 28308 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:25:46.127987 28308 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:25:46.129245 28308 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 15:25:46.129303 28308 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:25:46.129317 28308 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:25:46.129330 28308 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 15:25:46.129343 28308 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260810 15:25:46.129354 28308 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260810 15:25:46.129402 28308 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260810 15:25:46.131064 28308 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:32947
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786375520124696-18706-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786375520124696-18706-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.68.190:46143
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.190:46143
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.68.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786375520124696-18706-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28308
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786375520124696-18706-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:25:46.131341 28308 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:25:46.131570 28308 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:25:46.136554 28317 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:46.136579 28324 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:25:46.136557 28308 server_base.cc:1034] running on GCE node
W20260810 15:25:46.136577 28320 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:25:46.136979 28308 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:25:46.137286 28308 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:25:46.138437 28308 hybrid_clock.cc:648] HybridClock initialized: now 1786375546138421 us; error 31 us; skew 500 ppm
I20260810 15:25:46.139828 28308 webserver.cc:460] Webserver started at http://127.18.68.190:38675/ using document root <none> and password file <none>
I20260810 15:25:46.140168 28308 fs_manager.cc:359] Metadata directory not provided
I20260810 15:25:46.140267 28308 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:25:46.140424 28308 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:25:46.141829 28308 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786375520124696-18706-0/minicluster-data/master-0/data/instance:
uuid: "bc1fc20551d7493f82df78583ab56807"
format_stamp: "Formatted at 2026-08-10 15:25:46 on dist-test-slave-2p8l"
server_key: "268489a1e3945c066b0acca53cfb7ba6"
server_key_iv: "c525b4cc532a14d6b177ee7ddd635966"
server_key_version: "encryptionkey@0"
I20260810 15:25:46.142226 28308 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786375520124696-18706-0/minicluster-data/master-0/wal/instance:
uuid: "bc1fc20551d7493f82df78583ab56807"
format_stamp: "Formatted at 2026-08-10 15:25:46 on dist-test-slave-2p8l"
server_key: "268489a1e3945c066b0acca53cfb7ba6"
server_key_iv: "c525b4cc532a14d6b177ee7ddd635966"
server_key_version: "encryptionkey@0"
I20260810 15:25:46.143724 28308 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260810 15:25:46.144616 28330 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:46.144801 28308 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 15:25:46.144913 28308 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786375520124696-18706-0/minicluster-data/master-0/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786375520124696-18706-0/minicluster-data/master-0/wal
uuid: "bc1fc20551d7493f82df78583ab56807"
format_stamp: "Formatted at 2026-08-10 15:25:46 on dist-test-slave-2p8l"
server_key: "268489a1e3945c066b0acca53cfb7ba6"
server_key_iv: "c525b4cc532a14d6b177ee7ddd635966"
server_key_version: "encryptionkey@0"
I20260810 15:25:46.144992 28308 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786375520124696-18706-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786375520124696-18706-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786375520124696-18706-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:25:46.161387 28308 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:25:46.161799 28308 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:25:46.161975 28308 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:25:46.166405 28308 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.190:46143
I20260810 15:25:46.166442 28418 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.190:46143 every 8 connection(s)
I20260810 15:25:46.166826 28308 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
I20260810 15:25:46.167608 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 28308
I20260810 15:25:46.167729 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786375520124696-18706-0/minicluster-data/master-0/wal/instance
I20260810 15:25:46.167980 18706 external_mini_cluster.cc:1428] Setting key 0caea38bc9be762c4120e68f16d1518c
I20260810 15:25:46.168089 28421 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:25:46.171649 28421 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bc1fc20551d7493f82df78583ab56807: Bootstrap starting.
I20260810 15:25:46.172576 28421 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bc1fc20551d7493f82df78583ab56807: Neither blocks nor log segments found. Creating new log.
I20260810 15:25:46.172950 28421 log.cc:824] T 00000000000000000000000000000000 P bc1fc20551d7493f82df78583ab56807: Log is configured to *not* fsync() on all Append() calls
I20260810 15:25:46.173830 28421 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bc1fc20551d7493f82df78583ab56807: No bootstrap required, opened a new log
I20260810 15:25:46.174640 28428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:46.168590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53128 (local address 127.18.68.190:46143)
0810 15:25:46.168816 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:46.168824 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:46.168849 (+ 25us) server_negotiation.cc:407] Connection header received
0810 15:25:46.169264 (+ 415us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:46.169270 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:46.169334 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:46.169456 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:46.169835 (+ 379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:46.170953 (+ 1118us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:46.172114 (+ 1161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:46.172835 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:46.172953 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:46.173794 (+ 841us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:46.173799 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:46.173799 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 15:25:46.174025 (+ 226us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:46.174092 (+ 67us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 15:25:46.174109 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:46.174181 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:46.174324 (+ 143us) server_negotiation.cc:299] Negotiation successful
0810 15:25:46.174415 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":160,"thread_start_us":94,"threads_started":1}
I20260810 15:25:46.175727 18706 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 15:25:46.176224 28421 raft_consensus.cc:348] T 00000000000000000000000000000000 P bc1fc20551d7493f82df78583ab56807 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc1fc20551d7493f82df78583ab56807" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46143 } }
I20260810 15:25:46.176420 28421 raft_consensus.cc:374] T 00000000000000000000000000000000 P bc1fc20551d7493f82df78583ab56807 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:25:46.176460 28421 raft_consensus.cc:729] T 00000000000000000000000000000000 P bc1fc20551d7493f82df78583ab56807 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc1fc20551d7493f82df78583ab56807, State: Initialized, Role: FOLLOWER
I20260810 15:25:46.176584 28421 consensus_queue.cc:260] T 00000000000000000000000000000000 P bc1fc20551d7493f82df78583ab56807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc1fc20551d7493f82df78583ab56807" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46143 } }
I20260810 15:25:46.176694 28421 raft_consensus.cc:388] T 00000000000000000000000000000000 P bc1fc20551d7493f82df78583ab56807 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 15:25:46.176740 28421 raft_consensus.cc:482] T 00000000000000000000000000000000 P bc1fc20551d7493f82df78583ab56807 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 15:25:46.176791 28421 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bc1fc20551d7493f82df78583ab56807 [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:25:46.177429 28421 raft_consensus.cc:504] T 00000000000000000000000000000000 P bc1fc20551d7493f82df78583ab56807 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc1fc20551d7493f82df78583ab56807" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46143 } }
I20260810 15:25:46.177559 28421 leader_election.cc:302] T 00000000000000000000000000000000 P bc1fc20551d7493f82df78583ab56807 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bc1fc20551d7493f82df78583ab56807; no voters:
I20260810 15:25:46.177762 28421 leader_election.cc:288] T 00000000000000000000000000000000 P bc1fc20551d7493f82df78583ab56807 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 15:25:46.177954 28430 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bc1fc20551d7493f82df78583ab56807 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 15:25:46.178054 28421 sys_catalog.cc:564] T 00000000000000000000000000000000 P bc1fc20551d7493f82df78583ab56807 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 15:25:46.178184 28430 raft_consensus.cc:686] T 00000000000000000000000000000000 P bc1fc20551d7493f82df78583ab56807 [term 1 LEADER]: Becoming Leader. State: Replica: bc1fc20551d7493f82df78583ab56807, State: Running, Role: LEADER
I20260810 15:25:46.178282 28430 consensus_queue.cc:237] T 00000000000000000000000000000000 P bc1fc20551d7493f82df78583ab56807 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc1fc20551d7493f82df78583ab56807" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46143 } }
I20260810 15:25:46.178668 28432 sys_catalog.cc:455] T 00000000000000000000000000000000 P bc1fc20551d7493f82df78583ab56807 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bc1fc20551d7493f82df78583ab56807. Latest consensus state: current_term: 1 leader_uuid: "bc1fc20551d7493f82df78583ab56807" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc1fc20551d7493f82df78583ab56807" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46143 } } }
I20260810 15:25:46.178668 28431 sys_catalog.cc:455] T 00000000000000000000000000000000 P bc1fc20551d7493f82df78583ab56807 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bc1fc20551d7493f82df78583ab56807" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc1fc20551d7493f82df78583ab56807" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46143 } } }
I20260810 15:25:46.178771 28432 sys_catalog.cc:458] T 00000000000000000000000000000000 P bc1fc20551d7493f82df78583ab56807 [sys.catalog]: This master's current role is: LEADER
I20260810 15:25:46.178771 28431 sys_catalog.cc:458] T 00000000000000000000000000000000 P bc1fc20551d7493f82df78583ab56807 [sys.catalog]: This master's current role is: LEADER
I20260810 15:25:46.178968 28440 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 15:25:46.179497 28440 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 15:25:46.181087 28440 catalog_manager.cc:1347] Generated new cluster ID: f2d16dd7b0314709987a8479ff684892
I20260810 15:25:46.181165 28440 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 15:25:46.201153 28440 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 15:25:46.201795 28440 catalog_manager.cc:1504] Loading token signing keys...
I20260810 15:25:46.213804 28440 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bc1fc20551d7493f82df78583ab56807: Generated new TSK 0
I20260810 15:25:46.214098 28440 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 15:25:46.307725 28428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:46.227278 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53138 (local address 127.18.68.190:46143)
0810 15:25:46.227332 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:46.227334 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:46.227438 (+ 104us) server_negotiation.cc:407] Connection header received
0810 15:25:46.227516 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:46.227517 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:46.227532 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:46.227607 (+ 75us) server_negotiation.cc:226] Negotiated authn=JWT
0810 15:25:46.227758 (+ 151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:46.228552 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:46.229414 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:46.229745 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:46.229821 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:46.230007 (+ 186us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0810 15:25:46.307423 (+ 77416us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0810 15:25:46.307626 (+ 203us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:53138: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":27}
W20260810 15:25:46.307821 28428 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:53138: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260810 15:25:46.307845 28471 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 15:25:46.227151 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46143 (local address 127.0.0.1:53138)
0810 15:25:46.227376 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:46.227385 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:46.227439 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:46.227622 (+ 183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:46.227623 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:46.227624 (+ 1us) client_negotiation.cc:189] Negotiated authn=JWT
0810 15:25:46.227691 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:46.227693 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:46.228687 (+ 994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:46.228687 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:46.229333 (+ 646us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:46.229336 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:46.229843 (+ 507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:46.229844 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:46.229889 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:46.229894 (+ 5us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0810 15:25:46.307583 (+ 77689us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0810 15:25:46.307714 (+ 131us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.18.68.190:46143: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":132,"threads_started":1}
I20260810 15:25:46.308394 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 28308
2026-08-10T15:25:46Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (301 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (92 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (90 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 15:25:46 dist-test-slave-2p8l krb5kdc[28488](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 15:25:46 dist-test-slave-2p8l krb5kdc[28488](info): set up 2 sockets
Aug 10 15:25:46 dist-test-slave-2p8l krb5kdc[28488](info): commencing operation
krb5kdc: starting...
W20260810 15:25:47.801712 18706 mini_kdc.cc:121] Time spent starting KDC: real 1.282s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/krb5kdc/test-user.keytab.
Aug 10 15:25:47 dist-test-slave-2p8l krb5kdc[28488](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375547, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T15:25:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T15:25:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.68.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.68.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.68.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab.
Entry for principal kudu/127.18.68.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab.
I20260810 15:25:47.932662 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.190:41809
--webserver_interface=127.18.68.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab
--principal=kudu/127.18.68.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:44785
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.68.190:41809
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:25:48.019229 28509 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:25:48.019451 28509 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:25:48.019479 28509 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:25:48.020665 28509 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 15:25:48.020710 28509 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:25:48.020725 28509 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:25:48.020738 28509 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 15:25:48.020750 28509 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 15:25:48.022385 28509 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:44785
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.68.190:41809
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab
--principal=kudu/127.18.68.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.190:41809
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.68.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28509
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:25:48.022652 28509 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:25:48.022887 28509 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:25:48.027709 28522 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:48.027738 28518 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:48.027751 28519 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:25:48.028035 28509 server_base.cc:1034] running on GCE node
I20260810 15:25:48.028301 28509 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:25:48.028606 28509 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:25:48.029789 28509 hybrid_clock.cc:648] HybridClock initialized: now 1786375548029775 us; error 33 us; skew 500 ppm
Aug 10 15:25:48 dist-test-slave-2p8l krb5kdc[28488](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375548, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:25:48.032464 28509 init.cc:377] Logged in from keytab as kudu/127.18.68.190@KRBTEST.COM (short username kudu)
I20260810 15:25:48.032913 28509 webserver.cc:460] Webserver started at http://127.18.68.190:44547/ using document root <none> and password file <none>
I20260810 15:25:48.033164 28509 fs_manager.cc:359] Metadata directory not provided
I20260810 15:25:48.033238 28509 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:25:48.033390 28509 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:25:48.034546 28509 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/minicluster-data/master-0/data/instance:
uuid: "8374abfd07d14bc18e6b872c46753ca4"
format_stamp: "Formatted at 2026-08-10 15:25:48 on dist-test-slave-2p8l"
server_key: "89d00e44bd7344cf1d99a801dc4fa02f"
server_key_iv: "67d6d948fb527fd129c0de0e70ada21f"
server_key_version: "encryptionkey@0"
I20260810 15:25:48.034931 28509 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/minicluster-data/master-0/wal/instance:
uuid: "8374abfd07d14bc18e6b872c46753ca4"
format_stamp: "Formatted at 2026-08-10 15:25:48 on dist-test-slave-2p8l"
server_key: "89d00e44bd7344cf1d99a801dc4fa02f"
server_key_iv: "67d6d948fb527fd129c0de0e70ada21f"
server_key_version: "encryptionkey@0"
I20260810 15:25:48.036401 28509 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 15:25:48.037240 28535 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:48.037459 28509 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:25:48.037571 28509 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/minicluster-data/master-0/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/minicluster-data/master-0/wal
uuid: "8374abfd07d14bc18e6b872c46753ca4"
format_stamp: "Formatted at 2026-08-10 15:25:48 on dist-test-slave-2p8l"
server_key: "89d00e44bd7344cf1d99a801dc4fa02f"
server_key_iv: "67d6d948fb527fd129c0de0e70ada21f"
server_key_version: "encryptionkey@0"
I20260810 15:25:48.037663 28509 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:25:48.053930 28509 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:25:48.056430 28509 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:25:48.056562 28509 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:25:48.060696 28509 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.190:41809
I20260810 15:25:48.060774 28629 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.190:41809 every 8 connection(s)
I20260810 15:25:48.061115 28509 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
I20260810 15:25:48.062193 28631 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:25:48.064626 28631 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8374abfd07d14bc18e6b872c46753ca4: Bootstrap starting.
I20260810 15:25:48.065421 28631 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8374abfd07d14bc18e6b872c46753ca4: Neither blocks nor log segments found. Creating new log.
I20260810 15:25:48.065866 28631 log.cc:824] T 00000000000000000000000000000000 P 8374abfd07d14bc18e6b872c46753ca4: Log is configured to *not* fsync() on all Append() calls
I20260810 15:25:48.066735 28631 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8374abfd07d14bc18e6b872c46753ca4: No bootstrap required, opened a new log
I20260810 15:25:48.068351 28631 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8374abfd07d14bc18e6b872c46753ca4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8374abfd07d14bc18e6b872c46753ca4" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 41809 } }
I20260810 15:25:48.068526 28631 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8374abfd07d14bc18e6b872c46753ca4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:25:48.068576 28631 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8374abfd07d14bc18e6b872c46753ca4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8374abfd07d14bc18e6b872c46753ca4, State: Initialized, Role: FOLLOWER
I20260810 15:25:48.068719 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 28509
I20260810 15:25:48.068776 28631 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8374abfd07d14bc18e6b872c46753ca4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8374abfd07d14bc18e6b872c46753ca4" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 41809 } }
I20260810 15:25:48.068842 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/minicluster-data/master-0/wal/instance
I20260810 15:25:48.068871 28631 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8374abfd07d14bc18e6b872c46753ca4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 15:25:48.068913 28631 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8374abfd07d14bc18e6b872c46753ca4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 15:25:48.068966 28631 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8374abfd07d14bc18e6b872c46753ca4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:25:48.069031 18706 external_mini_cluster.cc:1428] Setting key a3fa246e97596ee537b3822bf6658a05
I20260810 15:25:48.069733 28631 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8374abfd07d14bc18e6b872c46753ca4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8374abfd07d14bc18e6b872c46753ca4" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 41809 } }
I20260810 15:25:48.069865 28631 leader_election.cc:302] T 00000000000000000000000000000000 P 8374abfd07d14bc18e6b872c46753ca4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8374abfd07d14bc18e6b872c46753ca4; no voters:
I20260810 15:25:48.070096 28631 leader_election.cc:288] T 00000000000000000000000000000000 P 8374abfd07d14bc18e6b872c46753ca4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 15:25:48.070150 28640 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8374abfd07d14bc18e6b872c46753ca4 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 15:25:48.070343 28640 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8374abfd07d14bc18e6b872c46753ca4 [term 1 LEADER]: Becoming Leader. State: Replica: 8374abfd07d14bc18e6b872c46753ca4, State: Running, Role: LEADER
I20260810 15:25:48.070493 28631 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8374abfd07d14bc18e6b872c46753ca4 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 15:25:48.070479 28640 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8374abfd07d14bc18e6b872c46753ca4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8374abfd07d14bc18e6b872c46753ca4" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 41809 } }
I20260810 15:25:48.070863 28640 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8374abfd07d14bc18e6b872c46753ca4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8374abfd07d14bc18e6b872c46753ca4. Latest consensus state: current_term: 1 leader_uuid: "8374abfd07d14bc18e6b872c46753ca4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8374abfd07d14bc18e6b872c46753ca4" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 41809 } } }
I20260810 15:25:48.071009 28640 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8374abfd07d14bc18e6b872c46753ca4 [sys.catalog]: This master's current role is: LEADER
I20260810 15:25:48.071478 28658 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 15:25:48.071700 28649 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8374abfd07d14bc18e6b872c46753ca4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8374abfd07d14bc18e6b872c46753ca4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8374abfd07d14bc18e6b872c46753ca4" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 41809 } } }
I20260810 15:25:48.071861 28649 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8374abfd07d14bc18e6b872c46753ca4 [sys.catalog]: This master's current role is: LEADER
I20260810 15:25:48.072062 28658 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 15:25:48.074542 28658 catalog_manager.cc:1347] Generated new cluster ID: 68e4014a8ffe4b18a8695ea7449ac8aa
I20260810 15:25:48.074594 28658 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 10 15:25:48 dist-test-slave-2p8l krb5kdc[28488](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375547, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
I20260810 15:25:48.080340 28643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:48.069954 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41482 (local address 127.18.68.190:41809)
0810 15:25:48.070322 (+ 368us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:48.070348 (+ 26us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:48.070387 (+ 39us) server_negotiation.cc:407] Connection header received
0810 15:25:48.070503 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:48.070510 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:48.070566 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:48.070735 (+ 169us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:48.071544 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:48.072853 (+ 1309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:48.073914 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:48.074388 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:48.074504 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:48.076896 (+ 2392us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:48.076900 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:48.076901 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:48.076913 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:48.078744 (+ 1831us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:48.079147 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:48.079150 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:48.079150 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:48.079258 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:48.079473 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:48.079475 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:48.079475 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:48.079726 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:48.079891 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:48.080000 (+ 109us) server_negotiation.cc:299] Negotiation successful
0810 15:25:48.080148 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":286,"thread_start_us":139,"threads_started":1}
I20260810 15:25:48.090236 28658 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 15:25:48.090806 28658 catalog_manager.cc:1504] Loading token signing keys...
I20260810 15:25:48.095110 28658 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8374abfd07d14bc18e6b872c46753ca4: Generated new TSK 0
I20260810 15:25:48.095293 28658 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.18.68.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.68.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.68.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.129.keytab.
Entry for principal kudu/127.18.68.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.129.keytab.
I20260810 15:25:48.128952 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.68.129:0
--local_ip_for_outbound_sockets=127.18.68.129
--webserver_interface=127.18.68.129
--webserver_port=0
--tserver_master_addrs=127.18.68.190:41809
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.129.keytab
--principal=kudu/127.18.68.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:44785
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:25:48.221288 28682 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:25:48.221545 28682 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:25:48.221589 28682 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:25:48.223153 28682 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:25:48.223234 28682 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:25:48.223280 28682 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.68.129
I20260810 15:25:48.225006 28682 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:44785
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.129.keytab
--principal=kudu/127.18.68.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.68.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.68.129
--webserver_port=0
--tserver_master_addrs=127.18.68.190:41809
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28682
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.68.129
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:25:48.225292 28682 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:25:48.225534 28682 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:25:48.230855 28702 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:48.230855 28699 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:25:48.231081 28682 server_base.cc:1034] running on GCE node
W20260810 15:25:48.230957 28695 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:25:48.231441 28682 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:25:48.231654 28682 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:25:48.232818 28682 hybrid_clock.cc:648] HybridClock initialized: now 1786375548232801 us; error 30 us; skew 500 ppm
Aug 10 15:25:48 dist-test-slave-2p8l krb5kdc[28488](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375548, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:25:48.235560 28682 init.cc:377] Logged in from keytab as kudu/127.18.68.129@KRBTEST.COM (short username kudu)
I20260810 15:25:48.236024 28682 webserver.cc:460] Webserver started at http://127.18.68.129:34717/ using document root <none> and password file <none>
I20260810 15:25:48.236264 28682 fs_manager.cc:359] Metadata directory not provided
I20260810 15:25:48.236311 28682 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:25:48.236449 28682 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:25:48.237493 28682 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/minicluster-data/ts-0/data/instance:
uuid: "319bd66c53dc453b98998b46dfbd1beb"
format_stamp: "Formatted at 2026-08-10 15:25:48 on dist-test-slave-2p8l"
server_key: "e85b298bcc40c1ef9a505c6b8b1a42cd"
server_key_iv: "f42b8d6f846c58b246add4e4de5cffb1"
server_key_version: "encryptionkey@0"
I20260810 15:25:48.237870 28682 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/minicluster-data/ts-0/wal/instance:
uuid: "319bd66c53dc453b98998b46dfbd1beb"
format_stamp: "Formatted at 2026-08-10 15:25:48 on dist-test-slave-2p8l"
server_key: "e85b298bcc40c1ef9a505c6b8b1a42cd"
server_key_iv: "f42b8d6f846c58b246add4e4de5cffb1"
server_key_version: "encryptionkey@0"
I20260810 15:25:48.239326 28682 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260810 15:25:48.240146 28712 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:48.240360 28682 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 15:25:48.240453 28682 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/minicluster-data/ts-0/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/minicluster-data/ts-0/wal
uuid: "319bd66c53dc453b98998b46dfbd1beb"
format_stamp: "Formatted at 2026-08-10 15:25:48 on dist-test-slave-2p8l"
server_key: "e85b298bcc40c1ef9a505c6b8b1a42cd"
server_key_iv: "f42b8d6f846c58b246add4e4de5cffb1"
server_key_version: "encryptionkey@0"
I20260810 15:25:48.240528 28682 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:25:48.252063 28682 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:25:48.254113 28682 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:25:48.254225 28682 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:25:48.254408 28682 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 15:25:48.254726 28682 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 15:25:48.254761 28682 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:48.254784 28682 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 15:25:48.254838 28682 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:48.260771 28682 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.129:38865
I20260810 15:25:48.260821 28903 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.129:38865 every 8 connection(s)
I20260810 15:25:48.261128 28682 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/minicluster-data/ts-0/data/info.pb
I20260810 15:25:48.265198 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 28682
I20260810 15:25:48.265333 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/minicluster-data/ts-0/wal/instance
I20260810 15:25:48.265553 18706 external_mini_cluster.cc:1428] Setting key c27103a1e66aebc5b07a7641a13068e7
Aug 10 15:25:48 dist-test-slave-2p8l krb5kdc[28488](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375548, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.129@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
I20260810 15:25:48.271349 28643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:48.261813 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.129:33009 (local address 127.18.68.190:41809)
0810 15:25:48.261881 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:48.261883 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:48.262133 (+ 250us) server_negotiation.cc:407] Connection header received
0810 15:25:48.263080 (+ 947us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:48.263082 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:48.263093 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:48.263158 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:48.263765 (+ 607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:48.264271 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:48.265257 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:48.265563 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:48.265658 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:48.267899 (+ 2241us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:48.267901 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:48.267901 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:48.267913 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:48.269469 (+ 1556us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:48.269979 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:48.269980 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:48.269981 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:48.270036 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:48.270422 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:48.270423 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:48.270423 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:48.270657 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:48.270726 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:48.271106 (+ 380us) server_negotiation.cc:299] Negotiation successful
0810 15:25:48.271263 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260810 15:25:48.271716 28911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:48.261763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:41809 (local address 127.18.68.129:33009)
0810 15:25:48.261955 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:48.261999 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:48.262946 (+ 947us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:48.263241 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:48.263244 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:48.263493 (+ 249us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:25:48.263683 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:48.263686 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:48.264351 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:48.264352 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:48.265153 (+ 801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:48.265156 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:48.265671 (+ 515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:48.265672 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:48.265821 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:48.266430 (+ 609us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:25:48.266438 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:25:48.267768 (+ 1330us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:25:48.269560 (+ 1792us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:48.269568 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:48.269571 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:48.269895 (+ 324us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:48.270150 (+ 255us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:48.270151 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:48.270152 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:48.270303 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:48.270743 (+ 440us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:25:48.270750 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:25:48.270927 (+ 177us) client_negotiation.cc:769] Sending connection context
0810 15:25:48.271055 (+ 128us) client_negotiation.cc:240] Negotiation successful
0810 15:25:48.271330 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":113,"threads_started":1}
I20260810 15:25:48.272230 28904 heartbeater.cc:347] Connected to a master server at 127.18.68.190:41809
I20260810 15:25:48.272387 28904 heartbeater.cc:464] Registering TS with master...
I20260810 15:25:48.272603 28904 heartbeater.cc:511] Master 127.18.68.190:41809 requested a full tablet report, sending...
I20260810 15:25:48.273169 28556 ts_manager.cc:194] Registered new tserver with Master: 319bd66c53dc453b98998b46dfbd1beb (127.18.68.129:38865)
I20260810 15:25:48.273844 28556 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.68.129@KRBTEST.COM'} at 127.18.68.129:33009
WARNING: no policy specified for kudu/127.18.68.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.68.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.68.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.130.keytab.
Entry for principal kudu/127.18.68.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.130.keytab.
I20260810 15:25:48.292928 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.68.130:0
--local_ip_for_outbound_sockets=127.18.68.130
--webserver_interface=127.18.68.130
--webserver_port=0
--tserver_master_addrs=127.18.68.190:41809
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.130.keytab
--principal=kudu/127.18.68.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:44785
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:25:48.376674 28917 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:25:48.376930 28917 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:25:48.376969 28917 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:25:48.378187 28917 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:25:48.378260 28917 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:25:48.378304 28917 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.68.130
I20260810 15:25:48.379820 28917 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:44785
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.130.keytab
--principal=kudu/127.18.68.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.68.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.68.130
--webserver_port=0
--tserver_master_addrs=127.18.68.190:41809
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28917
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.68.130
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:25:48.380095 28917 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:25:48.380332 28917 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:25:48.385609 28924 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:48.385619 28923 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:48.385628 28931 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:25:48.385789 28917 server_base.cc:1034] running on GCE node
I20260810 15:25:48.387524 28917 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:25:48.387807 28917 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:25:48.388984 28917 hybrid_clock.cc:648] HybridClock initialized: now 1786375548388964 us; error 43 us; skew 500 ppm
Aug 10 15:25:48 dist-test-slave-2p8l krb5kdc[28488](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375548, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:25:48.391670 28917 init.cc:377] Logged in from keytab as kudu/127.18.68.130@KRBTEST.COM (short username kudu)
I20260810 15:25:48.392148 28917 webserver.cc:460] Webserver started at http://127.18.68.130:45953/ using document root <none> and password file <none>
I20260810 15:25:48.392386 28917 fs_manager.cc:359] Metadata directory not provided
I20260810 15:25:48.392457 28917 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:25:48.392612 28917 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:25:48.393684 28917 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/minicluster-data/ts-1/data/instance:
uuid: "a0a76eeeae8240c689088f78c5bdd71e"
format_stamp: "Formatted at 2026-08-10 15:25:48 on dist-test-slave-2p8l"
server_key: "8aad5d826791e87a14353bcf2c68db97"
server_key_iv: "9ef50cff74a976ac87ad0912834b8082"
server_key_version: "encryptionkey@0"
I20260810 15:25:48.394158 28917 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/minicluster-data/ts-1/wal/instance:
uuid: "a0a76eeeae8240c689088f78c5bdd71e"
format_stamp: "Formatted at 2026-08-10 15:25:48 on dist-test-slave-2p8l"
server_key: "8aad5d826791e87a14353bcf2c68db97"
server_key_iv: "9ef50cff74a976ac87ad0912834b8082"
server_key_version: "encryptionkey@0"
I20260810 15:25:48.395569 28917 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260810 15:25:48.396394 28943 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:48.396677 28917 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 15:25:48.396797 28917 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/minicluster-data/ts-1/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/minicluster-data/ts-1/wal
uuid: "a0a76eeeae8240c689088f78c5bdd71e"
format_stamp: "Formatted at 2026-08-10 15:25:48 on dist-test-slave-2p8l"
server_key: "8aad5d826791e87a14353bcf2c68db97"
server_key_iv: "9ef50cff74a976ac87ad0912834b8082"
server_key_version: "encryptionkey@0"
I20260810 15:25:48.396889 28917 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:25:48.407127 28917 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:25:48.409680 28917 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:25:48.409860 28917 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:25:48.410195 28917 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 15:25:48.410532 28917 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 15:25:48.410588 28917 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:48.410634 28917 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 15:25:48.410660 28917 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:48.416744 28917 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.130:44217
I20260810 15:25:48.416795 29144 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.130:44217 every 8 connection(s)
I20260810 15:25:48.417131 28917 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/minicluster-data/ts-1/data/info.pb
I20260810 15:25:48.418299 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 28917
I20260810 15:25:48.418416 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/minicluster-data/ts-1/wal/instance
I20260810 15:25:48.418625 18706 external_mini_cluster.cc:1428] Setting key a08777a84dbbc2503e1f11e50642f1bd
Aug 10 15:25:48 dist-test-slave-2p8l krb5kdc[28488](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375548, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.130@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
I20260810 15:25:48.428612 28643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:48.417868 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.130:59839 (local address 127.18.68.190:41809)
0810 15:25:48.417918 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:48.417920 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:48.418193 (+ 273us) server_negotiation.cc:407] Connection header received
0810 15:25:48.419471 (+ 1278us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:48.419472 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:48.419482 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:48.419565 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:48.420186 (+ 621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:48.420929 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:48.422498 (+ 1569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:48.422779 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:48.422843 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:48.425428 (+ 2585us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:48.425430 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:48.425430 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:48.425444 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:48.427169 (+ 1725us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:48.427597 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:48.427599 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:48.427599 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:48.427667 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:48.427910 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:48.427911 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:48.427911 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:48.428059 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:48.428146 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:48.428403 (+ 257us) server_negotiation.cc:299] Negotiation successful
0810 15:25:48.428494 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260810 15:25:48.428701 29148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:48.417833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:41809 (local address 127.18.68.130:59839)
0810 15:25:48.418010 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:48.418051 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:48.419349 (+ 1298us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:48.419654 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:48.419657 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:48.419903 (+ 246us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:25:48.420092 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:48.420096 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:48.421025 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:48.421026 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:48.422380 (+ 1354us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:48.422384 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:48.422873 (+ 489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:48.422874 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:48.423029 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:48.423592 (+ 563us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:25:48.423603 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:25:48.425330 (+ 1727us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:25:48.427264 (+ 1934us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:48.427271 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:48.427273 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:48.427517 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:48.427740 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:48.427741 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:48.427741 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:48.427840 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:48.428144 (+ 304us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:25:48.428148 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:25:48.428264 (+ 116us) client_negotiation.cc:769] Sending connection context
0810 15:25:48.428349 (+ 85us) client_negotiation.cc:240] Negotiation successful
0810 15:25:48.428470 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":80,"threads_started":1}
WARNING: no policy specified for kudu/127.18.68.131@KRBTEST.COM; defaulting to no policy
I20260810 15:25:48.429229 29145 heartbeater.cc:347] Connected to a master server at 127.18.68.190:41809
I20260810 15:25:48.429342 29145 heartbeater.cc:464] Registering TS with master...
I20260810 15:25:48.429548 29145 heartbeater.cc:511] Master 127.18.68.190:41809 requested a full tablet report, sending...
I20260810 15:25:48.429946 28556 ts_manager.cc:194] Registered new tserver with Master: a0a76eeeae8240c689088f78c5bdd71e (127.18.68.130:44217)
I20260810 15:25:48.430346 28556 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.68.130@KRBTEST.COM'} at 127.18.68.130:59839
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.68.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.68.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.131.keytab.
Entry for principal kudu/127.18.68.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.131.keytab.
I20260810 15:25:48.448663 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.68.131:0
--local_ip_for_outbound_sockets=127.18.68.131
--webserver_interface=127.18.68.131
--webserver_port=0
--tserver_master_addrs=127.18.68.190:41809
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.131.keytab
--principal=kudu/127.18.68.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:44785
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:25:48.532140 29153 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:25:48.532395 29153 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:25:48.532436 29153 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:25:48.533591 29153 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:25:48.533659 29153 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:25:48.533703 29153 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.68.131
I20260810 15:25:48.535230 29153 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:44785
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.131.keytab
--principal=kudu/127.18.68.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.68.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.68.131
--webserver_port=0
--tserver_master_addrs=127.18.68.190:41809
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29153
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.68.131
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:25:48.535485 29153 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:25:48.535722 29153 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:25:48.540768 29168 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:25:48.540872 29153 server_base.cc:1034] running on GCE node
W20260810 15:25:48.540795 29161 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:48.540791 29162 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:25:48.541267 29153 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:25:48.541534 29153 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:25:48.542702 29153 hybrid_clock.cc:648] HybridClock initialized: now 1786375548542686 us; error 52 us; skew 500 ppm
Aug 10 15:25:48 dist-test-slave-2p8l krb5kdc[28488](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375548, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:25:48.545301 29153 init.cc:377] Logged in from keytab as kudu/127.18.68.131@KRBTEST.COM (short username kudu)
I20260810 15:25:48.545778 29153 webserver.cc:460] Webserver started at http://127.18.68.131:40551/ using document root <none> and password file <none>
I20260810 15:25:48.546006 29153 fs_manager.cc:359] Metadata directory not provided
I20260810 15:25:48.546093 29153 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:25:48.546242 29153 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:25:48.547264 29153 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/minicluster-data/ts-2/data/instance:
uuid: "7936d5194c4248b69b4f61356e2f50ae"
format_stamp: "Formatted at 2026-08-10 15:25:48 on dist-test-slave-2p8l"
server_key: "b888115461b8753729cfbb1f96184a3a"
server_key_iv: "7602c2fdcc9388cece53c8d3b3a02bec"
server_key_version: "encryptionkey@0"
I20260810 15:25:48.547628 29153 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/minicluster-data/ts-2/wal/instance:
uuid: "7936d5194c4248b69b4f61356e2f50ae"
format_stamp: "Formatted at 2026-08-10 15:25:48 on dist-test-slave-2p8l"
server_key: "b888115461b8753729cfbb1f96184a3a"
server_key_iv: "7602c2fdcc9388cece53c8d3b3a02bec"
server_key_version: "encryptionkey@0"
I20260810 15:25:48.548935 29153 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 15:25:48.549693 29183 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:48.549870 29153 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 15:25:48.549973 29153 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/minicluster-data/ts-2/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/minicluster-data/ts-2/wal
uuid: "7936d5194c4248b69b4f61356e2f50ae"
format_stamp: "Formatted at 2026-08-10 15:25:48 on dist-test-slave-2p8l"
server_key: "b888115461b8753729cfbb1f96184a3a"
server_key_iv: "7602c2fdcc9388cece53c8d3b3a02bec"
server_key_version: "encryptionkey@0"
I20260810 15:25:48.550057 29153 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:25:48.558995 29153 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:25:48.560837 29153 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:25:48.560997 29153 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:25:48.561223 29153 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 15:25:48.561525 29153 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 15:25:48.561580 29153 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:48.561622 29153 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 15:25:48.561650 29153 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:48.568023 29153 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.131:35031
I20260810 15:25:48.568070 29380 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.131:35031 every 8 connection(s)
I20260810 15:25:48.568380 29153 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/minicluster-data/ts-2/data/info.pb
I20260810 15:25:48.574148 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 29153
I20260810 15:25:48.574272 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/minicluster-data/ts-2/wal/instance
I20260810 15:25:48.574486 18706 external_mini_cluster.cc:1428] Setting key 92a23b7e4b925f1d03e59135bc326010
Aug 10 15:25:48 dist-test-slave-2p8l krb5kdc[28488](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375548, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.131@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
I20260810 15:25:48.578279 28643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:48.569160 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.131:36507 (local address 127.18.68.190:41809)
0810 15:25:48.569209 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:48.569211 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:48.569371 (+ 160us) server_negotiation.cc:407] Connection header received
0810 15:25:48.570327 (+ 956us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:48.570328 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:48.570338 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:48.570402 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:48.570963 (+ 561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:48.571742 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:48.572767 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:48.572945 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:48.573000 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:48.575366 (+ 2366us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:48.575368 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:48.575368 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:48.575376 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:48.576840 (+ 1464us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:48.577263 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:48.577264 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:48.577265 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:48.577327 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:48.577592 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:48.577593 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:48.577593 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:48.577717 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:48.577791 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:48.578103 (+ 312us) server_negotiation.cc:299] Negotiation successful
0810 15:25:48.578183 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260810 15:25:48.578473 29385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:48.569072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:41809 (local address 127.18.68.131:36507)
0810 15:25:48.569237 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:48.569278 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:48.570237 (+ 959us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:48.570455 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:48.570458 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:48.570704 (+ 246us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:25:48.570884 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:48.570888 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:48.571830 (+ 942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:48.571831 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:48.572694 (+ 863us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:48.572697 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:48.573028 (+ 331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:48.573029 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:48.573131 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:48.573602 (+ 471us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:25:48.573611 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:25:48.575262 (+ 1651us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:25:48.576944 (+ 1682us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:48.576952 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:48.576955 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:48.577182 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:48.577397 (+ 215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:48.577398 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:48.577399 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:48.577512 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:48.577797 (+ 285us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:25:48.577805 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:25:48.577941 (+ 136us) client_negotiation.cc:769] Sending connection context
0810 15:25:48.578044 (+ 103us) client_negotiation.cc:240] Negotiation successful
0810 15:25:48.578249 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":98,"threads_started":1}
I20260810 15:25:48.578905 29382 heartbeater.cc:347] Connected to a master server at 127.18.68.190:41809
I20260810 15:25:48.579017 29382 heartbeater.cc:464] Registering TS with master...
I20260810 15:25:48.579196 29382 heartbeater.cc:511] Master 127.18.68.190:41809 requested a full tablet report, sending...
I20260810 15:25:48.579568 28556 ts_manager.cc:194] Registered new tserver with Master: 7936d5194c4248b69b4f61356e2f50ae (127.18.68.131:35031)
I20260810 15:25:48.579972 28556 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.68.131@KRBTEST.COM'} at 127.18.68.131:36507
I20260810 15:25:48.586468 18706 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/krb5kdc/test-admin.keytab.
Aug 10 15:25:48 dist-test-slave-2p8l krb5kdc[28488](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375548, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:25:48.603363 18706 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260810 15:25:48.605248 29394 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 15:25:48.604379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40900 (local address 127.18.68.129:38865)
0810 15:25:48.604596 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:48.604601 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:48.604612 (+ 11us) server_negotiation.cc:407] Connection header received
0810 15:25:48.604664 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:48.604666 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:48.604680 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:48.604752 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:48.605160 (+ 408us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40900: BlockingRecv error: recv got EOF from 127.0.0.1:40900 (error 108)
Metrics: {"server-negotiator.queue_time_us":183,"thread_start_us":133,"threads_started":1}
W20260810 15:25:48.605463 18706 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/krb5kdc/krb5cc' of type FILE
Aug 10 15:25:48 dist-test-slave-2p8l krb5kdc[28488](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375548, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:25:48.606534 18706 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 10 15:25:48 dist-test-slave-2p8l krb5kdc[28488](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375548, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:25:48.607411 18706 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 10 15:25:48 dist-test-slave-2p8l krb5kdc[28488](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375548, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.68.129@KRBTEST.COM
I20260810 15:25:48.615458 29394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:48.607972 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40906 (local address 127.18.68.129:38865)
0810 15:25:48.608031 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:48.608033 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:48.608081 (+ 48us) server_negotiation.cc:407] Connection header received
0810 15:25:48.608125 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:48.608126 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:48.608137 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:48.608188 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:48.608553 (+ 365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:48.609267 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:48.609946 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:48.610327 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:48.610386 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:48.612576 (+ 2190us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:48.612585 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:48.612585 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:48.612592 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:48.614269 (+ 1677us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:48.614588 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:48.614590 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:48.614591 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:48.614673 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:48.614858 (+ 185us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:48.614859 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:48.614859 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:48.614985 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:48.615086 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:48.615240 (+ 154us) server_negotiation.cc:299] Negotiation successful
0810 15:25:48.615305 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
W20260810 15:25:48.617569 29394 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 15:25:48.616910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40910 (local address 127.18.68.129:38865)
0810 15:25:48.616982 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:48.616985 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:48.617075 (+ 90us) server_negotiation.cc:407] Connection header received
0810 15:25:48.617138 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:48.617139 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:48.617151 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:48.617207 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:48.617514 (+ 307us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40910: BlockingRecv error: recv got EOF from 127.0.0.1:40910 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
W20260810 15:25:48.617655 18706 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/krb5kdc/krb5cc' of type FILE
Aug 10 15:25:48 dist-test-slave-2p8l krb5kdc[28488](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375548, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:25:48.618762 18706 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 10 15:25:48 dist-test-slave-2p8l krb5kdc[28488](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375548, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:25:48.619681 18706 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 10 15:25:48 dist-test-slave-2p8l krb5kdc[28488](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375548, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.68.129@KRBTEST.COM
I20260810 15:25:48.627990 29394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:48.620192 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40914 (local address 127.18.68.129:38865)
0810 15:25:48.620259 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:48.620261 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:48.620322 (+ 61us) server_negotiation.cc:407] Connection header received
0810 15:25:48.620439 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:48.620440 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:48.620452 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:48.620514 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:48.620942 (+ 428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:48.621491 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:48.622354 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:48.622591 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:48.622685 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:48.625025 (+ 2340us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:48.625027 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:48.625027 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:48.625036 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:48.626671 (+ 1635us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:48.627074 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:48.627076 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:48.627076 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:48.627142 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:48.627380 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:48.627381 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:48.627381 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:48.627495 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:48.627616 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:48.627777 (+ 161us) server_negotiation.cc:299] Negotiation successful
0810 15:25:48.627869 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
W20260810 15:25:48.629733 29394 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 15:25:48.629095 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40918 (local address 127.18.68.129:38865)
0810 15:25:48.629156 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:48.629159 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:48.629263 (+ 104us) server_negotiation.cc:407] Connection header received
0810 15:25:48.629288 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:48.629289 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:48.629298 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:48.629351 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:48.629681 (+ 330us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40918: BlockingRecv error: recv got EOF from 127.0.0.1:40918 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
W20260810 15:25:48.629784 18706 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786375520124696-18706-0/krb5kdc/krb5cc' of type FILE
Aug 10 15:25:48 dist-test-slave-2p8l krb5kdc[28488](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375548, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:25:48.630986 18706 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 10 15:25:48 dist-test-slave-2p8l krb5kdc[28488](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375548, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:25:48.631906 18706 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 10 15:25:48 dist-test-slave-2p8l krb5kdc[28488](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375548, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.68.129@KRBTEST.COM
I20260810 15:25:48.639468 29394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:48.632428 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40922 (local address 127.18.68.129:38865)
0810 15:25:48.632484 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:48.632486 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:48.632507 (+ 21us) server_negotiation.cc:407] Connection header received
0810 15:25:48.632567 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:48.632568 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:48.632575 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:48.632620 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:48.633039 (+ 419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:48.633566 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:48.634446 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:48.634672 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:48.634739 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:48.636858 (+ 2119us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:48.636859 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:48.636860 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:48.636866 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:48.638309 (+ 1443us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:48.638650 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:48.638651 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:48.638651 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:48.638708 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:48.638888 (+ 180us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:48.638889 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:48.638889 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:48.638988 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:48.639064 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:48.639257 (+ 193us) server_negotiation.cc:299] Negotiation successful
0810 15:25:48.639321 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260810 15:25:48.640266 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 28682
I20260810 15:25:48.654735 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 28917
I20260810 15:25:48.680358 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 29153
I20260810 15:25:48.693463 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 28509
2026-08-10T15:25:48Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (2203 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 15:25:48 dist-test-slave-2p8l krb5kdc[29413](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 15:25:48 dist-test-slave-2p8l krb5kdc[29413](info): set up 2 sockets
Aug 10 15:25:48 dist-test-slave-2p8l krb5kdc[29413](info): commencing operation
krb5kdc: starting...
W20260810 15:25:50.053177 18706 mini_kdc.cc:121] Time spent starting KDC: real 1.330s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/krb5kdc/test-user.keytab.
Aug 10 15:25:50 dist-test-slave-2p8l krb5kdc[29413](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375550, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T15:25:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T15:25:50Z Disabled control of system clock
WARNING: no policy specified for oryx/127.18.68.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.18.68.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.18.68.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/krb5kdc/oryx_127.18.68.190.keytab.
Entry for principal oryx/127.18.68.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/krb5kdc/oryx_127.18.68.190.keytab.
I20260810 15:25:50.175195 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.190:46363
--webserver_interface=127.18.68.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/krb5kdc/oryx_127.18.68.190.keytab
--principal=oryx/127.18.68.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:33723
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.68.190:46363
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:25:50.257056 29436 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:25:50.257310 29436 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:25:50.257347 29436 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:25:50.258579 29436 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 15:25:50.258643 29436 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:25:50.258665 29436 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:25:50.258685 29436 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 15:25:50.258714 29436 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 15:25:50.260236 29436 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:33723
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.68.190:46363
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/krb5kdc/oryx_127.18.68.190.keytab
--principal=oryx/127.18.68.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.190:46363
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.68.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29436
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:25:50.260524 29436 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:25:50.260754 29436 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:25:50.265700 29445 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:50.265760 29447 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:50.265717 29450 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:25:50.265991 29436 server_base.cc:1034] running on GCE node
I20260810 15:25:50.266311 29436 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:25:50.266655 29436 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:25:50.267819 29436 hybrid_clock.cc:648] HybridClock initialized: now 1786375550267798 us; error 39 us; skew 500 ppm
Aug 10 15:25:50 dist-test-slave-2p8l krb5kdc[29413](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375550, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.68.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:25:50.273758 29436 init.cc:377] Logged in from keytab as oryx/127.18.68.190@KRBTEST.COM (short username oryx)
I20260810 15:25:50.274359 29436 webserver.cc:460] Webserver started at http://127.18.68.190:38729/ using document root <none> and password file <none>
I20260810 15:25:50.274628 29436 fs_manager.cc:359] Metadata directory not provided
I20260810 15:25:50.274703 29436 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:25:50.274857 29436 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:25:50.276086 29436 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/master-0/data/instance:
uuid: "dc69d8e9c6814168941f833a163493a1"
format_stamp: "Formatted at 2026-08-10 15:25:50 on dist-test-slave-2p8l"
server_key: "db2b4cbce1ff1035556481fbde09384b"
server_key_iv: "ed82870e6c88017e2ba5c234c0132d33"
server_key_version: "encryptionkey@0"
I20260810 15:25:50.276475 29436 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/master-0/wal/instance:
uuid: "dc69d8e9c6814168941f833a163493a1"
format_stamp: "Formatted at 2026-08-10 15:25:50 on dist-test-slave-2p8l"
server_key: "db2b4cbce1ff1035556481fbde09384b"
server_key_iv: "ed82870e6c88017e2ba5c234c0132d33"
server_key_version: "encryptionkey@0"
I20260810 15:25:50.277904 29436 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 15:25:50.278820 29464 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:50.278998 29436 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:25:50.279125 29436 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/master-0/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/master-0/wal
uuid: "dc69d8e9c6814168941f833a163493a1"
format_stamp: "Formatted at 2026-08-10 15:25:50 on dist-test-slave-2p8l"
server_key: "db2b4cbce1ff1035556481fbde09384b"
server_key_iv: "ed82870e6c88017e2ba5c234c0132d33"
server_key_version: "encryptionkey@0"
I20260810 15:25:50.279209 29436 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:25:50.320981 29436 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:25:50.323149 29436 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:25:50.323326 29436 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:25:50.327495 29436 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.190:46363
I20260810 15:25:50.327543 29568 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.190:46363 every 8 connection(s)
I20260810 15:25:50.327929 29436 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
I20260810 15:25:50.329025 29569 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:25:50.330412 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 29436
I20260810 15:25:50.330500 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/master-0/wal/instance
I20260810 15:25:50.330696 18706 external_mini_cluster.cc:1428] Setting key f1016696cbd53a1f7f4eabd1f4231261
I20260810 15:25:50.331984 29569 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dc69d8e9c6814168941f833a163493a1: Bootstrap starting.
I20260810 15:25:50.332676 29569 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dc69d8e9c6814168941f833a163493a1: Neither blocks nor log segments found. Creating new log.
I20260810 15:25:50.332999 29569 log.cc:824] T 00000000000000000000000000000000 P dc69d8e9c6814168941f833a163493a1: Log is configured to *not* fsync() on all Append() calls
I20260810 15:25:50.333832 29569 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dc69d8e9c6814168941f833a163493a1: No bootstrap required, opened a new log
I20260810 15:25:50.336059 29569 raft_consensus.cc:348] T 00000000000000000000000000000000 P dc69d8e9c6814168941f833a163493a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc69d8e9c6814168941f833a163493a1" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46363 } }
I20260810 15:25:50.336226 29569 raft_consensus.cc:374] T 00000000000000000000000000000000 P dc69d8e9c6814168941f833a163493a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:25:50.336273 29569 raft_consensus.cc:729] T 00000000000000000000000000000000 P dc69d8e9c6814168941f833a163493a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc69d8e9c6814168941f833a163493a1, State: Initialized, Role: FOLLOWER
I20260810 15:25:50.336418 29569 consensus_queue.cc:260] T 00000000000000000000000000000000 P dc69d8e9c6814168941f833a163493a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc69d8e9c6814168941f833a163493a1" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46363 } }
I20260810 15:25:50.336531 29569 raft_consensus.cc:388] T 00000000000000000000000000000000 P dc69d8e9c6814168941f833a163493a1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 15:25:50.336580 29569 raft_consensus.cc:482] T 00000000000000000000000000000000 P dc69d8e9c6814168941f833a163493a1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 15:25:50.336632 29569 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dc69d8e9c6814168941f833a163493a1 [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:25:50.337165 29569 raft_consensus.cc:504] T 00000000000000000000000000000000 P dc69d8e9c6814168941f833a163493a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc69d8e9c6814168941f833a163493a1" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46363 } }
I20260810 15:25:50.337285 29569 leader_election.cc:302] T 00000000000000000000000000000000 P dc69d8e9c6814168941f833a163493a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dc69d8e9c6814168941f833a163493a1; no voters:
I20260810 15:25:50.337468 29569 leader_election.cc:288] T 00000000000000000000000000000000 P dc69d8e9c6814168941f833a163493a1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 15:25:50.337538 29578 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dc69d8e9c6814168941f833a163493a1 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 15:25:50.337693 29578 raft_consensus.cc:686] T 00000000000000000000000000000000 P dc69d8e9c6814168941f833a163493a1 [term 1 LEADER]: Becoming Leader. State: Replica: dc69d8e9c6814168941f833a163493a1, State: Running, Role: LEADER
I20260810 15:25:50.337736 29569 sys_catalog.cc:564] T 00000000000000000000000000000000 P dc69d8e9c6814168941f833a163493a1 [sys.catalog]: configured and running, proceeding with master startup.
Aug 10 15:25:50 dist-test-slave-2p8l krb5kdc[29413](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375550, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM
I20260810 15:25:50.338475 29578 consensus_queue.cc:237] T 00000000000000000000000000000000 P dc69d8e9c6814168941f833a163493a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc69d8e9c6814168941f833a163493a1" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46363 } }
I20260810 15:25:50.339110 29580 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc69d8e9c6814168941f833a163493a1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dc69d8e9c6814168941f833a163493a1. Latest consensus state: current_term: 1 leader_uuid: "dc69d8e9c6814168941f833a163493a1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc69d8e9c6814168941f833a163493a1" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46363 } } }
I20260810 15:25:50.339419 29580 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc69d8e9c6814168941f833a163493a1 [sys.catalog]: This master's current role is: LEADER
I20260810 15:25:50.339110 29581 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc69d8e9c6814168941f833a163493a1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dc69d8e9c6814168941f833a163493a1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc69d8e9c6814168941f833a163493a1" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46363 } } }
I20260810 15:25:50.339522 29581 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc69d8e9c6814168941f833a163493a1 [sys.catalog]: This master's current role is: LEADER
W20260810 15:25:50.340173 29603 catalog_manager.cc:1558] T 00000000000000000000000000000000 P dc69d8e9c6814168941f833a163493a1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 15:25:50.340235 29603 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 15:25:50.340313 29606 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 15:25:50.340523 29606 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 15:25:50.342123 29606 catalog_manager.cc:1347] Generated new cluster ID: 282c713ec3e04fc6b63b8a8f3178953f
I20260810 15:25:50.342178 29606 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 15:25:50.342898 29574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:50.331263 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39450 (local address 127.18.68.190:46363)
0810 15:25:50.331484 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:50.331493 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:50.331530 (+ 37us) server_negotiation.cc:407] Connection header received
0810 15:25:50.332074 (+ 544us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:50.332083 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:50.332143 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:50.332297 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:50.332957 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:50.334307 (+ 1350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:50.335097 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:50.335788 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:50.335908 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:50.338695 (+ 2787us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:50.338699 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:50.338700 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:50.338712 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:50.341150 (+ 2438us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:50.341590 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:50.341593 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:50.341593 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:50.341712 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:50.341932 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:50.341932 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:50.341933 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:50.342282 (+ 349us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:50.342423 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:50.342560 (+ 137us) server_negotiation.cc:299] Negotiation successful
0810 15:25:50.342706 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":165,"thread_start_us":102,"threads_started":1}
I20260810 15:25:50.348067 29606 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 15:25:50.348791 29606 catalog_manager.cc:1504] Loading token signing keys...
I20260810 15:25:50.355340 29606 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dc69d8e9c6814168941f833a163493a1: Generated new TSK 0
I20260810 15:25:50.355522 29606 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.18.68.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.18.68.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.18.68.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/krb5kdc/oryx_127.18.68.129.keytab.
Entry for principal oryx/127.18.68.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/krb5kdc/oryx_127.18.68.129.keytab.
I20260810 15:25:50.389104 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.68.129:0
--local_ip_for_outbound_sockets=127.18.68.129
--webserver_interface=127.18.68.129
--webserver_port=0
--tserver_master_addrs=127.18.68.190:46363
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/krb5kdc/oryx_127.18.68.129.keytab
--principal=oryx/127.18.68.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:33723
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:25:50.473528 29614 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:25:50.473737 29614 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:25:50.473760 29614 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:25:50.475005 29614 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:25:50.475062 29614 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:25:50.475091 29614 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.68.129
I20260810 15:25:50.476632 29614 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:33723
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/krb5kdc/oryx_127.18.68.129.keytab
--principal=oryx/127.18.68.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.68.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.68.129
--webserver_port=0
--tserver_master_addrs=127.18.68.190:46363
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29614
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.68.129
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:25:50.476884 29614 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:25:50.477124 29614 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:25:50.482153 29626 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:50.482257 29630 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:50.482159 29628 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:25:50.482802 29614 server_base.cc:1034] running on GCE node
I20260810 15:25:50.483129 29614 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:25:50.483425 29614 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:25:50.484575 29614 hybrid_clock.cc:648] HybridClock initialized: now 1786375550484550 us; error 39 us; skew 500 ppm
Aug 10 15:25:50 dist-test-slave-2p8l krb5kdc[29413](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375550, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.68.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:25:50.487332 29614 init.cc:377] Logged in from keytab as oryx/127.18.68.129@KRBTEST.COM (short username oryx)
I20260810 15:25:50.487834 29614 webserver.cc:460] Webserver started at http://127.18.68.129:45181/ using document root <none> and password file <none>
I20260810 15:25:50.488075 29614 fs_manager.cc:359] Metadata directory not provided
I20260810 15:25:50.488147 29614 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:25:50.488296 29614 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:25:50.489387 29614 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/ts-0/data/instance:
uuid: "aa343e60e15a4e3fb24f49dbb3aa37b3"
format_stamp: "Formatted at 2026-08-10 15:25:50 on dist-test-slave-2p8l"
server_key: "e6d66ee6c3eab93df0428ba740cd3513"
server_key_iv: "a6a96a645eaba18a071035a4c76566a9"
server_key_version: "encryptionkey@0"
I20260810 15:25:50.489777 29614 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/ts-0/wal/instance:
uuid: "aa343e60e15a4e3fb24f49dbb3aa37b3"
format_stamp: "Formatted at 2026-08-10 15:25:50 on dist-test-slave-2p8l"
server_key: "e6d66ee6c3eab93df0428ba740cd3513"
server_key_iv: "a6a96a645eaba18a071035a4c76566a9"
server_key_version: "encryptionkey@0"
I20260810 15:25:50.491297 29614 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 15:25:50.492326 29643 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:50.492609 29614 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:25:50.492744 29614 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/ts-0/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/ts-0/wal
uuid: "aa343e60e15a4e3fb24f49dbb3aa37b3"
format_stamp: "Formatted at 2026-08-10 15:25:50 on dist-test-slave-2p8l"
server_key: "e6d66ee6c3eab93df0428ba740cd3513"
server_key_iv: "a6a96a645eaba18a071035a4c76566a9"
server_key_version: "encryptionkey@0"
I20260810 15:25:50.492834 29614 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:25:50.506049 29614 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:25:50.508335 29614 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:25:50.508517 29614 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:25:50.508805 29614 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 15:25:50.509141 29614 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 15:25:50.509197 29614 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:50.509233 29614 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 15:25:50.509279 29614 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:50.515501 29614 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.129:38595
I20260810 15:25:50.515558 29826 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.129:38595 every 8 connection(s)
I20260810 15:25:50.515893 29614 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/ts-0/data/info.pb
Aug 10 15:25:50 dist-test-slave-2p8l krb5kdc[29413](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375550, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.68.129@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM
I20260810 15:25:50.524843 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 29614
I20260810 15:25:50.524971 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/ts-0/wal/instance
I20260810 15:25:50.525213 18706 external_mini_cluster.cc:1428] Setting key ccfc44cce9c09317da68a18d6ae71f39
I20260810 15:25:50.525867 29574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:50.516683 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.129:35877 (local address 127.18.68.190:46363)
0810 15:25:50.516753 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:50.516755 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:50.516961 (+ 206us) server_negotiation.cc:407] Connection header received
0810 15:25:50.517606 (+ 645us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:50.517607 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:50.517620 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:50.517692 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:50.518718 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:50.519231 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:50.520196 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:50.520407 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:50.520465 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:50.522820 (+ 2355us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:50.522822 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:50.522822 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:50.522830 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:50.524263 (+ 1433us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:50.524723 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:50.524724 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:50.524725 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:50.524781 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:50.525123 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:50.525125 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:50.525125 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:50.525286 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:50.525338 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:50.525672 (+ 334us) server_negotiation.cc:299] Negotiation successful
0810 15:25:50.525772 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260810 15:25:50.526114 29832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:50.516636 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46363 (local address 127.18.68.129:35877)
0810 15:25:50.516821 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:50.516865 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:50.517379 (+ 514us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:50.517778 (+ 399us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:50.517782 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:50.518410 (+ 628us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:25:50.518611 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:50.518616 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:50.519320 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:50.519320 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:50.520111 (+ 791us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:50.520113 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:50.520486 (+ 373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:50.520487 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:50.520589 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:50.521189 (+ 600us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:25:50.521199 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:25:50.522693 (+ 1494us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:25:50.524339 (+ 1646us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:50.524346 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:50.524348 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:50.524583 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:50.524855 (+ 272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:50.524856 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:50.524856 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:50.525018 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:50.525393 (+ 375us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:25:50.525400 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:25:50.525534 (+ 134us) client_negotiation.cc:769] Sending connection context
0810 15:25:50.525646 (+ 112us) client_negotiation.cc:240] Negotiation successful
0810 15:25:50.525821 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":97,"threads_started":1}
I20260810 15:25:50.526770 29828 heartbeater.cc:347] Connected to a master server at 127.18.68.190:46363
I20260810 15:25:50.526894 29828 heartbeater.cc:464] Registering TS with master...
I20260810 15:25:50.527086 29828 heartbeater.cc:511] Master 127.18.68.190:46363 requested a full tablet report, sending...
I20260810 15:25:50.527695 29495 ts_manager.cc:194] Registered new tserver with Master: aa343e60e15a4e3fb24f49dbb3aa37b3 (127.18.68.129:38595)
I20260810 15:25:50.528352 29495 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.18.68.129@KRBTEST.COM'} at 127.18.68.129:35877
WARNING: no policy specified for oryx/127.18.68.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.18.68.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.18.68.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/krb5kdc/oryx_127.18.68.130.keytab.
Entry for principal oryx/127.18.68.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/krb5kdc/oryx_127.18.68.130.keytab.
I20260810 15:25:50.553996 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.68.130:0
--local_ip_for_outbound_sockets=127.18.68.130
--webserver_interface=127.18.68.130
--webserver_port=0
--tserver_master_addrs=127.18.68.190:46363
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/krb5kdc/oryx_127.18.68.130.keytab
--principal=oryx/127.18.68.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:33723
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:25:50.640100 29835 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:25:50.640372 29835 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:25:50.640421 29835 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:25:50.641710 29835 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:25:50.641784 29835 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:25:50.641832 29835 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.68.130
I20260810 15:25:50.643443 29835 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:33723
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/krb5kdc/oryx_127.18.68.130.keytab
--principal=oryx/127.18.68.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.68.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.68.130
--webserver_port=0
--tserver_master_addrs=127.18.68.190:46363
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29835
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.68.130
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:25:50.643735 29835 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:25:50.643996 29835 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:25:50.649231 29853 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:50.649237 29848 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:50.649237 29847 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:25:50.649442 29835 server_base.cc:1034] running on GCE node
I20260810 15:25:50.649744 29835 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:25:50.650048 29835 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:25:50.651278 29835 hybrid_clock.cc:648] HybridClock initialized: now 1786375550651265 us; error 28 us; skew 500 ppm
Aug 10 15:25:50 dist-test-slave-2p8l krb5kdc[29413](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375550, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.68.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:25:50.654328 29835 init.cc:377] Logged in from keytab as oryx/127.18.68.130@KRBTEST.COM (short username oryx)
I20260810 15:25:50.654878 29835 webserver.cc:460] Webserver started at http://127.18.68.130:39567/ using document root <none> and password file <none>
I20260810 15:25:50.655156 29835 fs_manager.cc:359] Metadata directory not provided
I20260810 15:25:50.655232 29835 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:25:50.655390 29835 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:25:50.656466 29835 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/ts-1/data/instance:
uuid: "a69ecd14acce486bbad8a4d162d66996"
format_stamp: "Formatted at 2026-08-10 15:25:50 on dist-test-slave-2p8l"
server_key: "79e71e321eb0aec09c3da332976e3c18"
server_key_iv: "b6d2e1f84f878f915e213e88b93eb91e"
server_key_version: "encryptionkey@0"
I20260810 15:25:50.656841 29835 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/ts-1/wal/instance:
uuid: "a69ecd14acce486bbad8a4d162d66996"
format_stamp: "Formatted at 2026-08-10 15:25:50 on dist-test-slave-2p8l"
server_key: "79e71e321eb0aec09c3da332976e3c18"
server_key_iv: "b6d2e1f84f878f915e213e88b93eb91e"
server_key_version: "encryptionkey@0"
I20260810 15:25:50.658352 29835 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 15:25:50.659267 29869 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:50.659484 29835 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:25:50.659600 29835 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/ts-1/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/ts-1/wal
uuid: "a69ecd14acce486bbad8a4d162d66996"
format_stamp: "Formatted at 2026-08-10 15:25:50 on dist-test-slave-2p8l"
server_key: "79e71e321eb0aec09c3da332976e3c18"
server_key_iv: "b6d2e1f84f878f915e213e88b93eb91e"
server_key_version: "encryptionkey@0"
I20260810 15:25:50.659687 29835 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:25:50.668730 29835 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:25:50.671233 29835 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:25:50.671406 29835 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:25:50.671669 29835 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 15:25:50.671986 29835 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 15:25:50.672043 29835 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:50.672107 29835 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 15:25:50.672151 29835 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:50.678438 29835 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.130:45317
I20260810 15:25:50.678535 30062 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.130:45317 every 8 connection(s)
I20260810 15:25:50.679054 29835 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/ts-1/data/info.pb
I20260810 15:25:50.680008 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 29835
I20260810 15:25:50.680160 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/ts-1/wal/instance
I20260810 15:25:50.680387 18706 external_mini_cluster.cc:1428] Setting key 53cd3418349a84eab6178918bd441632
Aug 10 15:25:50 dist-test-slave-2p8l krb5kdc[29413](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375550, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.68.130@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM
WARNING: no policy specified for oryx/127.18.68.131@KRBTEST.COM; defaulting to no policy
I20260810 15:25:50.689769 29574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:50.679917 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.130:40295 (local address 127.18.68.190:46363)
0810 15:25:50.680051 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:50.680053 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:50.680176 (+ 123us) server_negotiation.cc:407] Connection header received
0810 15:25:50.680911 (+ 735us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:50.680912 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:50.680921 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:50.680963 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:50.682322 (+ 1359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:50.682835 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:50.683980 (+ 1145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:50.684319 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:50.684418 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:50.686836 (+ 2418us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:50.686837 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:50.686838 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:50.686846 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:50.688323 (+ 1477us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:50.688768 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:50.688770 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:50.688770 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:50.688832 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:50.689101 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:50.689101 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:50.689102 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:50.689218 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:50.689290 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:50.689583 (+ 293us) server_negotiation.cc:299] Negotiation successful
0810 15:25:50.689678 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109}
I20260810 15:25:50.689963 30066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:50.679801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46363 (local address 127.18.68.130:40295)
0810 15:25:50.680004 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:50.680068 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:50.680805 (+ 737us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:50.681033 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:50.681043 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:50.681917 (+ 874us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:25:50.682239 (+ 322us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:50.682246 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:50.682928 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:50.682929 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:50.683893 (+ 964us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:50.683895 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:50.684442 (+ 547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:50.684443 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:50.684592 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:50.685208 (+ 616us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:25:50.685218 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:25:50.686730 (+ 1512us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:25:50.688430 (+ 1700us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:50.688439 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:50.688441 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:50.688687 (+ 246us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:50.688901 (+ 214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:50.688903 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:50.688903 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:50.689015 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:50.689294 (+ 279us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:25:50.689302 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:25:50.689442 (+ 140us) client_negotiation.cc:769] Sending connection context
0810 15:25:50.689547 (+ 105us) client_negotiation.cc:240] Negotiation successful
0810 15:25:50.689713 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":107,"threads_started":1}
I20260810 15:25:50.690454 30064 heartbeater.cc:347] Connected to a master server at 127.18.68.190:46363
I20260810 15:25:50.690567 30064 heartbeater.cc:464] Registering TS with master...
I20260810 15:25:50.690778 30064 heartbeater.cc:511] Master 127.18.68.190:46363 requested a full tablet report, sending...
I20260810 15:25:50.691215 29495 ts_manager.cc:194] Registered new tserver with Master: a69ecd14acce486bbad8a4d162d66996 (127.18.68.130:45317)
I20260810 15:25:50.691612 29495 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.18.68.130@KRBTEST.COM'} at 127.18.68.130:40295
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.18.68.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.18.68.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/krb5kdc/oryx_127.18.68.131.keytab.
Entry for principal oryx/127.18.68.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/krb5kdc/oryx_127.18.68.131.keytab.
I20260810 15:25:50.709182 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.68.131:0
--local_ip_for_outbound_sockets=127.18.68.131
--webserver_interface=127.18.68.131
--webserver_port=0
--tserver_master_addrs=127.18.68.190:46363
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/krb5kdc/oryx_127.18.68.131.keytab
--principal=oryx/127.18.68.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:33723
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:25:50.793468 30069 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:25:50.793677 30069 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:25:50.793704 30069 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:25:50.794952 30069 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:25:50.794996 30069 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:25:50.795023 30069 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.68.131
I20260810 15:25:50.796649 30069 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:33723
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/krb5kdc/oryx_127.18.68.131.keytab
--principal=oryx/127.18.68.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.68.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.68.131
--webserver_port=0
--tserver_master_addrs=127.18.68.190:46363
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30069
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.68.131
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:25:50.796856 30069 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:25:50.797051 30069 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:25:50.802645 30086 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:50.802650 30078 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:25:50.802807 30069 server_base.cc:1034] running on GCE node
W20260810 15:25:50.802654 30080 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:25:50.803154 30069 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:25:50.803369 30069 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:25:50.804550 30069 hybrid_clock.cc:648] HybridClock initialized: now 1786375550804537 us; error 46 us; skew 500 ppm
Aug 10 15:25:50 dist-test-slave-2p8l krb5kdc[29413](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375550, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.68.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:25:50.807550 30069 init.cc:377] Logged in from keytab as oryx/127.18.68.131@KRBTEST.COM (short username oryx)
I20260810 15:25:50.808112 30069 webserver.cc:460] Webserver started at http://127.18.68.131:40343/ using document root <none> and password file <none>
I20260810 15:25:50.808389 30069 fs_manager.cc:359] Metadata directory not provided
I20260810 15:25:50.808462 30069 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:25:50.808619 30069 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:25:50.809724 30069 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/ts-2/data/instance:
uuid: "92842de48966403c9acb8cbb06797670"
format_stamp: "Formatted at 2026-08-10 15:25:50 on dist-test-slave-2p8l"
server_key: "8e2671c45a0fff751aba3d92c2c26302"
server_key_iv: "dcd3b87142c763a8d65104b695445f0f"
server_key_version: "encryptionkey@0"
I20260810 15:25:50.810177 30069 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/ts-2/wal/instance:
uuid: "92842de48966403c9acb8cbb06797670"
format_stamp: "Formatted at 2026-08-10 15:25:50 on dist-test-slave-2p8l"
server_key: "8e2671c45a0fff751aba3d92c2c26302"
server_key_iv: "dcd3b87142c763a8d65104b695445f0f"
server_key_version: "encryptionkey@0"
I20260810 15:25:50.811591 30069 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260810 15:25:50.812398 30099 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:50.812602 30069 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 15:25:50.812723 30069 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/ts-2/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/ts-2/wal
uuid: "92842de48966403c9acb8cbb06797670"
format_stamp: "Formatted at 2026-08-10 15:25:50 on dist-test-slave-2p8l"
server_key: "8e2671c45a0fff751aba3d92c2c26302"
server_key_iv: "dcd3b87142c763a8d65104b695445f0f"
server_key_version: "encryptionkey@0"
I20260810 15:25:50.812813 30069 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:25:50.824875 30069 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:25:50.827035 30069 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:25:50.827224 30069 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:25:50.827484 30069 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 15:25:50.827827 30069 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 15:25:50.827883 30069 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:50.827919 30069 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 15:25:50.827968 30069 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:50.834789 30069 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.131:42797
I20260810 15:25:50.834853 30291 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.131:42797 every 8 connection(s)
I20260810 15:25:50.835273 30069 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/ts-2/data/info.pb
Aug 10 15:25:50 dist-test-slave-2p8l krb5kdc[29413](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375550, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.68.131@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM
I20260810 15:25:50.845146 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 30069
I20260810 15:25:50.845235 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/ts-2/wal/instance
I20260810 15:25:50.845448 18706 external_mini_cluster.cc:1428] Setting key a40c5bee7025d55f309017b8e8e84928
I20260810 15:25:50.845903 29574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:50.836074 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.131:45369 (local address 127.18.68.190:46363)
0810 15:25:50.836131 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:50.836133 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:50.836332 (+ 199us) server_negotiation.cc:407] Connection header received
0810 15:25:50.836832 (+ 500us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:50.836833 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:50.836844 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:50.836902 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:50.837949 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:50.838687 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:50.840200 (+ 1513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:50.840383 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:50.840444 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:50.842920 (+ 2476us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:50.842922 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:50.842923 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:50.842931 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:50.844291 (+ 1360us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:50.844784 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:50.844785 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:50.844786 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:50.844852 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:50.845105 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:50.845106 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:50.845107 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:50.845262 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:50.845332 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:50.845684 (+ 352us) server_negotiation.cc:299] Negotiation successful
0810 15:25:50.845774 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260810 15:25:50.846139 30294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:50.836048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46363 (local address 127.18.68.131:45369)
0810 15:25:50.836208 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:50.836244 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:50.836723 (+ 479us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:50.836953 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:50.836956 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:50.837626 (+ 670us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:25:50.837845 (+ 219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:50.837851 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:50.838798 (+ 947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:50.838799 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:50.840104 (+ 1305us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:50.840108 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:50.840465 (+ 357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:50.840466 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:50.840608 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:50.841180 (+ 572us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:25:50.841189 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:25:50.842812 (+ 1623us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:25:50.844405 (+ 1593us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:50.844412 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:50.844415 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:50.844704 (+ 289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:50.844924 (+ 220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:50.844925 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:50.844926 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:50.845034 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:50.845332 (+ 298us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:25:50.845340 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:25:50.845476 (+ 136us) client_negotiation.cc:769] Sending connection context
0810 15:25:50.845630 (+ 154us) client_negotiation.cc:240] Negotiation successful
0810 15:25:50.845818 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":90,"threads_started":1}
I20260810 15:25:50.846578 30292 heartbeater.cc:347] Connected to a master server at 127.18.68.190:46363
I20260810 15:25:50.846673 30292 heartbeater.cc:464] Registering TS with master...
I20260810 15:25:50.846872 30292 heartbeater.cc:511] Master 127.18.68.190:46363 requested a full tablet report, sending...
I20260810 15:25:50.847266 29495 ts_manager.cc:194] Registered new tserver with Master: 92842de48966403c9acb8cbb06797670 (127.18.68.131:42797)
I20260810 15:25:50.847594 29495 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.18.68.131@KRBTEST.COM'} at 127.18.68.131:45369
I20260810 15:25:50.857532 18706 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.18.68.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.18.68.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.18.68.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/krb5kdc/oryx_127.18.68.189.keytab.
Entry for principal oryx/127.18.68.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/krb5kdc/oryx_127.18.68.189.keytab.
I20260810 15:25:50.887301 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.189:38325
--webserver_interface=127.18.68.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/krb5kdc/oryx_127.18.68.189.keytab
--principal=oryx/127.18.68.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:33723
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.68.190:46363,127.18.68.189:38325
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:25:50.971319 30298 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:25:50.971539 30298 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:25:50.971562 30298 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:25:50.972728 30298 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 15:25:50.972771 30298 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:25:50.972785 30298 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:25:50.972798 30298 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 15:25:50.972810 30298 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 15:25:50.974344 30298 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:33723
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.18.68.190:46363,127.18.68.189:38325
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/krb5kdc/oryx_127.18.68.189.keytab
--principal=oryx/127.18.68.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.189:38325
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.18.68.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30298
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
W20260810 15:25:50.974478 30298 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.18.68.190:46363,127.18.68.189:38325'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260810 15:25:50.974634 30298 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:25:50.974867 30298 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:25:50.980423 30314 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:25:50.980590 30298 server_base.cc:1034] running on GCE node
W20260810 15:25:50.980449 30319 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:50.980439 30311 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:25:50.980986 30298 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:25:50.981354 30298 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:25:50.982542 30298 hybrid_clock.cc:648] HybridClock initialized: now 1786375550982504 us; error 70 us; skew 500 ppm
Aug 10 15:25:50 dist-test-slave-2p8l krb5kdc[29413](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375550, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.68.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:25:50.985356 30298 init.cc:377] Logged in from keytab as oryx/127.18.68.189@KRBTEST.COM (short username oryx)
I20260810 15:25:50.985924 30298 webserver.cc:460] Webserver started at http://127.18.68.189:43275/ using document root <none> and password file <none>
I20260810 15:25:50.986274 30298 fs_manager.cc:359] Metadata directory not provided
I20260810 15:25:50.986354 30298 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:25:50.986526 30298 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:25:50.987707 30298 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/master-1/data/instance:
uuid: "368b444be95f4679b16a674be8ad8be1"
format_stamp: "Formatted at 2026-08-10 15:25:50 on dist-test-slave-2p8l"
server_key: "2581449e56adcd7a1b68aebeb956fa1c"
server_key_iv: "29260b73ac3dce1cbecfb5355626fb9c"
server_key_version: "encryptionkey@0"
I20260810 15:25:50.988118 30298 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/master-1/wal/instance:
uuid: "368b444be95f4679b16a674be8ad8be1"
format_stamp: "Formatted at 2026-08-10 15:25:50 on dist-test-slave-2p8l"
server_key: "2581449e56adcd7a1b68aebeb956fa1c"
server_key_iv: "29260b73ac3dce1cbecfb5355626fb9c"
server_key_version: "encryptionkey@0"
I20260810 15:25:50.989594 30298 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 15:25:50.990463 30333 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:50.990644 30298 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:50.990759 30298 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/master-1/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/master-1/wal
uuid: "368b444be95f4679b16a674be8ad8be1"
format_stamp: "Formatted at 2026-08-10 15:25:50 on dist-test-slave-2p8l"
server_key: "2581449e56adcd7a1b68aebeb956fa1c"
server_key_iv: "29260b73ac3dce1cbecfb5355626fb9c"
server_key_version: "encryptionkey@0"
I20260810 15:25:50.990846 30298 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:25:51.007306 30298 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:25:51.009500 30298 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:25:51.009693 30298 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:25:51.014663 30298 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.189:38325
I20260810 15:25:51.014701 30417 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.189:38325 every 8 connection(s)
I20260810 15:25:51.015112 30298 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/master-1/data/info.pb
I20260810 15:25:51.016280 30418 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:25:51.018181 30418 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46363 } has no permanent_uuid. Determining permanent_uuid...
I20260810 15:25:51.023419 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 30298
Aug 10 15:25:51 dist-test-slave-2p8l krb5kdc[29413](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375550, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.68.189@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM
I20260810 15:25:51.029032 29574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:51.018921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39466 (local address 127.18.68.190:46363)
0810 15:25:51.018989 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:51.018991 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:51.019189 (+ 198us) server_negotiation.cc:407] Connection header received
0810 15:25:51.019676 (+ 487us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:51.019677 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:51.019689 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:51.019759 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:51.020374 (+ 615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:51.020912 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:51.021998 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:51.022307 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:51.022373 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:51.025220 (+ 2847us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:51.025222 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:51.025222 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:51.025229 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:51.027112 (+ 1883us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:51.027641 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:51.027642 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:51.027643 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:51.027704 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:51.028004 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:51.028005 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:51.028005 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:51.028238 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:51.028325 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:51.028758 (+ 433us) server_negotiation.cc:299] Negotiation successful
0810 15:25:51.028873 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260810 15:25:51.029145 30421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:51.018863 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46363 (local address 127.0.0.1:39466)
0810 15:25:51.019056 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:51.019099 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:51.019549 (+ 450us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:51.019832 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:51.019836 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:51.020100 (+ 264us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:25:51.020291 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:51.020295 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:51.021011 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:51.021012 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:51.021872 (+ 860us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:51.021874 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:51.022401 (+ 527us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:51.022402 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:51.022518 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:51.023158 (+ 640us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:25:51.023176 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:25:51.025126 (+ 1950us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:25:51.027212 (+ 2086us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:51.027220 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:51.027221 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:51.027507 (+ 286us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:51.027778 (+ 271us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:51.027778 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:51.027779 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:51.027931 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:51.028338 (+ 407us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:25:51.028345 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:25:51.028563 (+ 218us) client_negotiation.cc:769] Sending connection context
0810 15:25:51.028700 (+ 137us) client_negotiation.cc:240] Negotiation successful
0810 15:25:51.028891 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":118,"threads_started":1}
I20260810 15:25:51.030296 30418 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.68.189" port: 38325 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 15:25:51 dist-test-slave-2p8l krb5kdc[29413](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375550, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.18.68.189@KRBTEST.COM
Aug 10 15:25:51 dist-test-slave-2p8l krb5kdc[29413](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375550, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.68.189@KRBTEST.COM for oryx/127.18.68.189@KRBTEST.COM
I20260810 15:25:51.034932 30423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:51.024189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57180 (local address 127.18.68.189:38325)
0810 15:25:51.024380 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:51.024385 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:51.024461 (+ 76us) server_negotiation.cc:407] Connection header received
0810 15:25:51.024485 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:51.024487 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:51.024567 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:51.024661 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:51.025345 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:51.026402 (+ 1057us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:51.027526 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:51.028081 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:51.028138 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:51.031412 (+ 3274us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:51.031421 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:51.031422 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:51.031430 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:51.033291 (+ 1861us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:51.033774 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:51.033776 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:51.033777 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:51.033837 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:51.034191 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:51.034193 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:51.034193 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:51.034416 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:51.034591 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:51.034712 (+ 121us) server_negotiation.cc:299] Negotiation successful
0810 15:25:51.034795 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":164,"thread_start_us":95,"threads_started":1}
I20260810 15:25:51.038610 30421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:51.030627 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.189:38325 (local address 127.0.0.1:57182)
0810 15:25:51.030696 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:51.030709 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:51.030758 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:51.031027 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:51.031028 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:51.031187 (+ 159us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:25:51.031239 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:51.031240 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:51.031960 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:51.031961 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:51.032474 (+ 513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:51.032476 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:51.032895 (+ 419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:51.032896 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:51.032972 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:51.033398 (+ 426us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:25:51.033403 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:25:51.035189 (+ 1786us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:25:51.037508 (+ 2319us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:51.037509 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:51.037509 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:51.037689 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:51.037888 (+ 199us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:51.037889 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:51.037889 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:51.037943 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:51.038292 (+ 349us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:25:51.038293 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:25:51.038357 (+ 64us) client_negotiation.cc:769] Sending connection context
0810 15:25:51.038434 (+ 77us) client_negotiation.cc:240] Negotiation successful
0810 15:25:51.038541 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":47}
I20260810 15:25:51.038779 30426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:51.030706 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57182 (local address 127.18.68.189:38325)
0810 15:25:51.030850 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:51.030852 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:51.030861 (+ 9us) server_negotiation.cc:407] Connection header received
0810 15:25:51.030889 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:51.030890 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:51.030899 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:51.031018 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:51.031324 (+ 306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:51.031856 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:51.032583 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:51.032815 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:51.032899 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:51.035286 (+ 2387us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:51.035287 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:51.035287 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:51.035295 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:51.037427 (+ 2132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:51.037763 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:51.037764 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:51.037764 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:51.037822 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:51.038002 (+ 180us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:51.038003 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:51.038003 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:51.038170 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:51.038292 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:51.038469 (+ 177us) server_negotiation.cc:299] Negotiation successful
0810 15:25:51.038598 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":55,"server-negotiator.queue_time_us":123,"thread_start_us":94,"threads_started":1}
I20260810 15:25:51.040191 30418 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 368b444be95f4679b16a674be8ad8be1: Bootstrap starting.
I20260810 15:25:51.040879 30418 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 368b444be95f4679b16a674be8ad8be1: Neither blocks nor log segments found. Creating new log.
I20260810 15:25:51.041191 30418 log.cc:824] T 00000000000000000000000000000000 P 368b444be95f4679b16a674be8ad8be1: Log is configured to *not* fsync() on all Append() calls
I20260810 15:25:51.042003 30418 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 368b444be95f4679b16a674be8ad8be1: No bootstrap required, opened a new log
I20260810 15:25:51.043593 30418 raft_consensus.cc:348] T 00000000000000000000000000000000 P 368b444be95f4679b16a674be8ad8be1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc69d8e9c6814168941f833a163493a1" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46363 } } peers { permanent_uuid: "368b444be95f4679b16a674be8ad8be1" member_type: VOTER last_known_addr { host: "127.18.68.189" port: 38325 } }
I20260810 15:25:51.043756 30418 raft_consensus.cc:374] T 00000000000000000000000000000000 P 368b444be95f4679b16a674be8ad8be1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:25:51.043780 30418 raft_consensus.cc:729] T 00000000000000000000000000000000 P 368b444be95f4679b16a674be8ad8be1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 368b444be95f4679b16a674be8ad8be1, State: Initialized, Role: FOLLOWER
I20260810 15:25:51.043920 30418 consensus_queue.cc:260] T 00000000000000000000000000000000 P 368b444be95f4679b16a674be8ad8be1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc69d8e9c6814168941f833a163493a1" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46363 } } peers { permanent_uuid: "368b444be95f4679b16a674be8ad8be1" member_type: VOTER last_known_addr { host: "127.18.68.189" port: 38325 } }
I20260810 15:25:51.044269 30418 sys_catalog.cc:564] T 00000000000000000000000000000000 P 368b444be95f4679b16a674be8ad8be1 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 15:25:51.044240 30432 sys_catalog.cc:455] T 00000000000000000000000000000000 P 368b444be95f4679b16a674be8ad8be1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc69d8e9c6814168941f833a163493a1" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46363 } } peers { permanent_uuid: "368b444be95f4679b16a674be8ad8be1" member_type: VOTER last_known_addr { host: "127.18.68.189" port: 38325 } } }
I20260810 15:25:51.044363 30432 sys_catalog.cc:458] T 00000000000000000000000000000000 P 368b444be95f4679b16a674be8ad8be1 [sys.catalog]: This master's current role is: FOLLOWER
W20260810 15:25:51.046042 30449 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 368b444be95f4679b16a674be8ad8be1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 15:25:51.046131 30449 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 15:25:51.050841 30298 master_runner.cc:428] Detected that this master 368b444be95f4679b16a674be8ad8be1 is joining an existing cluster
I20260810 15:25:51.050897 30298 master_runner.cc:432] Initiating AddMaster RPC to add 127.18.68.189:38325
I20260810 15:25:51.061058 30459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:51.052520 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.189:38325 (local address 127.0.0.1:57188)
0810 15:25:51.052685 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:51.052698 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:51.052758 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:51.052947 (+ 189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:51.052948 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:51.053170 (+ 222us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:25:51.053259 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:51.053261 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:51.054285 (+ 1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:51.054285 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:51.055313 (+ 1028us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:51.055316 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:51.055908 (+ 592us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:51.055909 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:51.055976 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:51.057258 (+ 1282us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:25:51.057263 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:25:51.057778 (+ 515us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:25:51.059825 (+ 2047us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:51.059826 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:51.059826 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:51.060012 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:51.060252 (+ 240us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:51.060253 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:51.060253 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:51.060315 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:51.060623 (+ 308us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:25:51.060624 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:25:51.060679 (+ 55us) client_negotiation.cc:769] Sending connection context
0810 15:25:51.060776 (+ 97us) client_negotiation.cc:240] Negotiation successful
0810 15:25:51.060893 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":106,"threads_started":1}
I20260810 15:25:51.061165 30426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:51.052704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57188 (local address 127.18.68.189:38325)
0810 15:25:51.052742 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:51.052744 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:51.052754 (+ 10us) server_negotiation.cc:407] Connection header received
0810 15:25:51.052836 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:51.052837 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:51.052847 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:51.052877 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:51.053353 (+ 476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:51.054185 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:51.055416 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:51.055741 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:51.055794 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:51.057944 (+ 2150us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:51.057945 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:51.057945 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:51.057953 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:51.059707 (+ 1754us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:51.060114 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:51.060115 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:51.060115 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:51.060179 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:51.060393 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:51.060394 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:51.060395 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:51.060535 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:51.060617 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:51.060821 (+ 204us) server_negotiation.cc:299] Negotiation successful
0810 15:25:51.060966 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":49,"server-negotiator.queue_time_us":21}
I20260810 15:25:51.061450 30458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:51.052282 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46363 (local address 127.0.0.1:39480)
0810 15:25:51.052429 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:51.052911 (+ 482us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:51.053019 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:51.053214 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:51.053215 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:51.053443 (+ 228us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:25:51.053508 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:51.053510 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:51.054496 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:51.054497 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:51.055326 (+ 829us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:51.055329 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:51.055924 (+ 595us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:51.055925 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:51.055989 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:51.057127 (+ 1138us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:25:51.057132 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:25:51.057596 (+ 464us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:25:51.060177 (+ 2581us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:51.060178 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:51.060179 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:51.060426 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:51.060668 (+ 242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:51.060668 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:51.060669 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:51.060730 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:51.061089 (+ 359us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:25:51.061090 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:25:51.061135 (+ 45us) client_negotiation.cc:769] Sending connection context
0810 15:25:51.061232 (+ 97us) client_negotiation.cc:240] Negotiation successful
0810 15:25:51.061343 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":93,"threads_started":1}
I20260810 15:25:51.061463 29574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:51.052474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39480 (local address 127.18.68.190:46363)
0810 15:25:51.052881 (+ 407us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:51.052884 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:51.052992 (+ 108us) server_negotiation.cc:407] Connection header received
0810 15:25:51.053110 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:51.053112 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:51.053122 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:51.053152 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:51.053605 (+ 453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:51.054395 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:51.055486 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:51.055780 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:51.055824 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:51.057702 (+ 1878us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:51.057704 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:51.057704 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:51.057711 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:51.060060 (+ 2349us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:51.060511 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:51.060512 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:51.060513 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:51.060576 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:51.060833 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:51.060834 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:51.060835 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:51.060982 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:51.061033 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:51.061268 (+ 235us) server_negotiation.cc:299] Negotiation successful
0810 15:25:51.061352 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":381}
Aug 10 15:25:51 dist-test-slave-2p8l krb5kdc[29413](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375550, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.68.190@KRBTEST.COM for oryx/127.18.68.189@KRBTEST.COM
I20260810 15:25:51.072455 30460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:51.064113 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.189:38325 (local address 127.0.0.1:57194)
0810 15:25:51.064259 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:51.064313 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:51.064384 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:51.064542 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:51.064545 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:51.064808 (+ 263us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:25:51.064859 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:51.064860 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:51.065829 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:51.065829 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:51.066551 (+ 722us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:51.066554 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:51.067071 (+ 517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:51.067072 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:51.067138 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:51.067699 (+ 561us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:25:51.067704 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:25:51.069331 (+ 1627us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:25:51.071262 (+ 1931us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:51.071271 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:51.071273 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:51.071490 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:51.071738 (+ 248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:51.071739 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:51.071739 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:51.071804 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:51.072127 (+ 323us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:25:51.072134 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:25:51.072187 (+ 53us) client_negotiation.cc:769] Sending connection context
0810 15:25:51.072274 (+ 87us) client_negotiation.cc:240] Negotiation successful
0810 15:25:51.072381 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":84,"threads_started":1}
I20260810 15:25:51.072518 30426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:51.064205 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57194 (local address 127.18.68.189:38325)
0810 15:25:51.064298 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:51.064300 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:51.064366 (+ 66us) server_negotiation.cc:407] Connection header received
0810 15:25:51.064446 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:51.064447 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:51.064458 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:51.064539 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:51.064935 (+ 396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:51.065739 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:51.066635 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:51.066968 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:51.067049 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:51.069420 (+ 2371us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:51.069422 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:51.069422 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:51.069430 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:51.071164 (+ 1734us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:51.071577 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:51.071578 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:51.071578 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:51.071646 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:51.071877 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:51.071878 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:51.071878 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:51.072023 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:51.072130 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:51.072322 (+ 192us) server_negotiation.cc:299] Negotiation successful
0810 15:25:51.072411 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260810 15:25:51.073155 29495 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.18.68.189:38325: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "368b444be95f4679b16a674be8ad8be1"
member_type: NON_VOTER
last_known_addr {
host: "127.18.68.189"
port: 38325
}
attrs {
promote: true
}
}
dest_uuid: "dc69d8e9c6814168941f833a163493a1"
cas_config_opid_index: -1
I20260810 15:25:51.073508 29495 consensus_queue.cc:237] T 00000000000000000000000000000000 P dc69d8e9c6814168941f833a163493a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "dc69d8e9c6814168941f833a163493a1" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46363 } } peers { permanent_uuid: "368b444be95f4679b16a674be8ad8be1" member_type: NON_VOTER last_known_addr { host: "127.18.68.189" port: 38325 } attrs { promote: true } }
I20260810 15:25:51.074046 30462 raft_consensus.cc:2932] T 00000000000000000000000000000000 P dc69d8e9c6814168941f833a163493a1 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 368b444be95f4679b16a674be8ad8be1 (127.18.68.189) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "dc69d8e9c6814168941f833a163493a1" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46363 } } peers { permanent_uuid: "368b444be95f4679b16a674be8ad8be1" member_type: NON_VOTER last_known_addr { host: "127.18.68.189" port: 38325 } attrs { promote: true } } }
I20260810 15:25:51.074424 30380 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 368b444be95f4679b16a674be8ad8be1 [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:25:51.075251 30380 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 368b444be95f4679b16a674be8ad8be1 [term 1 FOLLOWER]: Refusing update from remote peer dc69d8e9c6814168941f833a163493a1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260810 15:25:51.075341 30462 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.18.68.189:38325
I20260810 15:25:51.075718 30298 master.cc:537] Master@127.18.68.189:38325 shutting down...
I20260810 15:25:51.075718 30462 consensus_queue.cc:1035] T 00000000000000000000000000000000 P dc69d8e9c6814168941f833a163493a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "368b444be95f4679b16a674be8ad8be1" member_type: NON_VOTER last_known_addr { host: "127.18.68.189" port: 38325 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 15:25:51.076226 30461 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc69d8e9c6814168941f833a163493a1 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "dc69d8e9c6814168941f833a163493a1" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "dc69d8e9c6814168941f833a163493a1" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46363 } } peers { permanent_uuid: "368b444be95f4679b16a674be8ad8be1" member_type: NON_VOTER last_known_addr { host: "127.18.68.189" port: 38325 } attrs { promote: true } } }
I20260810 15:25:51.076347 30461 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc69d8e9c6814168941f833a163493a1 [sys.catalog]: This master's current role is: LEADER
W20260810 15:25:51.076555 29469 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260810 15:25:51.077069 29469 consensus_peers.cc:487] T 00000000000000000000000000000000 P dc69d8e9c6814168941f833a163493a1 -> Peer 368b444be95f4679b16a674be8ad8be1 (127.18.68.189:38325): Couldn't send request to peer 368b444be95f4679b16a674be8ad8be1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260810 15:25:51.078821 30298 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 368b444be95f4679b16a674be8ad8be1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 15:25:51.078915 30298 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 368b444be95f4679b16a674be8ad8be1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 15:25:51.078972 30298 tablet_replica.cc:330] T 00000000000000000000000000000000 P 368b444be95f4679b16a674be8ad8be1: stopping tablet replica
I20260810 15:25:51.091857 30298 master.cc:552] Master@127.18.68.189:38325 shutdown complete.
I20260810 15:25:51.091917 30298 master_runner.cc:305] Clearing existing system tablet
I20260810 15:25:51.092079 30298 fs_manager.cc:359] Metadata directory not provided
I20260810 15:25:51.092139 30298 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:25:51.092813 30298 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.001s sys 0.001s
I20260810 15:25:51.093320 30468 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:51.093459 30298 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:25:51.093520 30298 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:51.093544 30298 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/master-1/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/master-1/wal
uuid: "368b444be95f4679b16a674be8ad8be1"
format_stamp: "Formatted at 2026-08-10 15:25:50 on dist-test-slave-2p8l"
server_key: "2581449e56adcd7a1b68aebeb956fa1c"
server_key_iv: "29260b73ac3dce1cbecfb5355626fb9c"
server_key_version: "encryptionkey@0"
I20260810 15:25:51.094421 30298 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 368b444be95f4679b16a674be8ad8be1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 15:25:51.095772 30298 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 368b444be95f4679b16a674be8ad8be1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260810 15:25:51.095837 30298 log.cc:1196] T 00000000000000000000000000000000 P 368b444be95f4679b16a674be8ad8be1: Deleting WAL directory at /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260810 15:25:51.096067 30298 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 368b444be95f4679b16a674be8ad8be1: Deleting consensus metadata
I20260810 15:25:51.096242 30298 master_runner.cc:315] Copying system tablet from 127.18.68.190:46363
I20260810 15:25:51.096845 30298 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 368b444be95f4679b16a674be8ad8be1: tablet copy: Beginning tablet copy session from remote peer at address 127.18.68.190:46363
I20260810 15:25:51.104492 30481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:51.097210 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46363 (local address 127.0.0.1:39486)
0810 15:25:51.097372 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:51.097382 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:51.097449 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:51.097612 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:51.097612 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:51.097777 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:25:51.097836 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:51.097837 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:51.098942 (+ 1105us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:51.098943 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:51.099544 (+ 601us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:51.099546 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:51.100132 (+ 586us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:51.100133 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:51.100200 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:51.100841 (+ 641us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:25:51.100846 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:25:51.101194 (+ 348us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:25:51.103300 (+ 2106us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:51.103301 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:51.103301 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:51.103491 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:51.103788 (+ 297us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:51.103788 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:51.103789 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:51.103858 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:51.104193 (+ 335us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:25:51.104194 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:25:51.104240 (+ 46us) client_negotiation.cc:769] Sending connection context
0810 15:25:51.104302 (+ 62us) client_negotiation.cc:240] Negotiation successful
0810 15:25:51.104405 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":83,"threads_started":1}
I20260810 15:25:51.104588 29574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:51.097264 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39486 (local address 127.18.68.190:46363)
0810 15:25:51.097311 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:51.097313 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:51.097466 (+ 153us) server_negotiation.cc:407] Connection header received
0810 15:25:51.097503 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:51.097504 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:51.097518 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:51.097599 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:51.097905 (+ 306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:51.098822 (+ 917us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:51.099645 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:51.100006 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:51.100101 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:51.101299 (+ 1198us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:51.101301 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:51.101301 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:51.101310 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:51.103195 (+ 1885us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:51.103607 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:51.103609 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:51.103609 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:51.103683 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:51.103934 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:51.103935 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:51.103935 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:51.104113 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:51.104193 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:51.104360 (+ 167us) server_negotiation.cc:299] Negotiation successful
0810 15:25:51.104467 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260810 15:25:51.105230 29532 tablet_copy_service.cc:140] P dc69d8e9c6814168941f833a163493a1: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 368b444be95f4679b16a674be8ad8be1 ({username='oryx', principal='oryx/127.18.68.189@KRBTEST.COM'} at 127.0.0.1:39486)
I20260810 15:25:51.105340 29532 tablet_copy_service.cc:161] P dc69d8e9c6814168941f833a163493a1: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 368b444be95f4679b16a674be8ad8be1 at {username='oryx', principal='oryx/127.18.68.189@KRBTEST.COM'} at 127.0.0.1:39486: session id = 368b444be95f4679b16a674be8ad8be1-00000000000000000000000000000000
I20260810 15:25:51.105976 29532 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P dc69d8e9c6814168941f833a163493a1: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 15:25:51.106776 30298 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260810 15:25:51.108325 30298 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 368b444be95f4679b16a674be8ad8be1: tablet copy: Starting download of 0 data blocks...
I20260810 15:25:51.108515 30298 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 368b444be95f4679b16a674be8ad8be1: tablet copy: Starting download of 1 WAL segments...
I20260810 15:25:51.109668 30298 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 368b444be95f4679b16a674be8ad8be1: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 15:25:51.110877 29532 tablet_copy_service.cc:342] P dc69d8e9c6814168941f833a163493a1: Request end of tablet copy session 368b444be95f4679b16a674be8ad8be1-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.18.68.189@KRBTEST.COM'} at 127.0.0.1:39486
I20260810 15:25:51.110947 29532 tablet_copy_service.cc:433] P dc69d8e9c6814168941f833a163493a1: ending tablet copy session 368b444be95f4679b16a674be8ad8be1-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 368b444be95f4679b16a674be8ad8be1
I20260810 15:25:51.114355 30298 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:25:51.115859 30483 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:51.115875 30486 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:51.116138 30482 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:25:51.116271 30298 server_base.cc:1034] running on GCE node
I20260810 15:25:51.116360 30298 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:25:51.116509 30298 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:25:51.117640 30298 hybrid_clock.cc:648] HybridClock initialized: now 1786375551117639 us; error 37 us; skew 500 ppm
Aug 10 15:25:51 dist-test-slave-2p8l krb5kdc[29413](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375551, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.68.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:25:51.119200 30298 init.cc:377] Logged in from keytab as oryx/127.18.68.189@KRBTEST.COM (short username oryx)
I20260810 15:25:51.119509 30298 webserver.cc:460] Webserver started at http://127.18.68.189:43985/ using document root <none> and password file <none>
I20260810 15:25:51.119642 30298 fs_manager.cc:359] Metadata directory not provided
I20260810 15:25:51.119694 30298 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:25:51.120349 30298 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.000s sys 0.001s
I20260810 15:25:51.120915 30501 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:51.121065 30298 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 15:25:51.121115 30298 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/master-1/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/master-1/wal
uuid: "368b444be95f4679b16a674be8ad8be1"
format_stamp: "Formatted at 2026-08-10 15:25:50 on dist-test-slave-2p8l"
server_key: "2581449e56adcd7a1b68aebeb956fa1c"
server_key_iv: "29260b73ac3dce1cbecfb5355626fb9c"
server_key_version: "encryptionkey@0"
I20260810 15:25:51.121184 30298 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:25:51.129210 30298 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:25:51.131049 30298 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:25:51.134313 30298 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.189:38325
I20260810 15:25:51.134706 30594 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.189:38325 every 8 connection(s)
I20260810 15:25:51.134753 30298 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/master-1/data/info.pb
I20260810 15:25:51.135576 30595 sys_catalog.cc:263] Verifying existing consensus state
I20260810 15:25:51.136000 30595 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 368b444be95f4679b16a674be8ad8be1: Bootstrap starting.
I20260810 15:25:51.138917 30595 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 368b444be95f4679b16a674be8ad8be1: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 15:25:51.139186 30595 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 368b444be95f4679b16a674be8ad8be1: Bootstrap complete.
I20260810 15:25:51.139426 30595 raft_consensus.cc:348] T 00000000000000000000000000000000 P 368b444be95f4679b16a674be8ad8be1 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "dc69d8e9c6814168941f833a163493a1" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46363 } } peers { permanent_uuid: "368b444be95f4679b16a674be8ad8be1" member_type: NON_VOTER last_known_addr { host: "127.18.68.189" port: 38325 } attrs { promote: true } }
I20260810 15:25:51.139519 30595 raft_consensus.cc:729] T 00000000000000000000000000000000 P 368b444be95f4679b16a674be8ad8be1 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 368b444be95f4679b16a674be8ad8be1, State: Initialized, Role: LEARNER
I20260810 15:25:51.139560 30595 consensus_queue.cc:260] T 00000000000000000000000000000000 P 368b444be95f4679b16a674be8ad8be1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "dc69d8e9c6814168941f833a163493a1" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46363 } } peers { permanent_uuid: "368b444be95f4679b16a674be8ad8be1" member_type: NON_VOTER last_known_addr { host: "127.18.68.189" port: 38325 } attrs { promote: true } }
I20260810 15:25:51.139736 30595 sys_catalog.cc:564] T 00000000000000000000000000000000 P 368b444be95f4679b16a674be8ad8be1 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 15:25:51.141278 30618 catalog_manager.cc:1259] Loaded cluster ID: 282c713ec3e04fc6b63b8a8f3178953f
I20260810 15:25:51.141384 30618 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 368b444be95f4679b16a674be8ad8be1: loading cluster ID for follower catalog manager: success
I20260810 15:25:51.142681 30618 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 368b444be95f4679b16a674be8ad8be1: acquiring CA information for follower catalog manager: success
I20260810 15:25:51.143013 30618 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 368b444be95f4679b16a674be8ad8be1: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260810 15:25:51.145289 30597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:51.136902 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57210 (local address 127.18.68.189:38325)
0810 15:25:51.137097 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:51.137099 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:51.137108 (+ 9us) server_negotiation.cc:407] Connection header received
0810 15:25:51.137134 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:51.137135 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:51.137146 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:51.137228 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:51.137967 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:51.139303 (+ 1336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:51.140407 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:51.140743 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:51.140829 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:51.142415 (+ 1586us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:51.142416 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:51.142417 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:51.142424 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:51.144045 (+ 1621us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:51.144408 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:51.144409 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:51.144410 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:51.144470 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:51.144734 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:51.144734 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:51.144735 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:51.144863 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:51.144976 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:51.145079 (+ 103us) server_negotiation.cc:299] Negotiation successful
0810 15:25:51.145179 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":109,"threads_started":1}
I20260810 15:25:51.145437 30601 sys_catalog.cc:455] T 00000000000000000000000000000000 P 368b444be95f4679b16a674be8ad8be1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "dc69d8e9c6814168941f833a163493a1" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46363 } } peers { permanent_uuid: "368b444be95f4679b16a674be8ad8be1" member_type: NON_VOTER last_known_addr { host: "127.18.68.189" port: 38325 } attrs { promote: true } } }
I20260810 15:25:51.145547 30601 sys_catalog.cc:458] T 00000000000000000000000000000000 P 368b444be95f4679b16a674be8ad8be1 [sys.catalog]: This master's current role is: LEARNER
WARNING: no policy specified for oryx/127.18.68.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.18.68.188@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.18.68.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/krb5kdc/oryx_127.18.68.188.keytab.
Entry for principal oryx/127.18.68.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/krb5kdc/oryx_127.18.68.188.keytab.
I20260810 15:25:51.177131 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.188:45629
--webserver_interface=127.18.68.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/krb5kdc/oryx_127.18.68.188.keytab
--principal=oryx/127.18.68.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:33723
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.68.190:46363,127.18.68.189:38325,127.18.68.188:45629
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:25:51.284348 30623 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:25:51.284561 30623 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:25:51.284584 30623 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:25:51.285746 30623 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 15:25:51.285789 30623 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:25:51.285804 30623 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:25:51.285816 30623 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 15:25:51.285868 30623 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 15:25:51.287391 30623 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:33723
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.18.68.190:46363,127.18.68.189:38325,127.18.68.188:45629
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/krb5kdc/oryx_127.18.68.188.keytab
--principal=oryx/127.18.68.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.188:45629
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.18.68.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30623
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:25:51.287664 30623 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:25:51.287906 30623 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:25:51.292817 30637 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:51.292816 30646 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:51.292845 30638 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:25:51.293069 30623 server_base.cc:1034] running on GCE node
I20260810 15:25:51.293308 30623 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:25:51.293601 30623 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:25:51.294804 30623 hybrid_clock.cc:648] HybridClock initialized: now 1786375551294785 us; error 40 us; skew 500 ppm
Aug 10 15:25:51 dist-test-slave-2p8l krb5kdc[29413](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375551, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.68.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:25:51.297495 30623 init.cc:377] Logged in from keytab as oryx/127.18.68.188@KRBTEST.COM (short username oryx)
I20260810 15:25:51.297942 30623 webserver.cc:460] Webserver started at http://127.18.68.188:37953/ using document root <none> and password file <none>
I20260810 15:25:51.298228 30623 fs_manager.cc:359] Metadata directory not provided
I20260810 15:25:51.298300 30623 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:25:51.298463 30623 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:25:51.299523 30623 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/master-2/data/instance:
uuid: "79b8b9b8839e47be8dd75bfe3818b5cd"
format_stamp: "Formatted at 2026-08-10 15:25:51 on dist-test-slave-2p8l"
server_key: "647ee97f01f03928172579344b5339a3"
server_key_iv: "9f6e10a0254fd052bd65b21851e09b2a"
server_key_version: "encryptionkey@0"
I20260810 15:25:51.299898 30623 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/master-2/wal/instance:
uuid: "79b8b9b8839e47be8dd75bfe3818b5cd"
format_stamp: "Formatted at 2026-08-10 15:25:51 on dist-test-slave-2p8l"
server_key: "647ee97f01f03928172579344b5339a3"
server_key_iv: "9f6e10a0254fd052bd65b21851e09b2a"
server_key_version: "encryptionkey@0"
I20260810 15:25:51.301342 30623 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 15:25:51.302104 30656 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:51.302320 30623 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:25:51.302428 30623 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/master-2/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/master-2/wal
uuid: "79b8b9b8839e47be8dd75bfe3818b5cd"
format_stamp: "Formatted at 2026-08-10 15:25:51 on dist-test-slave-2p8l"
server_key: "647ee97f01f03928172579344b5339a3"
server_key_iv: "9f6e10a0254fd052bd65b21851e09b2a"
server_key_version: "encryptionkey@0"
I20260810 15:25:51.302503 30623 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:25:51.360342 30623 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:25:51.363003 30623 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:25:51.363178 30623 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:25:51.367547 30623 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.188:45629
I20260810 15:25:51.367666 30755 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.188:45629 every 8 connection(s)
I20260810 15:25:51.368001 30623 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/master-2/data/info.pb
I20260810 15:25:51.369063 30756 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:25:51.370676 30756 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46363 } has no permanent_uuid. Determining permanent_uuid...
I20260810 15:25:51.375825 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 30623
Aug 10 15:25:51 dist-test-slave-2p8l krb5kdc[29413](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375551, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.68.188@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM
I20260810 15:25:51.380534 29574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:51.371448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39492 (local address 127.18.68.190:46363)
0810 15:25:51.371629 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:51.371632 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:51.371833 (+ 201us) server_negotiation.cc:407] Connection header received
0810 15:25:51.372336 (+ 503us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:51.372338 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:51.372351 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:51.372410 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:51.373060 (+ 650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:51.373571 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:51.374666 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:51.374862 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:51.374937 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:51.377379 (+ 2442us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:51.377381 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:51.377382 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:51.377390 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:51.379084 (+ 1694us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:51.379496 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:51.379497 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:51.379498 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:51.379562 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:51.379844 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:51.379845 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:51.379845 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:51.379946 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:51.380018 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:51.380326 (+ 308us) server_negotiation.cc:299] Negotiation successful
0810 15:25:51.380416 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149}
I20260810 15:25:51.380769 30759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:51.371316 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46363 (local address 127.0.0.1:39492)
0810 15:25:51.371689 (+ 373us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:51.371737 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:51.372224 (+ 487us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:51.372477 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:51.372480 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:51.372761 (+ 281us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:25:51.372954 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:51.372958 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:51.373677 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:51.373678 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:51.374547 (+ 869us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:51.374549 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:51.374972 (+ 423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:51.374974 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:51.375098 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:51.375567 (+ 469us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:25:51.375574 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:25:51.377289 (+ 1715us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:25:51.379191 (+ 1902us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:51.379197 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:51.379199 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:51.379418 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:51.379633 (+ 215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:51.379634 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:51.379634 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:51.379760 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:51.380014 (+ 254us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:25:51.380020 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:25:51.380171 (+ 151us) client_negotiation.cc:769] Sending connection context
0810 15:25:51.380289 (+ 118us) client_negotiation.cc:240] Negotiation successful
0810 15:25:51.380455 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":331,"thread_start_us":115,"threads_started":1}
I20260810 15:25:51.381382 30756 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.68.189" port: 38325 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 15:25:51 dist-test-slave-2p8l krb5kdc[29413](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375550, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.18.68.188@KRBTEST.COM
I20260810 15:25:51.385859 30760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:51.376452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59156 (local address 127.18.68.188:45629)
0810 15:25:51.376616 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:51.376621 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:51.376641 (+ 20us) server_negotiation.cc:407] Connection header received
0810 15:25:51.376665 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:51.376667 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:51.376686 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:51.376781 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:51.377452 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:51.378523 (+ 1071us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:51.379523 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:51.379949 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:51.380034 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:51.382918 (+ 2884us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:51.382925 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:51.382926 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:51.382932 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:51.384542 (+ 1610us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:51.385019 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:51.385022 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:51.385022 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:51.385076 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:51.385276 (+ 200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:51.385277 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:51.385277 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:51.385465 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:51.385598 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:51.385725 (+ 127us) server_negotiation.cc:299] Negotiation successful
0810 15:25:51.385786 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":73,"threads_started":1}
Aug 10 15:25:51 dist-test-slave-2p8l krb5kdc[29413](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375551, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.68.188@KRBTEST.COM for oryx/127.18.68.189@KRBTEST.COM
I20260810 15:25:51.388834 30759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:51.381659 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.189:38325 (local address 127.0.0.1:57224)
0810 15:25:51.381779 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:51.381789 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:51.381836 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:51.381970 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:51.381971 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:51.382135 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:25:51.382193 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:51.382194 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:51.383143 (+ 949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:51.383144 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:51.384004 (+ 860us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:51.384007 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:51.384442 (+ 435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:51.384444 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:51.384538 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:51.384932 (+ 394us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:25:51.384936 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:25:51.386478 (+ 1542us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:25:51.387806 (+ 1328us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:51.387807 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:51.387807 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:51.387975 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:51.388188 (+ 213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:51.388189 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:51.388189 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:51.388246 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:51.388519 (+ 273us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:25:51.388520 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:25:51.388562 (+ 42us) client_negotiation.cc:769] Sending connection context
0810 15:25:51.388648 (+ 86us) client_negotiation.cc:240] Negotiation successful
0810 15:25:51.388745 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":102}
I20260810 15:25:51.388856 30597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:51.381731 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57224 (local address 127.18.68.189:38325)
0810 15:25:51.381821 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:51.381823 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:51.381833 (+ 10us) server_negotiation.cc:407] Connection header received
0810 15:25:51.381884 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:51.381885 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:51.381896 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:51.381962 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:51.382274 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:51.383037 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:51.384121 (+ 1084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:51.384346 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:51.384424 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:51.386569 (+ 2145us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:51.386571 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:51.386572 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:51.386579 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:51.387721 (+ 1142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:51.388050 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:51.388051 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:51.388052 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:51.388116 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:51.388321 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:51.388322 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:51.388322 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:51.388444 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:51.388518 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:51.388681 (+ 163us) server_negotiation.cc:299] Negotiation successful
0810 15:25:51.388768 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260810 15:25:51.389308 30756 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.68.188" port: 45629 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 15:25:51 dist-test-slave-2p8l krb5kdc[29413](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375551, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.68.188@KRBTEST.COM for oryx/127.18.68.188@KRBTEST.COM
I20260810 15:25:51.395078 30759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:51.389553 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.188:45629 (local address 127.0.0.1:59162)
0810 15:25:51.389652 (+ 99us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:51.389661 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:51.389707 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:51.389815 (+ 108us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:51.389815 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:51.389927 (+ 112us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:25:51.389956 (+ 29us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:51.389957 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:51.390584 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:51.390585 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:51.391040 (+ 455us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:51.391041 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:51.391355 (+ 314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:51.391355 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:51.391391 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:51.391789 (+ 398us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:25:51.391794 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:25:51.392853 (+ 1059us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:25:51.394303 (+ 1450us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:51.394303 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:51.394304 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:51.394463 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:51.394632 (+ 169us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:51.394633 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:51.394634 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:51.394685 (+ 51us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:51.394864 (+ 179us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:25:51.394865 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:25:51.394897 (+ 32us) client_negotiation.cc:769] Sending connection context
0810 15:25:51.394947 (+ 50us) client_negotiation.cc:240] Negotiation successful
0810 15:25:51.395020 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":85}
I20260810 15:25:51.395139 30760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:51.389616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59162 (local address 127.18.68.188:45629)
0810 15:25:51.389672 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:51.389674 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:51.389696 (+ 22us) server_negotiation.cc:407] Connection header received
0810 15:25:51.389743 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:51.389744 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:51.389752 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:51.389797 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:51.390008 (+ 211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:51.390517 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:51.391109 (+ 592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:51.391294 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:51.391343 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:51.392928 (+ 1585us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:51.392929 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:51.392929 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:51.392935 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:51.394232 (+ 1297us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:51.394524 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:51.394525 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:51.394525 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:51.394572 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:51.394732 (+ 160us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:51.394732 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:51.394732 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:51.394813 (+ 81us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:51.394857 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:51.394963 (+ 106us) server_negotiation.cc:299] Negotiation successful
0810 15:25:51.395064 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":44,"server-negotiator.queue_time_us":34}
I20260810 15:25:51.396644 30756 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 79b8b9b8839e47be8dd75bfe3818b5cd: Bootstrap starting.
I20260810 15:25:51.397514 30756 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 79b8b9b8839e47be8dd75bfe3818b5cd: Neither blocks nor log segments found. Creating new log.
I20260810 15:25:51.397756 30756 log.cc:824] T 00000000000000000000000000000000 P 79b8b9b8839e47be8dd75bfe3818b5cd: Log is configured to *not* fsync() on all Append() calls
I20260810 15:25:51.398546 30756 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 79b8b9b8839e47be8dd75bfe3818b5cd: No bootstrap required, opened a new log
I20260810 15:25:51.399983 30756 raft_consensus.cc:348] T 00000000000000000000000000000000 P 79b8b9b8839e47be8dd75bfe3818b5cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc69d8e9c6814168941f833a163493a1" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46363 } } peers { permanent_uuid: "368b444be95f4679b16a674be8ad8be1" member_type: VOTER last_known_addr { host: "127.18.68.189" port: 38325 } } peers { permanent_uuid: "79b8b9b8839e47be8dd75bfe3818b5cd" member_type: VOTER last_known_addr { host: "127.18.68.188" port: 45629 } }
I20260810 15:25:51.400107 30756 raft_consensus.cc:374] T 00000000000000000000000000000000 P 79b8b9b8839e47be8dd75bfe3818b5cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:25:51.400132 30756 raft_consensus.cc:729] T 00000000000000000000000000000000 P 79b8b9b8839e47be8dd75bfe3818b5cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79b8b9b8839e47be8dd75bfe3818b5cd, State: Initialized, Role: FOLLOWER
I20260810 15:25:51.400254 30756 consensus_queue.cc:260] T 00000000000000000000000000000000 P 79b8b9b8839e47be8dd75bfe3818b5cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc69d8e9c6814168941f833a163493a1" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46363 } } peers { permanent_uuid: "368b444be95f4679b16a674be8ad8be1" member_type: VOTER last_known_addr { host: "127.18.68.189" port: 38325 } } peers { permanent_uuid: "79b8b9b8839e47be8dd75bfe3818b5cd" member_type: VOTER last_known_addr { host: "127.18.68.188" port: 45629 } }
I20260810 15:25:51.400502 30762 sys_catalog.cc:455] T 00000000000000000000000000000000 P 79b8b9b8839e47be8dd75bfe3818b5cd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc69d8e9c6814168941f833a163493a1" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46363 } } peers { permanent_uuid: "368b444be95f4679b16a674be8ad8be1" member_type: VOTER last_known_addr { host: "127.18.68.189" port: 38325 } } peers { permanent_uuid: "79b8b9b8839e47be8dd75bfe3818b5cd" member_type: VOTER last_known_addr { host: "127.18.68.188" port: 45629 } } }
I20260810 15:25:51.400564 30756 sys_catalog.cc:564] T 00000000000000000000000000000000 P 79b8b9b8839e47be8dd75bfe3818b5cd [sys.catalog]: configured and running, proceeding with master startup.
I20260810 15:25:51.400589 30762 sys_catalog.cc:458] T 00000000000000000000000000000000 P 79b8b9b8839e47be8dd75bfe3818b5cd [sys.catalog]: This master's current role is: FOLLOWER
W20260810 15:25:51.402418 30783 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 79b8b9b8839e47be8dd75bfe3818b5cd: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 15:25:51.402498 30783 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 15:25:51.405025 30623 master_runner.cc:428] Detected that this master 79b8b9b8839e47be8dd75bfe3818b5cd is joining an existing cluster
I20260810 15:25:51.405083 30623 master_runner.cc:432] Initiating AddMaster RPC to add 127.18.68.188:45629
I20260810 15:25:51.412753 29574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:51.406666 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39508 (local address 127.18.68.190:46363)
0810 15:25:51.406737 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:51.406740 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:51.406748 (+ 8us) server_negotiation.cc:407] Connection header received
0810 15:25:51.406772 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:51.406773 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:51.406785 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:51.406840 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:51.407266 (+ 426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:51.407828 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:51.408591 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:51.408799 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:51.408885 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:51.409972 (+ 1087us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:51.409973 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:51.409974 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:51.409982 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:51.411541 (+ 1559us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:51.411920 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:51.411921 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:51.411922 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:51.411986 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:51.412193 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:51.412194 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:51.412194 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:51.412313 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:51.412393 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:51.412581 (+ 188us) server_negotiation.cc:299] Negotiation successful
0810 15:25:51.412657 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260810 15:25:51.412770 30791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:51.406212 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46363 (local address 127.0.0.1:39508)
0810 15:25:51.406398 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:51.406409 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:51.406487 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:51.406842 (+ 355us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:51.406843 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:51.407079 (+ 236us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:25:51.407188 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:51.407190 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:51.407912 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:51.407913 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:51.408486 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:51.408488 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:51.408900 (+ 412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:51.408901 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:51.408966 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:51.409520 (+ 554us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:25:51.409525 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:25:51.409871 (+ 346us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:25:51.411645 (+ 1774us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:51.411646 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:51.411647 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:51.411830 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:51.412056 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:51.412057 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:51.412057 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:51.412119 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:51.412384 (+ 265us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:25:51.412385 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:25:51.412459 (+ 74us) client_negotiation.cc:769] Sending connection context
0810 15:25:51.412550 (+ 91us) client_negotiation.cc:240] Negotiation successful
0810 15:25:51.412661 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":163,"mutex_wait_us":22,"thread_start_us":99,"threads_started":1}
Aug 10 15:25:51 dist-test-slave-2p8l krb5kdc[29413](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375550, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.68.190@KRBTEST.COM for oryx/127.18.68.188@KRBTEST.COM
I20260810 15:25:51.438059 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 29614
I20260810 15:25:51.438459 30460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:51.414872 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.188:45629 (local address 127.0.0.1:59182)
0810 15:25:51.414926 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:51.414935 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:51.414970 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:51.415256 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:51.415257 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:51.415427 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:25:51.415469 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:51.415471 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:51.416147 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:51.416148 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:51.417010 (+ 862us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:51.417012 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:51.417649 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:51.417650 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:51.417725 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:51.418237 (+ 512us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:25:51.418243 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:25:51.419648 (+ 1405us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:25:51.436697 (+ 17049us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:51.436699 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:51.436699 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:51.436955 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:51.437204 (+ 249us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:51.437206 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:51.437206 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:51.437521 (+ 315us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:51.437973 (+ 452us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:25:51.437974 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:25:51.438050 (+ 76us) client_negotiation.cc:769] Sending connection context
0810 15:25:51.438146 (+ 96us) client_negotiation.cc:240] Negotiation successful
0810 15:25:51.438299 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39}
I20260810 15:25:51.443588 30796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:51.414934 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59182 (local address 127.18.68.188:45629)
0810 15:25:51.415116 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:51.415118 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:51.415126 (+ 8us) server_negotiation.cc:407] Connection header received
0810 15:25:51.415166 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:51.415166 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:51.415175 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:51.415230 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:51.415583 (+ 353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:51.416067 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:51.417124 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:51.417553 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:51.417651 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:51.419775 (+ 2124us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:51.419776 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:51.419777 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:51.419784 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:51.436586 (+ 16802us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:51.437044 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:51.437045 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:51.437046 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:51.437110 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:51.437618 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:51.437619 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:51.437620 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:51.437860 (+ 240us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:51.437936 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:51.443406 (+ 5470us) server_negotiation.cc:299] Negotiation successful
0810 15:25:51.443497 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":162,"thread_start_us":137,"threads_started":1}
I20260810 15:25:51.449497 29495 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.18.68.188:45629: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "79b8b9b8839e47be8dd75bfe3818b5cd"
member_type: NON_VOTER
last_known_addr {
host: "127.18.68.188"
port: 45629
}
attrs {
promote: true
}
}
dest_uuid: "dc69d8e9c6814168941f833a163493a1"
cas_config_opid_index: 5
I20260810 15:25:51.449903 29495 consensus_queue.cc:237] T 00000000000000000000000000000000 P dc69d8e9c6814168941f833a163493a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "dc69d8e9c6814168941f833a163493a1" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46363 } } peers { permanent_uuid: "368b444be95f4679b16a674be8ad8be1" member_type: NON_VOTER last_known_addr { host: "127.18.68.189" port: 38325 } attrs { promote: true } } peers { permanent_uuid: "79b8b9b8839e47be8dd75bfe3818b5cd" member_type: NON_VOTER last_known_addr { host: "127.18.68.188" port: 45629 } attrs { promote: true } }
I20260810 15:25:51.450616 30462 raft_consensus.cc:2932] T 00000000000000000000000000000000 P dc69d8e9c6814168941f833a163493a1 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 79b8b9b8839e47be8dd75bfe3818b5cd (127.18.68.188) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "dc69d8e9c6814168941f833a163493a1" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46363 } } peers { permanent_uuid: "368b444be95f4679b16a674be8ad8be1" member_type: NON_VOTER last_known_addr { host: "127.18.68.189" port: 38325 } attrs { promote: true } } peers { permanent_uuid: "79b8b9b8839e47be8dd75bfe3818b5cd" member_type: NON_VOTER last_known_addr { host: "127.18.68.188" port: 45629 } attrs { promote: true } } }
I20260810 15:25:51.451684 30462 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.18.68.188:45629
I20260810 15:25:51.451758 30462 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc69d8e9c6814168941f833a163493a1 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "dc69d8e9c6814168941f833a163493a1" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "dc69d8e9c6814168941f833a163493a1" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46363 } } peers { permanent_uuid: "368b444be95f4679b16a674be8ad8be1" member_type: NON_VOTER last_known_addr { host: "127.18.68.189" port: 38325 } attrs { promote: true } } peers { permanent_uuid: "79b8b9b8839e47be8dd75bfe3818b5cd" member_type: NON_VOTER last_known_addr { host: "127.18.68.188" port: 45629 } attrs { promote: true } } }
I20260810 15:25:51.451818 30462 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc69d8e9c6814168941f833a163493a1 [sys.catalog]: This master's current role is: LEADER
I20260810 15:25:51.452061 30623 master.cc:537] Master@127.18.68.188:45629 shutting down...
I20260810 15:25:51.489470 30709 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 79b8b9b8839e47be8dd75bfe3818b5cd [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:25:51.490617 30795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:51.406236 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.188:45629 (local address 127.0.0.1:59168)
0810 15:25:51.406656 (+ 420us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:51.406665 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:51.406744 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:51.406908 (+ 164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:51.406909 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:51.407155 (+ 246us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:25:51.407226 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:51.407228 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:51.408146 (+ 918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:51.408147 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:51.408966 (+ 819us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:51.408968 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:51.409426 (+ 458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:51.409427 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:51.409506 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:51.434871 (+ 25365us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:25:51.434877 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:25:51.435568 (+ 691us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:25:51.489086 (+ 53518us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:51.489087 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:51.489088 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:51.489426 (+ 338us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:51.489814 (+ 388us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:51.489815 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:51.489815 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:51.489890 (+ 75us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:51.490217 (+ 327us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:25:51.490218 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:25:51.490273 (+ 55us) client_negotiation.cc:769] Sending connection context
0810 15:25:51.490342 (+ 69us) client_negotiation.cc:240] Negotiation successful
0810 15:25:51.490471 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":401,"thread_start_us":86,"threads_started":1}
I20260810 15:25:51.490953 30760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:51.406237 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59168 (local address 127.18.68.188:45629)
0810 15:25:51.406279 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:51.406281 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:51.406732 (+ 451us) server_negotiation.cc:407] Connection header received
0810 15:25:51.406796 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:51.406797 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:51.406806 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:51.406860 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:51.407312 (+ 452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:51.408044 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:51.409069 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:51.409295 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:51.409388 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:51.435975 (+ 26587us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:51.435976 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:51.435977 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:51.435984 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:51.488866 (+ 52882us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:51.489523 (+ 657us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:51.489525 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:51.489525 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:51.489584 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:51.489970 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:51.489971 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:51.489971 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:51.490119 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:51.490193 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:51.490748 (+ 555us) server_negotiation.cc:299] Negotiation successful
0810 15:25:51.490840 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260810 15:25:51.491010 30709 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 79b8b9b8839e47be8dd75bfe3818b5cd [term 1 FOLLOWER]: Refusing update from remote peer dc69d8e9c6814168941f833a163493a1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260810 15:25:51.491384 30463 consensus_queue.cc:1035] T 00000000000000000000000000000000 P dc69d8e9c6814168941f833a163493a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b8b9b8839e47be8dd75bfe3818b5cd" member_type: NON_VOTER last_known_addr { host: "127.18.68.188" port: 45629 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 15:25:51.492252 29465 consensus_peers.cc:487] T 00000000000000000000000000000000 P dc69d8e9c6814168941f833a163493a1 -> Peer 79b8b9b8839e47be8dd75bfe3818b5cd (127.18.68.188:45629): Couldn't send request to peer 79b8b9b8839e47be8dd75bfe3818b5cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260810 15:25:51.493425 30597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:51.406508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57232 (local address 127.18.68.189:38325)
0810 15:25:51.406559 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:51.406561 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:51.410234 (+ 3673us) server_negotiation.cc:407] Connection header received
0810 15:25:51.410326 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:51.410328 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:51.410342 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:51.410400 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:51.410787 (+ 387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:51.411513 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:51.413534 (+ 2021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:51.413827 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:51.413870 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:51.435769 (+ 21899us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:51.435772 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:51.435772 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:51.435782 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:51.437872 (+ 2090us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:51.492532 (+ 54660us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:51.492533 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:51.492534 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:51.492608 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:51.492816 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:51.492817 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:51.492817 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:51.492951 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:51.493010 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:51.493231 (+ 221us) server_negotiation.cc:299] Negotiation successful
0810 15:25:51.493327 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260810 15:25:51.493773 30793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:51.406464 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.189:38325 (local address 127.0.0.1:57232)
0810 15:25:51.410161 (+ 3697us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:51.410173 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:51.410263 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:51.410401 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:51.410401 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:51.410645 (+ 244us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:25:51.410686 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:51.410688 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:51.411625 (+ 937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:51.411626 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:51.413431 (+ 1805us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:51.413434 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:51.413951 (+ 517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:51.413952 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:51.414014 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:51.434809 (+ 20795us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:25:51.434816 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:25:51.435566 (+ 750us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:25:51.491092 (+ 55526us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:51.491092 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:51.491093 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:51.492434 (+ 1341us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:51.492684 (+ 250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:51.492685 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:51.492686 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:51.492746 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:51.493048 (+ 302us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:25:51.493048 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:25:51.493095 (+ 47us) client_negotiation.cc:769] Sending connection context
0810 15:25:51.493548 (+ 453us) client_negotiation.cc:240] Negotiation successful
0810 15:25:51.493671 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3679,"mutex_wait_us":2,"thread_start_us":73,"threads_started":1}
I20260810 15:25:51.495595 30460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:51.452786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.189:38325 (local address 127.0.0.1:57234)
0810 15:25:51.461204 (+ 8418us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:51.461223 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:51.461300 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:51.491758 (+ 30458us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:51.491760 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:51.491764 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:25:51.491823 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:51.491825 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:51.492912 (+ 1087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:51.492914 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:51.494289 (+ 1375us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:51.494295 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:51.495280 (+ 985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:51.495281 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:51.495355 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:51.495388 (+ 33us) client_negotiation.cc:769] Sending connection context
0810 15:25:51.495427 (+ 39us) client_negotiation.cc:240] Negotiation successful
0810 15:25:51.495482 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8386}
I20260810 15:25:51.495735 30623 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 79b8b9b8839e47be8dd75bfe3818b5cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 15:25:51.495837 30623 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 79b8b9b8839e47be8dd75bfe3818b5cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 15:25:51.495895 30623 tablet_replica.cc:330] T 00000000000000000000000000000000 P 79b8b9b8839e47be8dd75bfe3818b5cd: stopping tablet replica
I20260810 15:25:51.495999 30797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:51.489695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57234 (local address 127.18.68.189:38325)
0810 15:25:51.491520 (+ 1825us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:51.491523 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:51.491534 (+ 11us) server_negotiation.cc:407] Connection header received
0810 15:25:51.491563 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:51.491564 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:51.491593 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:51.491904 (+ 311us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:25:51.491950 (+ 46us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:51.492804 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:51.494443 (+ 1639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:51.495165 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:51.495744 (+ 579us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:51.495846 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:51.495870 (+ 24us) server_negotiation.cc:299] Negotiation successful
0810 15:25:51.495921 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1798,"thread_start_us":76,"threads_started":1}
I20260810 15:25:51.496243 30553 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 368b444be95f4679b16a674be8ad8be1 [term 1 LEARNER]: Refusing update from remote peer dc69d8e9c6814168941f833a163493a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260810 15:25:51.496512 30463 consensus_queue.cc:1035] T 00000000000000000000000000000000 P dc69d8e9c6814168941f833a163493a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "368b444be95f4679b16a674be8ad8be1" member_type: NON_VOTER last_known_addr { host: "127.18.68.189" port: 38325 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260810 15:25:51.497285 30553 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 368b444be95f4679b16a674be8ad8be1 [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 79b8b9b8839e47be8dd75bfe3818b5cd (127.18.68.188) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "dc69d8e9c6814168941f833a163493a1" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46363 } } peers { permanent_uuid: "368b444be95f4679b16a674be8ad8be1" member_type: NON_VOTER last_known_addr { host: "127.18.68.189" port: 38325 } attrs { promote: true } } peers { permanent_uuid: "79b8b9b8839e47be8dd75bfe3818b5cd" member_type: NON_VOTER last_known_addr { host: "127.18.68.188" port: 45629 } attrs { promote: true } } }
I20260810 15:25:51.498734 30799 sys_catalog.cc:455] T 00000000000000000000000000000000 P 368b444be95f4679b16a674be8ad8be1 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "dc69d8e9c6814168941f833a163493a1" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "dc69d8e9c6814168941f833a163493a1" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46363 } } peers { permanent_uuid: "368b444be95f4679b16a674be8ad8be1" member_type: NON_VOTER last_known_addr { host: "127.18.68.189" port: 38325 } attrs { promote: true } } peers { permanent_uuid: "79b8b9b8839e47be8dd75bfe3818b5cd" member_type: NON_VOTER last_known_addr { host: "127.18.68.188" port: 45629 } attrs { promote: true } } }
I20260810 15:25:51.498916 30799 sys_catalog.cc:458] T 00000000000000000000000000000000 P 368b444be95f4679b16a674be8ad8be1 [sys.catalog]: This master's current role is: LEARNER
I20260810 15:25:51.498996 30601 sys_catalog.cc:455] T 00000000000000000000000000000000 P 368b444be95f4679b16a674be8ad8be1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dc69d8e9c6814168941f833a163493a1. Latest consensus state: current_term: 1 leader_uuid: "dc69d8e9c6814168941f833a163493a1" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "dc69d8e9c6814168941f833a163493a1" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46363 } } peers { permanent_uuid: "368b444be95f4679b16a674be8ad8be1" member_type: NON_VOTER last_known_addr { host: "127.18.68.189" port: 38325 } attrs { promote: true } } peers { permanent_uuid: "79b8b9b8839e47be8dd75bfe3818b5cd" member_type: NON_VOTER last_known_addr { host: "127.18.68.188" port: 45629 } attrs { promote: true } } }
I20260810 15:25:51.499028 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.68.129:38595
--local_ip_for_outbound_sockets=127.18.68.129
--tserver_master_addrs=127.18.68.190:46363
--webserver_port=45181
--webserver_interface=127.18.68.129
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/krb5kdc/oryx_127.18.68.129.keytab
--principal=oryx/127.18.68.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:33723
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.18.68.190:46363,127.18.68.189:38325
--tserver_master_addrs=127.18.68.190:46363,127.18.68.189:38325,127.18.68.188:45629 with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 15:25:51.499073 30601 sys_catalog.cc:458] T 00000000000000000000000000000000 P 368b444be95f4679b16a674be8ad8be1 [sys.catalog]: This master's current role is: LEARNER
I20260810 15:25:51.499643 30463 raft_consensus.cc:1050] T 00000000000000000000000000000000 P dc69d8e9c6814168941f833a163493a1: attempting to promote NON_VOTER 368b444be95f4679b16a674be8ad8be1 to VOTER
I20260810 15:25:51.499908 30463 consensus_queue.cc:237] T 00000000000000000000000000000000 P dc69d8e9c6814168941f833a163493a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "dc69d8e9c6814168941f833a163493a1" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46363 } } peers { permanent_uuid: "368b444be95f4679b16a674be8ad8be1" member_type: VOTER last_known_addr { host: "127.18.68.189" port: 38325 } attrs { promote: false } } peers { permanent_uuid: "79b8b9b8839e47be8dd75bfe3818b5cd" member_type: NON_VOTER last_known_addr { host: "127.18.68.188" port: 45629 } attrs { promote: true } }
I20260810 15:25:51.500483 30460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:51.500351 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.188:45629 (local address 127.0.0.1:59186)
0810 15:25:51.500398 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:51.500447 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.188:45629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260810 15:25:51.500516 30553 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 368b444be95f4679b16a674be8ad8be1 [term 1 LEARNER]: Refusing update from remote peer dc69d8e9c6814168941f833a163493a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260810 15:25:51.500829 30462 consensus_queue.cc:1035] T 00000000000000000000000000000000 P dc69d8e9c6814168941f833a163493a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "368b444be95f4679b16a674be8ad8be1" member_type: VOTER last_known_addr { host: "127.18.68.189" port: 38325 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260810 15:25:51.500880 30460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:51.500751 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.188:45629 (local address 127.0.0.1:59194)
0810 15:25:51.500833 (+ 82us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:51.500859 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.188:45629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
W20260810 15:25:51.500963 29465 consensus_peers.cc:487] T 00000000000000000000000000000000 P dc69d8e9c6814168941f833a163493a1 -> Peer 79b8b9b8839e47be8dd75bfe3818b5cd (127.18.68.188:45629): Couldn't send request to peer 79b8b9b8839e47be8dd75bfe3818b5cd. Status: Network error: Client connection negotiation failed: client connection to 127.18.68.188:45629: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260810 15:25:51.501581 30461 raft_consensus.cc:2932] T 00000000000000000000000000000000 P dc69d8e9c6814168941f833a163493a1 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 368b444be95f4679b16a674be8ad8be1 (127.18.68.189) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "dc69d8e9c6814168941f833a163493a1" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46363 } } peers { permanent_uuid: "368b444be95f4679b16a674be8ad8be1" member_type: VOTER last_known_addr { host: "127.18.68.189" port: 38325 } attrs { promote: false } } peers { permanent_uuid: "79b8b9b8839e47be8dd75bfe3818b5cd" member_type: NON_VOTER last_known_addr { host: "127.18.68.188" port: 45629 } attrs { promote: true } } }
I20260810 15:25:51.501765 30553 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 368b444be95f4679b16a674be8ad8be1 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 368b444be95f4679b16a674be8ad8be1 (127.18.68.189) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "dc69d8e9c6814168941f833a163493a1" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46363 } } peers { permanent_uuid: "368b444be95f4679b16a674be8ad8be1" member_type: VOTER last_known_addr { host: "127.18.68.189" port: 38325 } attrs { promote: false } } peers { permanent_uuid: "79b8b9b8839e47be8dd75bfe3818b5cd" member_type: NON_VOTER last_known_addr { host: "127.18.68.188" port: 45629 } attrs { promote: true } } }
I20260810 15:25:51.502844 30461 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc69d8e9c6814168941f833a163493a1 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "dc69d8e9c6814168941f833a163493a1" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "dc69d8e9c6814168941f833a163493a1" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46363 } } peers { permanent_uuid: "368b444be95f4679b16a674be8ad8be1" member_type: VOTER last_known_addr { host: "127.18.68.189" port: 38325 } attrs { promote: false } } peers { permanent_uuid: "79b8b9b8839e47be8dd75bfe3818b5cd" member_type: NON_VOTER last_known_addr { host: "127.18.68.188" port: 45629 } attrs { promote: true } } }
I20260810 15:25:51.502833 30601 sys_catalog.cc:455] T 00000000000000000000000000000000 P 368b444be95f4679b16a674be8ad8be1 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "dc69d8e9c6814168941f833a163493a1" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "dc69d8e9c6814168941f833a163493a1" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46363 } } peers { permanent_uuid: "368b444be95f4679b16a674be8ad8be1" member_type: VOTER last_known_addr { host: "127.18.68.189" port: 38325 } attrs { promote: false } } peers { permanent_uuid: "79b8b9b8839e47be8dd75bfe3818b5cd" member_type: NON_VOTER last_known_addr { host: "127.18.68.188" port: 45629 } attrs { promote: true } } }
I20260810 15:25:51.502915 30601 sys_catalog.cc:458] T 00000000000000000000000000000000 P 368b444be95f4679b16a674be8ad8be1 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 15:25:51.502915 30461 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc69d8e9c6814168941f833a163493a1 [sys.catalog]: This master's current role is: LEADER
I20260810 15:25:51.502983 30461 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc69d8e9c6814168941f833a163493a1 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "dc69d8e9c6814168941f833a163493a1" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "dc69d8e9c6814168941f833a163493a1" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46363 } } peers { permanent_uuid: "368b444be95f4679b16a674be8ad8be1" member_type: VOTER last_known_addr { host: "127.18.68.189" port: 38325 } attrs { promote: false } } peers { permanent_uuid: "79b8b9b8839e47be8dd75bfe3818b5cd" member_type: NON_VOTER last_known_addr { host: "127.18.68.188" port: 45629 } attrs { promote: true } } }
I20260810 15:25:51.503049 30461 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc69d8e9c6814168941f833a163493a1 [sys.catalog]: This master's current role is: LEADER
I20260810 15:25:51.503322 30793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:51.502109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.188:45629 (local address 127.0.0.1:59208)
0810 15:25:51.503208 (+ 1099us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:51.503252 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.188:45629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1037}
I20260810 15:25:51.509657 30623 master.cc:552] Master@127.18.68.188:45629 shutdown complete.
I20260810 15:25:51.509734 30623 master_runner.cc:305] Clearing existing system tablet
I20260810 15:25:51.509879 30623 fs_manager.cc:359] Metadata directory not provided
I20260810 15:25:51.509941 30623 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:25:51.510715 30623 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:51.511270 30804 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:51.511461 30623 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:25:51.511523 30623 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260810 15:25:51.511556 30623 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/master-2/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/master-2/wal
uuid: "79b8b9b8839e47be8dd75bfe3818b5cd"
format_stamp: "Formatted at 2026-08-10 15:25:51 on dist-test-slave-2p8l"
server_key: "647ee97f01f03928172579344b5339a3"
server_key_iv: "9f6e10a0254fd052bd65b21851e09b2a"
server_key_version: "encryptionkey@0"
I20260810 15:25:51.512300 30623 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 79b8b9b8839e47be8dd75bfe3818b5cd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 15:25:51.513723 30623 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 79b8b9b8839e47be8dd75bfe3818b5cd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260810 15:25:51.513813 30623 log.cc:1196] T 00000000000000000000000000000000 P 79b8b9b8839e47be8dd75bfe3818b5cd: Deleting WAL directory at /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260810 15:25:51.514132 30623 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 79b8b9b8839e47be8dd75bfe3818b5cd: Deleting consensus metadata
I20260810 15:25:51.514272 30623 master_runner.cc:315] Copying system tablet from 127.18.68.190:46363
I20260810 15:25:51.515128 30623 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 79b8b9b8839e47be8dd75bfe3818b5cd: tablet copy: Beginning tablet copy session from remote peer at address 127.18.68.190:46363
I20260810 15:25:51.521973 30818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:51.515486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46363 (local address 127.0.0.1:39516)
0810 15:25:51.515675 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:51.515686 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:51.515759 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:51.515879 (+ 120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:51.515880 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:51.516087 (+ 207us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:25:51.516142 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:51.516144 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:51.516964 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:51.516965 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:51.517556 (+ 591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:51.517558 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:51.517974 (+ 416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:51.517975 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:51.518049 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:51.518636 (+ 587us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:25:51.518641 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:25:51.518970 (+ 329us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:25:51.520781 (+ 1811us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:51.520783 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:51.520784 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:51.520977 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:51.521216 (+ 239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:51.521217 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:51.521217 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:51.521286 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:51.521568 (+ 282us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:25:51.521569 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:25:51.521667 (+ 98us) client_negotiation.cc:769] Sending connection context
0810 15:25:51.521759 (+ 92us) client_negotiation.cc:240] Negotiation successful
0810 15:25:51.521875 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":75,"threads_started":1}
I20260810 15:25:51.521972 29574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:51.515545 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39516 (local address 127.18.68.190:46363)
0810 15:25:51.515598 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:51.515600 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:51.515759 (+ 159us) server_negotiation.cc:407] Connection header received
0810 15:25:51.515812 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:51.515814 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:51.515825 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:51.515876 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:51.516233 (+ 357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:51.516874 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:51.517673 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:51.517891 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:51.517975 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:51.519089 (+ 1114us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:51.519090 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:51.519091 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:51.519099 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:51.520684 (+ 1585us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:51.521066 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:51.521068 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:51.521069 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:51.521140 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:51.521375 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:51.521376 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:51.521377 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:51.521497 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:51.521578 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:51.521786 (+ 208us) server_negotiation.cc:299] Negotiation successful
0810 15:25:51.521874 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260810 15:25:51.522683 29532 tablet_copy_service.cc:140] P dc69d8e9c6814168941f833a163493a1: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 79b8b9b8839e47be8dd75bfe3818b5cd ({username='oryx', principal='oryx/127.18.68.188@KRBTEST.COM'} at 127.0.0.1:39516)
I20260810 15:25:51.522760 29532 tablet_copy_service.cc:161] P dc69d8e9c6814168941f833a163493a1: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 79b8b9b8839e47be8dd75bfe3818b5cd at {username='oryx', principal='oryx/127.18.68.188@KRBTEST.COM'} at 127.0.0.1:39516: session id = 79b8b9b8839e47be8dd75bfe3818b5cd-00000000000000000000000000000000
I20260810 15:25:51.523368 29532 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P dc69d8e9c6814168941f833a163493a1: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 15:25:51.523900 30623 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260810 15:25:51.524979 30623 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 79b8b9b8839e47be8dd75bfe3818b5cd: tablet copy: Starting download of 0 data blocks...
I20260810 15:25:51.525228 30623 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 79b8b9b8839e47be8dd75bfe3818b5cd: tablet copy: Starting download of 1 WAL segments...
I20260810 15:25:51.525959 30623 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 79b8b9b8839e47be8dd75bfe3818b5cd: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 15:25:51.526783 29532 tablet_copy_service.cc:342] P dc69d8e9c6814168941f833a163493a1: Request end of tablet copy session 79b8b9b8839e47be8dd75bfe3818b5cd-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.18.68.188@KRBTEST.COM'} at 127.0.0.1:39516
I20260810 15:25:51.526861 29532 tablet_copy_service.cc:433] P dc69d8e9c6814168941f833a163493a1: ending tablet copy session 79b8b9b8839e47be8dd75bfe3818b5cd-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 79b8b9b8839e47be8dd75bfe3818b5cd
I20260810 15:25:51.529352 30623 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:25:51.530550 30831 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:51.530555 30819 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:25:51.530887 30623 server_base.cc:1034] running on GCE node
W20260810 15:25:51.535001 30823 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:25:51.535184 30623 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:25:51.535387 30623 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:25:51.536525 30623 hybrid_clock.cc:648] HybridClock initialized: now 1786375551536512 us; error 33 us; skew 500 ppm
Aug 10 15:25:51 dist-test-slave-2p8l krb5kdc[29413](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375551, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.68.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:25:51.538235 30623 init.cc:377] Logged in from keytab as oryx/127.18.68.188@KRBTEST.COM (short username oryx)
I20260810 15:25:51.538602 30623 webserver.cc:460] Webserver started at http://127.18.68.188:35359/ using document root <none> and password file <none>
I20260810 15:25:51.538740 30623 fs_manager.cc:359] Metadata directory not provided
I20260810 15:25:51.538798 30623 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:25:51.539510 30623 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.001s sys 0.000s
I20260810 15:25:51.540145 30848 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:51.540304 30623 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 15:25:51.540352 30623 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/master-2/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/master-2/wal
uuid: "79b8b9b8839e47be8dd75bfe3818b5cd"
format_stamp: "Formatted at 2026-08-10 15:25:51 on dist-test-slave-2p8l"
server_key: "647ee97f01f03928172579344b5339a3"
server_key_iv: "9f6e10a0254fd052bd65b21851e09b2a"
server_key_version: "encryptionkey@0"
I20260810 15:25:51.540421 30623 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:25:51.559764 30623 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:25:51.561650 30623 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:25:51.565094 30623 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.188:45629
I20260810 15:25:51.565500 30623 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/master-2/data/info.pb
I20260810 15:25:51.566185 30938 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.188:45629 every 8 connection(s)
I20260810 15:25:51.566525 30939 sys_catalog.cc:263] Verifying existing consensus state
I20260810 15:25:51.566931 30939 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 79b8b9b8839e47be8dd75bfe3818b5cd: Bootstrap starting.
I20260810 15:25:51.569360 30939 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 79b8b9b8839e47be8dd75bfe3818b5cd: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 15:25:51.569622 30939 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 79b8b9b8839e47be8dd75bfe3818b5cd: Bootstrap complete.
I20260810 15:25:51.569849 30939 raft_consensus.cc:348] T 00000000000000000000000000000000 P 79b8b9b8839e47be8dd75bfe3818b5cd [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "dc69d8e9c6814168941f833a163493a1" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46363 } } peers { permanent_uuid: "368b444be95f4679b16a674be8ad8be1" member_type: VOTER last_known_addr { host: "127.18.68.189" port: 38325 } attrs { promote: false } } peers { permanent_uuid: "79b8b9b8839e47be8dd75bfe3818b5cd" member_type: NON_VOTER last_known_addr { host: "127.18.68.188" port: 45629 } attrs { promote: true } }
I20260810 15:25:51.569939 30939 raft_consensus.cc:729] T 00000000000000000000000000000000 P 79b8b9b8839e47be8dd75bfe3818b5cd [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 79b8b9b8839e47be8dd75bfe3818b5cd, State: Initialized, Role: LEARNER
I20260810 15:25:51.569988 30939 consensus_queue.cc:260] T 00000000000000000000000000000000 P 79b8b9b8839e47be8dd75bfe3818b5cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "dc69d8e9c6814168941f833a163493a1" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46363 } } peers { permanent_uuid: "368b444be95f4679b16a674be8ad8be1" member_type: VOTER last_known_addr { host: "127.18.68.189" port: 38325 } attrs { promote: false } } peers { permanent_uuid: "79b8b9b8839e47be8dd75bfe3818b5cd" member_type: NON_VOTER last_known_addr { host: "127.18.68.188" port: 45629 } attrs { promote: true } }
I20260810 15:25:51.570207 30939 sys_catalog.cc:564] T 00000000000000000000000000000000 P 79b8b9b8839e47be8dd75bfe3818b5cd [sys.catalog]: configured and running, proceeding with master startup.
I20260810 15:25:51.570201 30945 sys_catalog.cc:455] T 00000000000000000000000000000000 P 79b8b9b8839e47be8dd75bfe3818b5cd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "dc69d8e9c6814168941f833a163493a1" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46363 } } peers { permanent_uuid: "368b444be95f4679b16a674be8ad8be1" member_type: VOTER last_known_addr { host: "127.18.68.189" port: 38325 } attrs { promote: false } } peers { permanent_uuid: "79b8b9b8839e47be8dd75bfe3818b5cd" member_type: NON_VOTER last_known_addr { host: "127.18.68.188" port: 45629 } attrs { promote: true } } }
I20260810 15:25:51.570431 30945 sys_catalog.cc:458] T 00000000000000000000000000000000 P 79b8b9b8839e47be8dd75bfe3818b5cd [sys.catalog]: This master's current role is: LEARNER
I20260810 15:25:51.571792 30965 catalog_manager.cc:1259] Loaded cluster ID: 282c713ec3e04fc6b63b8a8f3178953f
I20260810 15:25:51.571884 30965 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 79b8b9b8839e47be8dd75bfe3818b5cd: loading cluster ID for follower catalog manager: success
I20260810 15:25:51.573024 30965 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 79b8b9b8839e47be8dd75bfe3818b5cd: acquiring CA information for follower catalog manager: success
I20260810 15:25:51.573328 30965 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 79b8b9b8839e47be8dd75bfe3818b5cd: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260810 15:25:51.622049 30800 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:25:51.622437 30800 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:25:51.622481 30800 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:25:51.624244 30800 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:25:51.624316 30800 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:25:51.624357 30800 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.68.129
I20260810 15:25:51.626681 30800 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:33723
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/krb5kdc/oryx_127.18.68.129.keytab
--principal=oryx/127.18.68.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.68.129:38595
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.68.129
--webserver_port=45181
--tserver_master_addrs=127.18.68.190:46363,127.18.68.189:38325,127.18.68.188:45629
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30800
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.68.129
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:25:51.626983 30800 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:25:51.627250 30800 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:25:51.632908 30971 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:51.632961 30973 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:51.632925 30976 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:25:51.633239 30800 server_base.cc:1034] running on GCE node
I20260810 15:25:51.633468 30800 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:25:51.633762 30800 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:25:51.634927 30800 hybrid_clock.cc:648] HybridClock initialized: now 1786375551634908 us; error 39 us; skew 500 ppm
Aug 10 15:25:51 dist-test-slave-2p8l krb5kdc[29413](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375551, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.68.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:25:51.637593 30800 init.cc:377] Logged in from keytab as oryx/127.18.68.129@KRBTEST.COM (short username oryx)
I20260810 15:25:51.638160 30800 webserver.cc:460] Webserver started at http://127.18.68.129:45181/ using document root <none> and password file <none>
I20260810 15:25:51.638401 30800 fs_manager.cc:359] Metadata directory not provided
I20260810 15:25:51.638486 30800 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:25:51.640231 30800 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260810 15:25:51.640946 30985 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:51.641139 30800 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 15:25:51.641242 30800 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/ts-0/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/ts-0/wal
uuid: "aa343e60e15a4e3fb24f49dbb3aa37b3"
format_stamp: "Formatted at 2026-08-10 15:25:50 on dist-test-slave-2p8l"
server_key: "e6d66ee6c3eab93df0428ba740cd3513"
server_key_iv: "a6a96a645eaba18a071035a4c76566a9"
server_key_version: "encryptionkey@0"
I20260810 15:25:51.641620 30800 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:25:51.668121 30800 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:25:51.670861 30800 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:25:51.671036 30800 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:25:51.671307 30800 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 15:25:51.671716 30800 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 15:25:51.671772 30800 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:51.671816 30800 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 15:25:51.671844 30800 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:51.679106 30800 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.129:38595
I20260810 15:25:51.679201 31170 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.129:38595 every 8 connection(s)
I20260810 15:25:51.679659 30800 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/ts-0/data/info.pb
I20260810 15:25:51.686496 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 30800
I20260810 15:25:51.686698 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 29835
Aug 10 15:25:51 dist-test-slave-2p8l krb5kdc[29413](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375551, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.68.129@KRBTEST.COM for oryx/127.18.68.189@KRBTEST.COM
I20260810 15:25:51.703704 30797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:51.680994 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.129:59259 (local address 127.18.68.189:38325)
0810 15:25:51.681038 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:51.681040 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:51.681100 (+ 60us) server_negotiation.cc:407] Connection header received
0810 15:25:51.682095 (+ 995us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:51.682098 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:51.682112 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:51.682148 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:51.683136 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:51.683645 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:51.685119 (+ 1474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:51.685330 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:51.685420 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:51.699036 (+ 13616us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:51.699038 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:51.699038 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:51.699048 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:51.702109 (+ 3061us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:51.702617 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:51.702618 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:51.702619 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:51.702673 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:51.702936 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:51.702936 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:51.702936 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:51.703087 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:51.703125 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:51.703462 (+ 337us) server_negotiation.cc:299] Negotiation successful
0810 15:25:51.703557 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260810 15:25:51.704288 31182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:51.680929 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.189:38325 (local address 127.18.68.129:59259)
0810 15:25:51.681044 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:51.681054 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:51.681969 (+ 915us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:51.682249 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:51.682252 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:51.682824 (+ 572us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:25:51.683018 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:51.683024 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:51.683766 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:51.683767 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:51.685004 (+ 1237us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:51.685005 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:51.685435 (+ 430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:51.685436 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:51.685580 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:51.696943 (+ 11363us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:25:51.696951 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:25:51.698898 (+ 1947us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:25:51.702213 (+ 3315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:51.702224 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:51.702227 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:51.702540 (+ 313us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:51.702749 (+ 209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:51.702750 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:51.702750 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:51.702876 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:51.703164 (+ 288us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:25:51.703168 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:25:51.703333 (+ 165us) client_negotiation.cc:769] Sending connection context
0810 15:25:51.703831 (+ 498us) client_negotiation.cc:240] Negotiation successful
0810 15:25:51.704031 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":97,"mutex_wait_us":73,"thread_start_us":70,"threads_started":1}
I20260810 15:25:51.704730 31175 heartbeater.cc:347] Connected to a master server at 127.18.68.189:38325
I20260810 15:25:51.704815 31175 heartbeater.cc:464] Registering TS with master...
I20260810 15:25:51.704998 31175 heartbeater.cc:511] Master 127.18.68.189:38325 requested a full tablet report, sending...
I20260810 15:25:51.705456 30535 ts_manager.cc:194] Registered new tserver with Master: aa343e60e15a4e3fb24f49dbb3aa37b3 (127.18.68.129:38595)
Aug 10 15:25:51 dist-test-slave-2p8l krb5kdc[29413](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375551, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.68.129@KRBTEST.COM for oryx/127.18.68.188@KRBTEST.COM
Aug 10 15:25:51 dist-test-slave-2p8l krb5kdc[29413](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375551, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.68.129@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM
I20260810 15:25:51.714329 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.68.130:45317
--local_ip_for_outbound_sockets=127.18.68.130
--tserver_master_addrs=127.18.68.190:46363
--webserver_port=39567
--webserver_interface=127.18.68.130
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/krb5kdc/oryx_127.18.68.130.keytab
--principal=oryx/127.18.68.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:33723
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.18.68.190:46363,127.18.68.189:38325
--tserver_master_addrs=127.18.68.190:46363,127.18.68.189:38325,127.18.68.188:45629 with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 15:25:51.714936 31177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:51.680477 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.129:58775 (local address 127.18.68.188:45629)
0810 15:25:51.680635 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:51.680637 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:51.680875 (+ 238us) server_negotiation.cc:407] Connection header received
0810 15:25:51.682115 (+ 1240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:51.682116 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:51.682130 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:51.682177 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:51.683133 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:51.683878 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:51.685079 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:51.685386 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:51.685447 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:51.711541 (+ 26094us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:51.711543 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:51.711543 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:51.711552 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:51.713535 (+ 1983us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:51.713974 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:51.713975 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:51.713976 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:51.714036 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:51.714298 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:51.714299 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:51.714299 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:51.714473 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:51.714538 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:51.714753 (+ 215us) server_negotiation.cc:299] Negotiation successful
0810 15:25:51.714843 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":58,"threads_started":1}
I20260810 15:25:51.715117 31178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:51.680487 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.188:45629 (local address 127.18.68.129:58775)
0810 15:25:51.680725 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:51.680809 (+ 84us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:51.681937 (+ 1128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:51.682256 (+ 319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:51.682257 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:51.682817 (+ 560us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:25:51.683018 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:51.683024 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:51.683975 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:51.683975 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:51.685001 (+ 1026us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:51.685004 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:51.685494 (+ 490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:51.685495 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:51.685583 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:51.686439 (+ 856us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:25:51.686444 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:25:51.710884 (+ 24440us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:25:51.713652 (+ 2768us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:51.713654 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:51.713654 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:51.713902 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:51.714154 (+ 252us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:51.714155 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:51.714156 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:51.714229 (+ 73us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:51.714567 (+ 338us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:25:51.714568 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:25:51.714623 (+ 55us) client_negotiation.cc:769] Sending connection context
0810 15:25:51.714705 (+ 82us) client_negotiation.cc:240] Negotiation successful
0810 15:25:51.714827 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":190,"mutex_wait_us":12,"thread_start_us":189,"threads_started":1}
I20260810 15:25:51.715169 29574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:51.680479 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.129:49849 (local address 127.18.68.190:46363)
0810 15:25:51.680539 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:51.680541 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:51.680896 (+ 355us) server_negotiation.cc:407] Connection header received
0810 15:25:51.682106 (+ 1210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:51.682107 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:51.682121 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:51.682165 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:51.683745 (+ 1580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:51.684197 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:51.685030 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:51.685327 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:51.685394 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:51.712159 (+ 26765us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:51.712161 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:51.712162 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:51.712171 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:51.713841 (+ 1670us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:51.714237 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:51.714238 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:51.714238 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:51.714295 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:51.714510 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:51.714512 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:51.714513 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:51.714663 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:51.714716 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:51.714921 (+ 205us) server_negotiation.cc:299] Negotiation successful
0810 15:25:51.715016 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260810 15:25:51.715547 31181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:51.680487 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46363 (local address 127.18.68.129:49849)
0810 15:25:51.680728 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:51.680775 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:51.681943 (+ 1168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:51.682247 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:51.682251 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:51.682798 (+ 547us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:25:51.683018 (+ 220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:51.683023 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:51.684292 (+ 1269us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:51.684292 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:51.684932 (+ 640us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:51.684934 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:51.685459 (+ 525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:51.685460 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:51.685583 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:51.686361 (+ 778us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:25:51.686387 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:25:51.711968 (+ 25581us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:25:51.713922 (+ 1954us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:51.713923 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:51.713924 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:51.714178 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:51.714351 (+ 173us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:51.714352 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:51.714352 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:51.714410 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:51.714753 (+ 343us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:25:51.714753 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:25:51.714802 (+ 49us) client_negotiation.cc:769] Sending connection context
0810 15:25:51.715255 (+ 453us) client_negotiation.cc:240] Negotiation successful
0810 15:25:51.715384 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":209,"mutex_wait_us":4,"thread_start_us":121,"threads_started":1}
I20260810 15:25:51.716406 31174 heartbeater.cc:347] Connected to a master server at 127.18.68.190:46363
I20260810 15:25:51.716423 31173 heartbeater.cc:347] Connected to a master server at 127.18.68.188:45629
I20260810 15:25:51.716477 31174 heartbeater.cc:464] Registering TS with master...
I20260810 15:25:51.716477 31173 heartbeater.cc:464] Registering TS with master...
I20260810 15:25:51.716583 31174 heartbeater.cc:511] Master 127.18.68.190:46363 requested a full tablet report, sending...
I20260810 15:25:51.716650 31173 heartbeater.cc:511] Master 127.18.68.188:45629 requested a full tablet report, sending...
I20260810 15:25:51.716928 29495 ts_manager.cc:194] Re-registered known tserver with Master: aa343e60e15a4e3fb24f49dbb3aa37b3 (127.18.68.129:38595)
I20260810 15:25:51.717087 30876 ts_manager.cc:194] Registered new tserver with Master: aa343e60e15a4e3fb24f49dbb3aa37b3 (127.18.68.129:38595)
I20260810 15:25:51.717376 29495 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.18.68.129@KRBTEST.COM'} at 127.18.68.129:49849
W20260810 15:25:51.799115 31183 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:25:51.799476 31183 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:25:51.799518 31183 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:25:51.801019 31183 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:25:51.801062 31183 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:25:51.801093 31183 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.68.130
I20260810 15:25:51.802772 31183 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:33723
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/krb5kdc/oryx_127.18.68.130.keytab
--principal=oryx/127.18.68.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.68.130:45317
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.68.130
--webserver_port=39567
--tserver_master_addrs=127.18.68.190:46363,127.18.68.189:38325,127.18.68.188:45629
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31183
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.68.130
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:25:51.803037 31183 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:25:51.803289 31183 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:25:51.808529 31190 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:51.808521 31191 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:51.808521 31194 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:25:51.808844 31183 server_base.cc:1034] running on GCE node
I20260810 15:25:51.809069 31183 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:25:51.809317 31183 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:25:51.810475 31183 hybrid_clock.cc:648] HybridClock initialized: now 1786375551810447 us; error 41 us; skew 500 ppm
Aug 10 15:25:51 dist-test-slave-2p8l krb5kdc[29413](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375551, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.68.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:25:51.813019 31183 init.cc:377] Logged in from keytab as oryx/127.18.68.130@KRBTEST.COM (short username oryx)
I20260810 15:25:51.813416 31183 webserver.cc:460] Webserver started at http://127.18.68.130:39567/ using document root <none> and password file <none>
I20260810 15:25:51.813606 31183 fs_manager.cc:359] Metadata directory not provided
I20260810 15:25:51.813670 31183 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:25:51.815162 31183 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:25:51.815819 31210 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:51.816069 31183 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:25:51.816179 31183 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/ts-1/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/ts-1/wal
uuid: "a69ecd14acce486bbad8a4d162d66996"
format_stamp: "Formatted at 2026-08-10 15:25:50 on dist-test-slave-2p8l"
server_key: "79e71e321eb0aec09c3da332976e3c18"
server_key_iv: "b6d2e1f84f878f915e213e88b93eb91e"
server_key_version: "encryptionkey@0"
I20260810 15:25:51.816592 31183 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:25:51.829888 31183 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:25:51.831991 31183 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:25:51.832165 31183 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:25:51.832403 31183 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 15:25:51.832726 31183 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 15:25:51.832782 31183 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:51.832824 31183 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 15:25:51.832851 31183 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:51.840358 31183 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.130:45317
I20260810 15:25:51.840440 31413 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.130:45317 every 8 connection(s)
I20260810 15:25:51.840915 31183 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/ts-1/data/info.pb
Aug 10 15:25:51 dist-test-slave-2p8l krb5kdc[29413](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375551, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.68.130@KRBTEST.COM for oryx/127.18.68.188@KRBTEST.COM
I20260810 15:25:51.848484 30292 heartbeater.cc:503] Master 127.18.68.190:46363 was elected leader, sending a full tablet report...
Aug 10 15:25:51 dist-test-slave-2p8l krb5kdc[29413](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375551, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.68.130@KRBTEST.COM for oryx/127.18.68.189@KRBTEST.COM
Aug 10 15:25:51 dist-test-slave-2p8l krb5kdc[29413](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375551, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.68.130@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM
I20260810 15:25:51.850646 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 31183
I20260810 15:25:51.850831 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 30069
I20260810 15:25:51.852380 31177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:51.842000 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.130:39853 (local address 127.18.68.188:45629)
0810 15:25:51.842105 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:51.842107 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:51.842118 (+ 11us) server_negotiation.cc:407] Connection header received
0810 15:25:51.842697 (+ 579us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:51.842698 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:51.842721 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:51.842778 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:51.843528 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:51.844317 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:51.845829 (+ 1512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:51.846171 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:51.846243 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:51.848904 (+ 2661us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:51.848906 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:51.848907 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:51.848917 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:51.850715 (+ 1798us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:51.851349 (+ 634us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:51.851351 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:51.851351 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:51.851406 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:51.851646 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:51.851647 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:51.851647 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:51.851777 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:51.851817 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:51.852143 (+ 326us) server_negotiation.cc:299] Negotiation successful
0810 15:25:51.852249 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260810 15:25:51.853107 31424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:51.841679 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.188:45629 (local address 127.18.68.130:39853)
0810 15:25:51.841886 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:51.841931 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:51.842591 (+ 660us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:51.842843 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:51.842847 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:51.843224 (+ 377us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:25:51.843429 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:51.843433 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:51.844687 (+ 1254us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:51.844688 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:51.845753 (+ 1065us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:51.845755 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:51.846299 (+ 544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:51.846300 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:51.846358 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:51.847058 (+ 700us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:25:51.847063 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:25:51.848712 (+ 1649us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:25:51.850864 (+ 2152us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:51.850907 (+ 43us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:51.850910 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:51.851258 (+ 348us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:51.851469 (+ 211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:51.851469 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:51.851470 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:51.851589 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:51.851856 (+ 267us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:25:51.851861 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:25:51.852016 (+ 155us) client_negotiation.cc:769] Sending connection context
0810 15:25:51.852680 (+ 664us) client_negotiation.cc:240] Negotiation successful
0810 15:25:51.852863 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162,"mutex_wait_us":5,"thread_start_us":124,"threads_started":1}
I20260810 15:25:51.856976 30797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:51.842167 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.130:54989 (local address 127.18.68.189:38325)
0810 15:25:51.842213 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:51.842215 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:51.842371 (+ 156us) server_negotiation.cc:407] Connection header received
0810 15:25:51.842722 (+ 351us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:51.842723 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:51.842737 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:51.842774 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:51.843557 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:51.844223 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:51.845804 (+ 1581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:51.846138 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:51.846190 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:51.849258 (+ 3068us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:51.849260 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:51.849260 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:51.849270 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:51.851058 (+ 1788us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:51.856014 (+ 4956us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:51.856016 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:51.856016 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:51.856085 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:51.856329 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:51.856330 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:51.856330 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:51.856478 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:51.856543 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:51.856763 (+ 220us) server_negotiation.cc:299] Negotiation successful
0810 15:25:51.856848 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260810 15:25:51.857350 31426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:51.842031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.189:38325 (local address 127.18.68.130:54989)
0810 15:25:51.842280 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:51.842290 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:51.842610 (+ 320us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:51.842855 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:51.842856 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:51.843261 (+ 405us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:25:51.843431 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:51.843437 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:51.844341 (+ 904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:51.844341 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:51.845686 (+ 1345us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:51.845689 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:51.846278 (+ 589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:51.846279 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:51.846342 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:51.846870 (+ 528us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:25:51.846882 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:25:51.849122 (+ 2240us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:25:51.855660 (+ 6538us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:51.855661 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:51.855662 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:51.855905 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:51.856172 (+ 267us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:51.856173 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:51.856173 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:51.856251 (+ 78us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:51.856596 (+ 345us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:25:51.856597 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:25:51.856643 (+ 46us) client_negotiation.cc:769] Sending connection context
0810 15:25:51.857088 (+ 445us) client_negotiation.cc:240] Negotiation successful
0810 15:25:51.857197 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":234,"mutex_wait_us":89,"thread_start_us":177,"threads_started":1}
I20260810 15:25:51.857788 31416 heartbeater.cc:347] Connected to a master server at 127.18.68.189:38325
I20260810 15:25:51.857872 31416 heartbeater.cc:464] Registering TS with master...
I20260810 15:25:51.858085 31416 heartbeater.cc:511] Master 127.18.68.189:38325 requested a full tablet report, sending...
I20260810 15:25:51.858556 30535 ts_manager.cc:194] Registered new tserver with Master: a69ecd14acce486bbad8a4d162d66996 (127.18.68.130:45317)
I20260810 15:25:51.859320 31422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:51.841680 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46363 (local address 127.18.68.130:50813)
0810 15:25:51.841886 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:51.841932 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:51.842610 (+ 678us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:51.842856 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:51.842856 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:51.843385 (+ 529us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:25:51.843437 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:51.843438 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:51.844413 (+ 975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:51.844414 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:51.845471 (+ 1057us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:51.845474 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:51.846036 (+ 562us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:51.846037 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:51.846217 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:51.846906 (+ 689us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:25:51.846910 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:25:51.849717 (+ 2807us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:25:51.858161 (+ 8444us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:51.858162 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:51.858162 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:51.858378 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:51.858610 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:51.858610 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:51.858611 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:51.858682 (+ 71us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:51.858988 (+ 306us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:25:51.858989 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:25:51.859029 (+ 40us) client_negotiation.cc:769] Sending connection context
0810 15:25:51.859105 (+ 76us) client_negotiation.cc:240] Negotiation successful
0810 15:25:51.859219 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"mutex_wait_us":102,"thread_start_us":117,"threads_started":1}
I20260810 15:25:51.859320 29574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:51.842166 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.130:50813 (local address 127.18.68.190:46363)
0810 15:25:51.842227 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:51.842229 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:51.842241 (+ 12us) server_negotiation.cc:407] Connection header received
0810 15:25:51.842721 (+ 480us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:51.842723 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:51.842737 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:51.842774 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:51.843578 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:51.844324 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:51.845597 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:51.845941 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:51.846009 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:51.850304 (+ 4295us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:51.850306 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:51.850307 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:51.850316 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:51.856680 (+ 6364us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:51.858466 (+ 1786us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:51.858467 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:51.858467 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:51.858531 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:51.858761 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:51.858762 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:51.858762 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:51.858895 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:51.858948 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:51.859156 (+ 208us) server_negotiation.cc:299] Negotiation successful
0810 15:25:51.859236 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260810 15:25:51.859608 31415 heartbeater.cc:347] Connected to a master server at 127.18.68.190:46363
I20260810 15:25:51.859660 31415 heartbeater.cc:464] Registering TS with master...
I20260810 15:25:51.859716 31415 heartbeater.cc:511] Master 127.18.68.190:46363 requested a full tablet report, sending...
I20260810 15:25:51.859936 29495 ts_manager.cc:194] Re-registered known tserver with Master: a69ecd14acce486bbad8a4d162d66996 (127.18.68.130:45317)
I20260810 15:25:51.860280 29495 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.18.68.130@KRBTEST.COM'} at 127.18.68.130:50813
I20260810 15:25:51.866567 31414 heartbeater.cc:347] Connected to a master server at 127.18.68.188:45629
I20260810 15:25:51.866659 31414 heartbeater.cc:464] Registering TS with master...
I20260810 15:25:51.866758 31414 heartbeater.cc:511] Master 127.18.68.188:45629 requested a full tablet report, sending...
I20260810 15:25:51.867110 30876 ts_manager.cc:194] Registered new tserver with Master: a69ecd14acce486bbad8a4d162d66996 (127.18.68.130:45317)
I20260810 15:25:51.870911 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.68.131:42797
--local_ip_for_outbound_sockets=127.18.68.131
--tserver_master_addrs=127.18.68.190:46363
--webserver_port=40343
--webserver_interface=127.18.68.131
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/krb5kdc/oryx_127.18.68.131.keytab
--principal=oryx/127.18.68.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:33723
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.18.68.190:46363,127.18.68.189:38325
--tserver_master_addrs=127.18.68.190:46363,127.18.68.189:38325,127.18.68.188:45629 with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:25:51.955507 31432 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:25:51.955761 31432 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:25:51.955801 31432 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:25:51.956964 31432 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:25:51.957036 31432 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:25:51.957080 31432 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.68.131
I20260810 15:25:51.958623 31432 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:33723
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/krb5kdc/oryx_127.18.68.131.keytab
--principal=oryx/127.18.68.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.68.131:42797
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.68.131
--webserver_port=40343
--tserver_master_addrs=127.18.68.190:46363,127.18.68.189:38325,127.18.68.188:45629
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31432
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.68.131
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:25:51.958923 31432 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:25:51.959156 31432 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:25:51.964303 31441 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:51.964365 31440 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:51.964303 31445 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:25:51.964763 31432 server_base.cc:1034] running on GCE node
I20260810 15:25:51.965003 31432 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:25:51.965301 31432 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:25:51.966449 31432 hybrid_clock.cc:648] HybridClock initialized: now 1786375551966438 us; error 34 us; skew 500 ppm
Aug 10 15:25:51 dist-test-slave-2p8l krb5kdc[29413](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375551, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.68.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:25:51.969208 31432 init.cc:377] Logged in from keytab as oryx/127.18.68.131@KRBTEST.COM (short username oryx)
I20260810 15:25:51.969763 31432 webserver.cc:460] Webserver started at http://127.18.68.131:40343/ using document root <none> and password file <none>
I20260810 15:25:51.970021 31432 fs_manager.cc:359] Metadata directory not provided
I20260810 15:25:51.970137 31432 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:25:51.971614 31432 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:25:51.972366 31455 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:51.972623 31432 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:25:51.972749 31432 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/ts-2/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/ts-2/wal
uuid: "92842de48966403c9acb8cbb06797670"
format_stamp: "Formatted at 2026-08-10 15:25:50 on dist-test-slave-2p8l"
server_key: "8e2671c45a0fff751aba3d92c2c26302"
server_key_iv: "dcd3b87142c763a8d65104b695445f0f"
server_key_version: "encryptionkey@0"
I20260810 15:25:51.973201 31432 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:25:51.976447 30460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:51.973224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.188:45629 (local address 127.0.0.1:59218)
0810 15:25:51.973312 (+ 88us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:51.973326 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:51.973393 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:51.973582 (+ 189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:51.973583 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:51.973585 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:25:51.973641 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:51.973643 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:51.974623 (+ 980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:51.974624 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:51.975330 (+ 706us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:51.975332 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:51.976131 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:51.976132 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:51.976192 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:51.976196 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 15:25:51.976329 (+ 133us) client_negotiation.cc:240] Negotiation successful
0810 15:25:51.976388 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":57}
I20260810 15:25:51.976449 31177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:51.973350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59218 (local address 127.18.68.188:45629)
0810 15:25:51.973405 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:51.973407 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:51.973421 (+ 14us) server_negotiation.cc:407] Connection header received
0810 15:25:51.973453 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:51.973454 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:51.973480 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:51.973556 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:25:51.973722 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:51.974536 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:51.975422 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:51.976028 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:51.976114 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:51.976209 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:51.976336 (+ 127us) server_negotiation.cc:299] Negotiation successful
0810 15:25:51.976378 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260810 15:25:51.976809 30886 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 79b8b9b8839e47be8dd75bfe3818b5cd [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260810 15:25:51.977025 30945 sys_catalog.cc:455] T 00000000000000000000000000000000 P 79b8b9b8839e47be8dd75bfe3818b5cd [sys.catalog]: SysCatalogTable state changed. Reason: New leader dc69d8e9c6814168941f833a163493a1. Latest consensus state: current_term: 1 leader_uuid: "dc69d8e9c6814168941f833a163493a1" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "dc69d8e9c6814168941f833a163493a1" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46363 } } peers { permanent_uuid: "368b444be95f4679b16a674be8ad8be1" member_type: VOTER last_known_addr { host: "127.18.68.189" port: 38325 } attrs { promote: false } } peers { permanent_uuid: "79b8b9b8839e47be8dd75bfe3818b5cd" member_type: NON_VOTER last_known_addr { host: "127.18.68.188" port: 45629 } attrs { promote: true } } }
I20260810 15:25:51.977135 30945 sys_catalog.cc:458] T 00000000000000000000000000000000 P 79b8b9b8839e47be8dd75bfe3818b5cd [sys.catalog]: This master's current role is: LEARNER
I20260810 15:25:51.986442 31432 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:25:51.988613 31432 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:25:51.988775 31432 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:25:51.989022 31432 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 15:25:51.989341 31432 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 15:25:51.989375 31432 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:51.989399 31432 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 15:25:51.989444 31432 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:51.996644 31432 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.131:42797
I20260810 15:25:51.996721 31645 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.131:42797 every 8 connection(s)
I20260810 15:25:51.997068 31432 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/ts-2/data/info.pb
Aug 10 15:25:52 dist-test-slave-2p8l krb5kdc[29413](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375551, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.68.131@KRBTEST.COM for oryx/127.18.68.189@KRBTEST.COM
Aug 10 15:25:52 dist-test-slave-2p8l krb5kdc[29413](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375551, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.68.131@KRBTEST.COM for oryx/127.18.68.188@KRBTEST.COM
Aug 10 15:25:52 dist-test-slave-2p8l krb5kdc[29413](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375551, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.68.131@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM
I20260810 15:25:52.006844 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 31432
I20260810 15:25:52.009442 31177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:51.997907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.131:40925 (local address 127.18.68.188:45629)
0810 15:25:51.998138 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:51.998140 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:51.998302 (+ 162us) server_negotiation.cc:407] Connection header received
0810 15:25:51.999503 (+ 1201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:51.999504 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:51.999520 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:51.999553 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:52.000327 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:52.001090 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:52.002486 (+ 1396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:52.002705 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:52.002785 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:52.005918 (+ 3133us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:52.005919 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:52.005920 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:52.005928 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:52.007655 (+ 1727us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:52.008127 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:52.008129 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:52.008129 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:52.008207 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:52.008542 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:52.008544 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:52.008544 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:52.008692 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:52.008744 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:52.009215 (+ 471us) server_negotiation.cc:299] Negotiation successful
0810 15:25:52.009317 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":200}
I20260810 15:25:52.009629 31652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:51.998280 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.189:38325 (local address 127.18.68.131:33667)
0810 15:25:51.998416 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:51.998425 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:51.999381 (+ 956us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:51.999637 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:51.999641 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:52.000018 (+ 377us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:25:52.000215 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:52.000220 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:52.002149 (+ 1929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:52.002150 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:52.002909 (+ 759us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:52.002911 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:52.003331 (+ 420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:52.003332 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:52.003444 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:52.003771 (+ 327us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:25:52.003775 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:25:52.005373 (+ 1598us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:25:52.007566 (+ 2193us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:52.007573 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:52.007576 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:52.008030 (+ 454us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:52.008278 (+ 248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:52.008279 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:52.008279 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:52.008454 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:52.008796 (+ 342us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:25:52.008804 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:25:52.008986 (+ 182us) client_negotiation.cc:769] Sending connection context
0810 15:25:52.009150 (+ 164us) client_negotiation.cc:240] Negotiation successful
0810 15:25:52.009338 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"mutex_wait_us":11,"thread_start_us":60,"threads_started":1}
I20260810 15:25:52.010113 29574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:51.997950 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.131:50731 (local address 127.18.68.190:46363)
0810 15:25:51.998010 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:51.998012 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:51.998334 (+ 322us) server_negotiation.cc:407] Connection header received
0810 15:25:51.999491 (+ 1157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:51.999493 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:51.999505 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:51.999554 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:52.000315 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:52.000822 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:52.002455 (+ 1633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:52.002757 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:52.002828 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:52.006989 (+ 4161us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:52.006992 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:52.006992 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:52.007001 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:52.008852 (+ 1851us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:52.009272 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:52.009273 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:52.009274 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:52.009333 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:52.009525 (+ 192us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:52.009526 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:52.009526 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:52.009649 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:52.009706 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:52.009907 (+ 201us) server_negotiation.cc:299] Negotiation successful
0810 15:25:52.009990 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260810 15:25:52.010120 30797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:51.998394 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.131:33667 (local address 127.18.68.189:38325)
0810 15:25:51.998442 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:51.998444 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:51.998457 (+ 13us) server_negotiation.cc:407] Connection header received
0810 15:25:51.999503 (+ 1046us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:51.999504 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:51.999516 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:51.999551 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:52.000327 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:52.001090 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:52.002992 (+ 1902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:52.003263 (+ 271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:52.003331 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:52.005480 (+ 2149us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:52.005481 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:52.005482 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:52.005490 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:52.007463 (+ 1973us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:52.008122 (+ 659us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:52.008124 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:52.008124 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:52.008197 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:52.008533 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:52.008534 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:52.008535 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:52.008701 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:52.008765 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:52.009906 (+ 1141us) server_negotiation.cc:299] Negotiation successful
0810 15:25:52.009991 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260810 15:25:52.010493 31650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:51.997921 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46363 (local address 127.18.68.131:50731)
0810 15:25:51.998222 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:51.998232 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:51.999372 (+ 1140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:51.999636 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:51.999640 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:51.999980 (+ 340us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:25:52.000214 (+ 234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:52.000218 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:52.000945 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:52.000946 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:52.002363 (+ 1417us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:52.002366 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:52.002860 (+ 494us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:52.002861 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:52.002956 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:52.004018 (+ 1062us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:25:52.004024 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:25:52.006506 (+ 2482us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:25:52.008930 (+ 2424us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:52.008931 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:52.008931 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:52.009187 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:52.009405 (+ 218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:52.009405 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:52.009405 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:52.009459 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:52.009742 (+ 283us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:25:52.009743 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:25:52.009787 (+ 44us) client_negotiation.cc:769] Sending connection context
0810 15:25:52.010259 (+ 472us) client_negotiation.cc:240] Negotiation successful
0810 15:25:52.010377 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":276,"mutex_wait_us":67,"spinlock_wait_cycles":7040,"thread_start_us":146,"threads_started":1}
I20260810 15:25:52.010473 31648 heartbeater.cc:347] Connected to a master server at 127.18.68.189:38325
I20260810 15:25:52.010602 31648 heartbeater.cc:464] Registering TS with master...
I20260810 15:25:52.010767 31648 heartbeater.cc:511] Master 127.18.68.189:38325 requested a full tablet report, sending...
I20260810 15:25:52.010960 31651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:51.997921 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.188:45629 (local address 127.18.68.131:40925)
0810 15:25:51.998176 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:51.998222 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:51.999372 (+ 1150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:51.999636 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:51.999641 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:52.000006 (+ 365us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:25:52.000215 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:52.000220 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:52.001167 (+ 947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:52.001168 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:52.002363 (+ 1195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:52.002366 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:52.002805 (+ 439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:52.002806 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:52.002956 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:52.003652 (+ 696us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:25:52.003664 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:25:52.005809 (+ 2145us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:25:52.007738 (+ 1929us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:52.007739 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:52.007739 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:52.008031 (+ 292us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:52.008295 (+ 264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:52.008295 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:52.008296 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:52.008455 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:52.008797 (+ 342us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:25:52.008827 (+ 30us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:25:52.008986 (+ 159us) client_negotiation.cc:769] Sending connection context
0810 15:25:52.009973 (+ 987us) client_negotiation.cc:240] Negotiation successful
0810 15:25:52.010115 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":202,"mutex_wait_us":14,"thread_start_us":96,"threads_started":1}
I20260810 15:25:52.011459 30535 ts_manager.cc:194] Registered new tserver with Master: 92842de48966403c9acb8cbb06797670 (127.18.68.131:42797)
I20260810 15:25:52.011827 31646 heartbeater.cc:347] Connected to a master server at 127.18.68.188:45629
I20260810 15:25:52.011891 31646 heartbeater.cc:464] Registering TS with master...
I20260810 15:25:52.011961 31646 heartbeater.cc:511] Master 127.18.68.188:45629 requested a full tablet report, sending...
I20260810 15:25:52.012228 30876 ts_manager.cc:194] Registered new tserver with Master: 92842de48966403c9acb8cbb06797670 (127.18.68.131:42797)
I20260810 15:25:52.012586 31647 heartbeater.cc:347] Connected to a master server at 127.18.68.190:46363
I20260810 15:25:52.012641 31647 heartbeater.cc:464] Registering TS with master...
I20260810 15:25:52.012702 31647 heartbeater.cc:511] Master 127.18.68.190:46363 requested a full tablet report, sending...
I20260810 15:25:52.012915 29495 ts_manager.cc:194] Re-registered known tserver with Master: 92842de48966403c9acb8cbb06797670 (127.18.68.131:42797)
I20260810 15:25:52.013378 29495 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.18.68.131@KRBTEST.COM'} at 127.18.68.131:50731
I20260810 15:25:52.018321 29574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:52.008168 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39518 (local address 127.18.68.190:46363)
0810 15:25:52.010199 (+ 2031us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:52.010202 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:52.010846 (+ 644us) server_negotiation.cc:407] Connection header received
0810 15:25:52.010870 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:52.010871 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:52.010881 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:52.010925 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:52.011691 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:52.012380 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:52.013449 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:52.013710 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:52.013754 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:52.015383 (+ 1629us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:52.015385 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:52.015385 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:52.015392 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:52.016968 (+ 1576us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:52.017387 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:52.017388 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:52.017389 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:52.017450 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:52.017657 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:52.017659 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:52.017659 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:52.017797 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:52.017895 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:52.018132 (+ 237us) server_negotiation.cc:299] Negotiation successful
0810 15:25:52.018223 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2013,"thread_start_us":55,"threads_started":1}
I20260810 15:25:52.018388 31177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:52.008430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59222 (local address 127.18.68.188:45629)
0810 15:25:52.009532 (+ 1102us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:52.009534 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:52.009643 (+ 109us) server_negotiation.cc:407] Connection header received
0810 15:25:52.009747 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:52.009748 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:52.009757 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:52.009784 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:52.011734 (+ 1950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:52.012479 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:52.013544 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:52.013839 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:52.013875 (+ 36us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:52.015428 (+ 1553us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:52.015430 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:52.015430 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:52.015437 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:52.017222 (+ 1785us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:52.017592 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:52.017593 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:52.017593 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:52.017646 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:52.017840 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:52.017841 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:52.017842 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:52.017994 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:52.018122 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:52.018221 (+ 99us) server_negotiation.cc:299] Negotiation successful
0810 15:25:52.018292 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1085,"thread_start_us":60,"threads_started":1}
I20260810 15:25:52.019043 31661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:52.009148 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57240 (local address 127.18.68.189:38325)
0810 15:25:52.009463 (+ 315us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:52.009465 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:52.010964 (+ 1499us) server_negotiation.cc:407] Connection header received
0810 15:25:52.010987 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:52.010989 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:52.011002 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:52.011063 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:52.011697 (+ 634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:52.012605 (+ 908us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:52.013791 (+ 1186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:52.014120 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:52.014193 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:52.015647 (+ 1454us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:52.015648 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:52.015648 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:52.015655 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:52.017413 (+ 1758us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:52.017746 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:52.017747 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:52.017747 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:52.017800 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:52.018009 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:52.018010 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:52.018010 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:52.018167 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:52.018255 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:52.018864 (+ 609us) server_negotiation.cc:299] Negotiation successful
0810 15:25:52.018954 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":292,"thread_start_us":63,"threads_started":1}
I20260810 15:25:52.020444 29495 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39518:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 15:25:52.022323 29495 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 15:25:52.023155 30461 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc69d8e9c6814168941f833a163493a1 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "dc69d8e9c6814168941f833a163493a1" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "dc69d8e9c6814168941f833a163493a1" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46363 } } peers { permanent_uuid: "368b444be95f4679b16a674be8ad8be1" member_type: VOTER last_known_addr { host: "127.18.68.189" port: 38325 } attrs { promote: false } } peers { permanent_uuid: "79b8b9b8839e47be8dd75bfe3818b5cd" member_type: NON_VOTER last_known_addr { host: "127.18.68.188" port: 45629 } attrs { promote: true } } }
I20260810 15:25:52.023269 30461 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc69d8e9c6814168941f833a163493a1 [sys.catalog]: This master's current role is: LEADER
I20260810 15:25:52.024595 31667 raft_consensus.cc:1050] T 00000000000000000000000000000000 P dc69d8e9c6814168941f833a163493a1: attempting to promote NON_VOTER 79b8b9b8839e47be8dd75bfe3818b5cd to VOTER
I20260810 15:25:52.024719 31667 consensus_queue.cc:237] T 00000000000000000000000000000000 P dc69d8e9c6814168941f833a163493a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "dc69d8e9c6814168941f833a163493a1" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46363 } } peers { permanent_uuid: "368b444be95f4679b16a674be8ad8be1" member_type: VOTER last_known_addr { host: "127.18.68.189" port: 38325 } attrs { promote: false } } peers { permanent_uuid: "79b8b9b8839e47be8dd75bfe3818b5cd" member_type: VOTER last_known_addr { host: "127.18.68.188" port: 45629 } attrs { promote: false } }
I20260810 15:25:52.025332 30886 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 79b8b9b8839e47be8dd75bfe3818b5cd [term 1 LEARNER]: Refusing update from remote peer dc69d8e9c6814168941f833a163493a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260810 15:25:52.025426 30553 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 368b444be95f4679b16a674be8ad8be1 [term 1 FOLLOWER]: Refusing update from remote peer dc69d8e9c6814168941f833a163493a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260810 15:25:52.025615 31664 consensus_queue.cc:1035] T 00000000000000000000000000000000 P dc69d8e9c6814168941f833a163493a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b8b9b8839e47be8dd75bfe3818b5cd" member_type: VOTER last_known_addr { host: "127.18.68.188" port: 45629 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260810 15:25:52.025704 30461 consensus_queue.cc:1035] T 00000000000000000000000000000000 P dc69d8e9c6814168941f833a163493a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "368b444be95f4679b16a674be8ad8be1" member_type: VOTER last_known_addr { host: "127.18.68.189" port: 38325 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260810 15:25:52.026271 31667 raft_consensus.cc:2932] T 00000000000000000000000000000000 P dc69d8e9c6814168941f833a163493a1 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 79b8b9b8839e47be8dd75bfe3818b5cd (127.18.68.188) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "dc69d8e9c6814168941f833a163493a1" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46363 } } peers { permanent_uuid: "368b444be95f4679b16a674be8ad8be1" member_type: VOTER last_known_addr { host: "127.18.68.189" port: 38325 } attrs { promote: false } } peers { permanent_uuid: "79b8b9b8839e47be8dd75bfe3818b5cd" member_type: VOTER last_known_addr { host: "127.18.68.188" port: 45629 } attrs { promote: false } } }
I20260810 15:25:52.026407 30553 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 368b444be95f4679b16a674be8ad8be1 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 79b8b9b8839e47be8dd75bfe3818b5cd (127.18.68.188) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "dc69d8e9c6814168941f833a163493a1" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46363 } } peers { permanent_uuid: "368b444be95f4679b16a674be8ad8be1" member_type: VOTER last_known_addr { host: "127.18.68.189" port: 38325 } attrs { promote: false } } peers { permanent_uuid: "79b8b9b8839e47be8dd75bfe3818b5cd" member_type: VOTER last_known_addr { host: "127.18.68.188" port: 45629 } attrs { promote: false } } }
I20260810 15:25:52.027282 31667 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc69d8e9c6814168941f833a163493a1 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "dc69d8e9c6814168941f833a163493a1" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "dc69d8e9c6814168941f833a163493a1" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46363 } } peers { permanent_uuid: "368b444be95f4679b16a674be8ad8be1" member_type: VOTER last_known_addr { host: "127.18.68.189" port: 38325 } attrs { promote: false } } peers { permanent_uuid: "79b8b9b8839e47be8dd75bfe3818b5cd" member_type: VOTER last_known_addr { host: "127.18.68.188" port: 45629 } attrs { promote: false } } }
I20260810 15:25:52.027362 31667 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc69d8e9c6814168941f833a163493a1 [sys.catalog]: This master's current role is: LEADER
I20260810 15:25:52.027326 30461 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc69d8e9c6814168941f833a163493a1 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "dc69d8e9c6814168941f833a163493a1" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "dc69d8e9c6814168941f833a163493a1" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46363 } } peers { permanent_uuid: "368b444be95f4679b16a674be8ad8be1" member_type: VOTER last_known_addr { host: "127.18.68.189" port: 38325 } attrs { promote: false } } peers { permanent_uuid: "79b8b9b8839e47be8dd75bfe3818b5cd" member_type: VOTER last_known_addr { host: "127.18.68.188" port: 45629 } attrs { promote: false } } }
I20260810 15:25:52.027398 31664 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc69d8e9c6814168941f833a163493a1 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "dc69d8e9c6814168941f833a163493a1" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "dc69d8e9c6814168941f833a163493a1" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46363 } } peers { permanent_uuid: "368b444be95f4679b16a674be8ad8be1" member_type: VOTER last_known_addr { host: "127.18.68.189" port: 38325 } attrs { promote: false } } peers { permanent_uuid: "79b8b9b8839e47be8dd75bfe3818b5cd" member_type: VOTER last_known_addr { host: "127.18.68.188" port: 45629 } attrs { promote: false } } }
I20260810 15:25:52.027457 31664 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc69d8e9c6814168941f833a163493a1 [sys.catalog]: This master's current role is: LEADER
I20260810 15:25:52.027427 30461 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc69d8e9c6814168941f833a163493a1 [sys.catalog]: This master's current role is: LEADER
I20260810 15:25:52.027484 30886 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 79b8b9b8839e47be8dd75bfe3818b5cd [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 79b8b9b8839e47be8dd75bfe3818b5cd (127.18.68.188) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "dc69d8e9c6814168941f833a163493a1" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46363 } } peers { permanent_uuid: "368b444be95f4679b16a674be8ad8be1" member_type: VOTER last_known_addr { host: "127.18.68.189" port: 38325 } attrs { promote: false } } peers { permanent_uuid: "79b8b9b8839e47be8dd75bfe3818b5cd" member_type: VOTER last_known_addr { host: "127.18.68.188" port: 45629 } attrs { promote: false } } }
I20260810 15:25:52.028601 30945 sys_catalog.cc:455] T 00000000000000000000000000000000 P 79b8b9b8839e47be8dd75bfe3818b5cd [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "dc69d8e9c6814168941f833a163493a1" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "dc69d8e9c6814168941f833a163493a1" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46363 } } peers { permanent_uuid: "368b444be95f4679b16a674be8ad8be1" member_type: VOTER last_known_addr { host: "127.18.68.189" port: 38325 } attrs { promote: false } } peers { permanent_uuid: "79b8b9b8839e47be8dd75bfe3818b5cd" member_type: VOTER last_known_addr { host: "127.18.68.188" port: 45629 } attrs { promote: false } } }
I20260810 15:25:52.028689 30945 sys_catalog.cc:458] T 00000000000000000000000000000000 P 79b8b9b8839e47be8dd75bfe3818b5cd [sys.catalog]: This master's current role is: FOLLOWER
I20260810 15:25:52.028852 31686 sys_catalog.cc:455] T 00000000000000000000000000000000 P 368b444be95f4679b16a674be8ad8be1 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "dc69d8e9c6814168941f833a163493a1" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "dc69d8e9c6814168941f833a163493a1" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46363 } } peers { permanent_uuid: "368b444be95f4679b16a674be8ad8be1" member_type: VOTER last_known_addr { host: "127.18.68.189" port: 38325 } attrs { promote: false } } peers { permanent_uuid: "79b8b9b8839e47be8dd75bfe3818b5cd" member_type: VOTER last_known_addr { host: "127.18.68.188" port: 45629 } attrs { promote: false } } }
I20260810 15:25:52.029032 31686 sys_catalog.cc:458] T 00000000000000000000000000000000 P 368b444be95f4679b16a674be8ad8be1 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 15:25:52.033352 30460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:52.029283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.129:38595 (local address 127.0.0.1:35952)
0810 15:25:52.029593 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:52.029607 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:52.029657 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:52.029924 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:52.029925 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:52.029927 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:25:52.029978 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:52.029980 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:52.031407 (+ 1427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:52.031409 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:52.032162 (+ 753us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:52.032164 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:52.033127 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:52.033128 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:52.033191 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:52.033194 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 15:25:52.033224 (+ 30us) client_negotiation.cc:240] Negotiation successful
0810 15:25:52.033263 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":293}
I20260810 15:25:52.033495 31697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:52.029826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46178 (local address 127.18.68.131:42797)
0810 15:25:52.030186 (+ 360us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:52.030190 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:52.030200 (+ 10us) server_negotiation.cc:407] Connection header received
0810 15:25:52.030237 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:52.030240 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:52.030255 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:52.030328 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:25:52.030417 (+ 89us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:52.031138 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:52.032378 (+ 1240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:52.033115 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:52.033185 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:52.033273 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:52.033354 (+ 81us) server_negotiation.cc:299] Negotiation successful
0810 15:25:52.033402 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":321,"thread_start_us":87,"threads_started":1}
I20260810 15:25:52.033746 31689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:52.029473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.131:42797 (local address 127.0.0.1:46178)
0810 15:25:52.030007 (+ 534us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:52.030018 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:52.030089 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:52.030323 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:52.030324 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:52.030326 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:25:52.030362 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:52.030363 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:52.031232 (+ 869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:52.031233 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:52.032285 (+ 1052us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:52.032287 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:52.033200 (+ 913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:52.033201 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:52.033260 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:52.033265 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 15:25:52.033338 (+ 73us) client_negotiation.cc:240] Negotiation successful
0810 15:25:52.033379 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":513,"mutex_wait_us":1,"thread_start_us":82,"threads_started":1}
I20260810 15:25:52.033793 31696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:52.029484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35952 (local address 127.18.68.129:38595)
0810 15:25:52.029736 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:52.029741 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:52.029752 (+ 11us) server_negotiation.cc:407] Connection header received
0810 15:25:52.029796 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:52.029798 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:52.029816 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:52.030106 (+ 290us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:25:52.030176 (+ 70us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:52.031307 (+ 1131us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:52.032246 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:52.033009 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:52.033553 (+ 544us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:52.033647 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:52.033674 (+ 27us) server_negotiation.cc:299] Negotiation successful
0810 15:25:52.033715 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":208,"thread_start_us":105,"threads_started":1}
I20260810 15:25:52.034289 31694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:52.029301 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.130:45317 (local address 127.0.0.1:57370)
0810 15:25:52.029653 (+ 352us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:52.029663 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:52.029753 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:52.030028 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:52.030028 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:52.030030 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:25:52.030156 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:52.030160 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:52.031556 (+ 1396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:52.031557 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:52.032734 (+ 1177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:52.032737 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:52.033997 (+ 1260us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:52.033998 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:52.034100 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:52.034104 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 15:25:52.034164 (+ 60us) client_negotiation.cc:240] Negotiation successful
0810 15:25:52.034210 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":333,"thread_start_us":85,"threads_started":1}
I20260810 15:25:52.034479 31692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:52.029424 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57370 (local address 127.18.68.130:45317)
0810 15:25:52.029595 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:52.029601 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:52.029723 (+ 122us) server_negotiation.cc:407] Connection header received
0810 15:25:52.029848 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:52.029851 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:52.029868 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:52.029928 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:25:52.030259 (+ 331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:52.031466 (+ 1207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:52.032821 (+ 1355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:52.033465 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:52.033533 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:52.033954 (+ 421us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:52.034286 (+ 332us) server_negotiation.cc:299] Negotiation successful
0810 15:25:52.034340 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":91,"threads_started":1}
I20260810 15:25:52.034642 31057 tablet_service.cc:1467] Processing CreateTablet for tablet 84ddf516321341d682f00291b041a6f9 (DEFAULT_TABLE table=test-table [id=ae2ac72be9f3467ea9efd5380420cba8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 15:25:52.034857 31538 tablet_service.cc:1467] Processing CreateTablet for tablet 84ddf516321341d682f00291b041a6f9 (DEFAULT_TABLE table=test-table [id=ae2ac72be9f3467ea9efd5380420cba8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 15:25:52.035012 31057 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 84ddf516321341d682f00291b041a6f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:25:52.035210 31538 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 84ddf516321341d682f00291b041a6f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:25:52.035133 31297 tablet_service.cc:1467] Processing CreateTablet for tablet 84ddf516321341d682f00291b041a6f9 (DEFAULT_TABLE table=test-table [id=ae2ac72be9f3467ea9efd5380420cba8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 15:25:52.035449 31297 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 84ddf516321341d682f00291b041a6f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:25:52.037685 31698 tablet_bootstrap.cc:492] T 84ddf516321341d682f00291b041a6f9 P aa343e60e15a4e3fb24f49dbb3aa37b3: Bootstrap starting.
I20260810 15:25:52.038475 31698 tablet_bootstrap.cc:654] T 84ddf516321341d682f00291b041a6f9 P aa343e60e15a4e3fb24f49dbb3aa37b3: Neither blocks nor log segments found. Creating new log.
I20260810 15:25:52.038836 31700 tablet_bootstrap.cc:492] T 84ddf516321341d682f00291b041a6f9 P 92842de48966403c9acb8cbb06797670: Bootstrap starting.
I20260810 15:25:52.038863 31698 log.cc:824] T 84ddf516321341d682f00291b041a6f9 P aa343e60e15a4e3fb24f49dbb3aa37b3: Log is configured to *not* fsync() on all Append() calls
I20260810 15:25:52.039503 31702 tablet_bootstrap.cc:492] T 84ddf516321341d682f00291b041a6f9 P a69ecd14acce486bbad8a4d162d66996: Bootstrap starting.
I20260810 15:25:52.039781 31698 tablet_bootstrap.cc:492] T 84ddf516321341d682f00291b041a6f9 P aa343e60e15a4e3fb24f49dbb3aa37b3: No bootstrap required, opened a new log
I20260810 15:25:52.039813 31700 tablet_bootstrap.cc:654] T 84ddf516321341d682f00291b041a6f9 P 92842de48966403c9acb8cbb06797670: Neither blocks nor log segments found. Creating new log.
I20260810 15:25:52.039866 31698 ts_tablet_manager.cc:1397] T 84ddf516321341d682f00291b041a6f9 P aa343e60e15a4e3fb24f49dbb3aa37b3: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260810 15:25:52.040211 31700 log.cc:824] T 84ddf516321341d682f00291b041a6f9 P 92842de48966403c9acb8cbb06797670: Log is configured to *not* fsync() on all Append() calls
I20260810 15:25:52.040280 31702 tablet_bootstrap.cc:654] T 84ddf516321341d682f00291b041a6f9 P a69ecd14acce486bbad8a4d162d66996: Neither blocks nor log segments found. Creating new log.
I20260810 15:25:52.040618 31702 log.cc:824] T 84ddf516321341d682f00291b041a6f9 P a69ecd14acce486bbad8a4d162d66996: Log is configured to *not* fsync() on all Append() calls
I20260810 15:25:52.041062 31700 tablet_bootstrap.cc:492] T 84ddf516321341d682f00291b041a6f9 P 92842de48966403c9acb8cbb06797670: No bootstrap required, opened a new log
I20260810 15:25:52.041157 31700 ts_tablet_manager.cc:1397] T 84ddf516321341d682f00291b041a6f9 P 92842de48966403c9acb8cbb06797670: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 15:25:52.041502 31702 tablet_bootstrap.cc:492] T 84ddf516321341d682f00291b041a6f9 P a69ecd14acce486bbad8a4d162d66996: No bootstrap required, opened a new log
I20260810 15:25:52.041580 31702 ts_tablet_manager.cc:1397] T 84ddf516321341d682f00291b041a6f9 P a69ecd14acce486bbad8a4d162d66996: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 15:25:52.042616 31698 raft_consensus.cc:348] T 84ddf516321341d682f00291b041a6f9 P aa343e60e15a4e3fb24f49dbb3aa37b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a69ecd14acce486bbad8a4d162d66996" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 45317 } } peers { permanent_uuid: "aa343e60e15a4e3fb24f49dbb3aa37b3" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 38595 } } peers { permanent_uuid: "92842de48966403c9acb8cbb06797670" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 42797 } }
I20260810 15:25:52.042796 31698 raft_consensus.cc:374] T 84ddf516321341d682f00291b041a6f9 P aa343e60e15a4e3fb24f49dbb3aa37b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:25:52.042836 31698 raft_consensus.cc:729] T 84ddf516321341d682f00291b041a6f9 P aa343e60e15a4e3fb24f49dbb3aa37b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa343e60e15a4e3fb24f49dbb3aa37b3, State: Initialized, Role: FOLLOWER
I20260810 15:25:52.042979 31698 consensus_queue.cc:260] T 84ddf516321341d682f00291b041a6f9 P aa343e60e15a4e3fb24f49dbb3aa37b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a69ecd14acce486bbad8a4d162d66996" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 45317 } } peers { permanent_uuid: "aa343e60e15a4e3fb24f49dbb3aa37b3" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 38595 } } peers { permanent_uuid: "92842de48966403c9acb8cbb06797670" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 42797 } }
I20260810 15:25:52.043289 31174 heartbeater.cc:503] Master 127.18.68.190:46363 was elected leader, sending a full tablet report...
I20260810 15:25:52.043679 31698 ts_tablet_manager.cc:1428] T 84ddf516321341d682f00291b041a6f9 P aa343e60e15a4e3fb24f49dbb3aa37b3: Time spent starting tablet: real 0.004s user 0.003s sys 0.001s
I20260810 15:25:52.043953 31700 raft_consensus.cc:348] T 84ddf516321341d682f00291b041a6f9 P 92842de48966403c9acb8cbb06797670 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a69ecd14acce486bbad8a4d162d66996" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 45317 } } peers { permanent_uuid: "aa343e60e15a4e3fb24f49dbb3aa37b3" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 38595 } } peers { permanent_uuid: "92842de48966403c9acb8cbb06797670" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 42797 } }
I20260810 15:25:52.044119 31700 raft_consensus.cc:374] T 84ddf516321341d682f00291b041a6f9 P 92842de48966403c9acb8cbb06797670 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:25:52.044370 31700 raft_consensus.cc:729] T 84ddf516321341d682f00291b041a6f9 P 92842de48966403c9acb8cbb06797670 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92842de48966403c9acb8cbb06797670, State: Initialized, Role: FOLLOWER
I20260810 15:25:52.044660 31700 consensus_queue.cc:260] T 84ddf516321341d682f00291b041a6f9 P 92842de48966403c9acb8cbb06797670 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a69ecd14acce486bbad8a4d162d66996" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 45317 } } peers { permanent_uuid: "aa343e60e15a4e3fb24f49dbb3aa37b3" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 38595 } } peers { permanent_uuid: "92842de48966403c9acb8cbb06797670" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 42797 } }
I20260810 15:25:52.044724 31702 raft_consensus.cc:348] T 84ddf516321341d682f00291b041a6f9 P a69ecd14acce486bbad8a4d162d66996 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a69ecd14acce486bbad8a4d162d66996" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 45317 } } peers { permanent_uuid: "aa343e60e15a4e3fb24f49dbb3aa37b3" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 38595 } } peers { permanent_uuid: "92842de48966403c9acb8cbb06797670" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 42797 } }
I20260810 15:25:52.044932 31700 ts_tablet_manager.cc:1428] T 84ddf516321341d682f00291b041a6f9 P 92842de48966403c9acb8cbb06797670: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260810 15:25:52.044960 31702 raft_consensus.cc:374] T 84ddf516321341d682f00291b041a6f9 P a69ecd14acce486bbad8a4d162d66996 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:25:52.045015 31702 raft_consensus.cc:729] T 84ddf516321341d682f00291b041a6f9 P a69ecd14acce486bbad8a4d162d66996 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a69ecd14acce486bbad8a4d162d66996, State: Initialized, Role: FOLLOWER
I20260810 15:25:52.045130 31702 consensus_queue.cc:260] T 84ddf516321341d682f00291b041a6f9 P a69ecd14acce486bbad8a4d162d66996 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a69ecd14acce486bbad8a4d162d66996" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 45317 } } peers { permanent_uuid: "aa343e60e15a4e3fb24f49dbb3aa37b3" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 38595 } } peers { permanent_uuid: "92842de48966403c9acb8cbb06797670" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 42797 } }
I20260810 15:25:52.045241 31647 heartbeater.cc:503] Master 127.18.68.190:46363 was elected leader, sending a full tablet report...
I20260810 15:25:52.045923 31702 ts_tablet_manager.cc:1428] T 84ddf516321341d682f00291b041a6f9 P a69ecd14acce486bbad8a4d162d66996: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260810 15:25:52.046273 31415 heartbeater.cc:503] Master 127.18.68.190:46363 was elected leader, sending a full tablet report...
I20260810 15:25:52.090670 31711 raft_consensus.cc:482] T 84ddf516321341d682f00291b041a6f9 P a69ecd14acce486bbad8a4d162d66996 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 15:25:52.090837 31711 raft_consensus.cc:504] T 84ddf516321341d682f00291b041a6f9 P a69ecd14acce486bbad8a4d162d66996 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a69ecd14acce486bbad8a4d162d66996" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 45317 } } peers { permanent_uuid: "aa343e60e15a4e3fb24f49dbb3aa37b3" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 38595 } } peers { permanent_uuid: "92842de48966403c9acb8cbb06797670" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 42797 } }
I20260810 15:25:52.091254 31711 leader_election.cc:288] T 84ddf516321341d682f00291b041a6f9 P a69ecd14acce486bbad8a4d162d66996 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa343e60e15a4e3fb24f49dbb3aa37b3 (127.18.68.129:38595), 92842de48966403c9acb8cbb06797670 (127.18.68.131:42797)
W20260810 15:25:52.092671 31419 tablet.cc:2369] T 84ddf516321341d682f00291b041a6f9 P a69ecd14acce486bbad8a4d162d66996: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 15:25:52.094587 31422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:52.091412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.131:42797 (local address 127.18.68.130:60857)
0810 15:25:52.091484 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:52.091496 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:52.091549 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:52.091739 (+ 190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:52.091740 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:52.091742 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:25:52.091853 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:52.091855 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:52.092875 (+ 1020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:52.092876 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:52.093641 (+ 765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:52.093643 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:52.094310 (+ 667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:52.094311 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:52.094385 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:52.094388 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 15:25:52.094465 (+ 77us) client_negotiation.cc:240] Negotiation successful
0810 15:25:52.094508 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45}
I20260810 15:25:52.094587 31697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:52.091520 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.130:60857 (local address 127.18.68.131:42797)
0810 15:25:52.091594 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:52.091597 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:52.091605 (+ 8us) server_negotiation.cc:407] Connection header received
0810 15:25:52.091635 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:52.091635 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:52.091644 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:52.091698 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:25:52.091957 (+ 259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:52.092775 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:52.093749 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:52.094226 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:52.094312 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:52.094322 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:52.094476 (+ 154us) server_negotiation.cc:299] Negotiation successful
0810 15:25:52.094520 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260810 15:25:52.094780 31696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:52.091520 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.130:39513 (local address 127.18.68.129:38595)
0810 15:25:52.091594 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:52.091596 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:52.092136 (+ 540us) server_negotiation.cc:407] Connection header received
0810 15:25:52.092214 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:52.092215 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:52.092225 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:52.092298 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:25:52.092462 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:52.093048 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:52.093968 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:52.094414 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:52.094504 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:52.094512 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:52.094674 (+ 162us) server_negotiation.cc:299] Negotiation successful
0810 15:25:52.094717 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260810 15:25:52.094825 31426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:52.091963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.129:38595 (local address 127.18.68.130:39513)
0810 15:25:52.092044 (+ 81us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:52.092054 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:52.092123 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:52.092303 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:52.092304 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:52.092305 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:25:52.092378 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:52.092380 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:52.093137 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:52.093139 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:52.093871 (+ 732us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:52.093873 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:52.094503 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:52.094504 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:52.094592 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:52.094595 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 15:25:52.094666 (+ 71us) client_negotiation.cc:240] Negotiation successful
0810 15:25:52.094703 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":64}
I20260810 15:25:52.094966 31570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84ddf516321341d682f00291b041a6f9" candidate_uuid: "a69ecd14acce486bbad8a4d162d66996" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92842de48966403c9acb8cbb06797670" is_pre_election: true
I20260810 15:25:52.095127 31570 raft_consensus.cc:2454] T 84ddf516321341d682f00291b041a6f9 P 92842de48966403c9acb8cbb06797670 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a69ecd14acce486bbad8a4d162d66996 in term 0.
I20260810 15:25:52.095173 31094 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84ddf516321341d682f00291b041a6f9" candidate_uuid: "a69ecd14acce486bbad8a4d162d66996" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa343e60e15a4e3fb24f49dbb3aa37b3" is_pre_election: true
I20260810 15:25:52.095329 31094 raft_consensus.cc:2454] T 84ddf516321341d682f00291b041a6f9 P aa343e60e15a4e3fb24f49dbb3aa37b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a69ecd14acce486bbad8a4d162d66996 in term 0.
I20260810 15:25:52.095414 31216 leader_election.cc:302] T 84ddf516321341d682f00291b041a6f9 P a69ecd14acce486bbad8a4d162d66996 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92842de48966403c9acb8cbb06797670, a69ecd14acce486bbad8a4d162d66996; no voters:
I20260810 15:25:52.095582 31711 raft_consensus.cc:2781] T 84ddf516321341d682f00291b041a6f9 P a69ecd14acce486bbad8a4d162d66996 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 15:25:52.095661 31711 raft_consensus.cc:482] T 84ddf516321341d682f00291b041a6f9 P a69ecd14acce486bbad8a4d162d66996 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 15:25:52.095680 31711 raft_consensus.cc:3037] T 84ddf516321341d682f00291b041a6f9 P a69ecd14acce486bbad8a4d162d66996 [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:25:52.096383 31711 raft_consensus.cc:504] T 84ddf516321341d682f00291b041a6f9 P a69ecd14acce486bbad8a4d162d66996 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a69ecd14acce486bbad8a4d162d66996" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 45317 } } peers { permanent_uuid: "aa343e60e15a4e3fb24f49dbb3aa37b3" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 38595 } } peers { permanent_uuid: "92842de48966403c9acb8cbb06797670" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 42797 } }
I20260810 15:25:52.096596 31711 leader_election.cc:288] T 84ddf516321341d682f00291b041a6f9 P a69ecd14acce486bbad8a4d162d66996 [CANDIDATE]: Term 1 election: Requested vote from peers aa343e60e15a4e3fb24f49dbb3aa37b3 (127.18.68.129:38595), 92842de48966403c9acb8cbb06797670 (127.18.68.131:42797)
I20260810 15:25:52.096720 31570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84ddf516321341d682f00291b041a6f9" candidate_uuid: "a69ecd14acce486bbad8a4d162d66996" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92842de48966403c9acb8cbb06797670"
I20260810 15:25:52.096773 31094 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84ddf516321341d682f00291b041a6f9" candidate_uuid: "a69ecd14acce486bbad8a4d162d66996" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa343e60e15a4e3fb24f49dbb3aa37b3"
I20260810 15:25:52.096818 31570 raft_consensus.cc:3037] T 84ddf516321341d682f00291b041a6f9 P 92842de48966403c9acb8cbb06797670 [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:25:52.096845 31094 raft_consensus.cc:3037] T 84ddf516321341d682f00291b041a6f9 P aa343e60e15a4e3fb24f49dbb3aa37b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:25:52.097759 31094 raft_consensus.cc:2454] T 84ddf516321341d682f00291b041a6f9 P aa343e60e15a4e3fb24f49dbb3aa37b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a69ecd14acce486bbad8a4d162d66996 in term 1.
I20260810 15:25:52.097759 31570 raft_consensus.cc:2454] T 84ddf516321341d682f00291b041a6f9 P 92842de48966403c9acb8cbb06797670 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a69ecd14acce486bbad8a4d162d66996 in term 1.
I20260810 15:25:52.097981 31216 leader_election.cc:302] T 84ddf516321341d682f00291b041a6f9 P a69ecd14acce486bbad8a4d162d66996 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92842de48966403c9acb8cbb06797670, a69ecd14acce486bbad8a4d162d66996; no voters:
I20260810 15:25:52.098111 31711 raft_consensus.cc:2781] T 84ddf516321341d682f00291b041a6f9 P a69ecd14acce486bbad8a4d162d66996 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 15:25:52.098292 31711 raft_consensus.cc:686] T 84ddf516321341d682f00291b041a6f9 P a69ecd14acce486bbad8a4d162d66996 [term 1 LEADER]: Becoming Leader. State: Replica: a69ecd14acce486bbad8a4d162d66996, State: Running, Role: LEADER
I20260810 15:25:52.098555 31711 consensus_queue.cc:237] T 84ddf516321341d682f00291b041a6f9 P a69ecd14acce486bbad8a4d162d66996 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a69ecd14acce486bbad8a4d162d66996" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 45317 } } peers { permanent_uuid: "aa343e60e15a4e3fb24f49dbb3aa37b3" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 38595 } } peers { permanent_uuid: "92842de48966403c9acb8cbb06797670" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 42797 } }
I20260810 15:25:52.099645 29495 catalog_manager.cc:5495] T 84ddf516321341d682f00291b041a6f9 P a69ecd14acce486bbad8a4d162d66996 reported cstate change: term changed from 0 to 1, leader changed from <none> to a69ecd14acce486bbad8a4d162d66996 (127.18.68.130). New cstate: current_term: 1 leader_uuid: "a69ecd14acce486bbad8a4d162d66996" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a69ecd14acce486bbad8a4d162d66996" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 45317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aa343e60e15a4e3fb24f49dbb3aa37b3" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 38595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92842de48966403c9acb8cbb06797670" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 42797 } health_report { overall_health: UNKNOWN } } }
I20260810 15:25:52.109373 31692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:52.106966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57380 (local address 127.18.68.130:45317)
0810 15:25:52.107031 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:52.107034 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:52.107054 (+ 20us) server_negotiation.cc:407] Connection header received
0810 15:25:52.107090 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:52.107091 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:52.107111 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:52.107175 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 15:25:52.107316 (+ 141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:52.107859 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:52.108598 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:52.108798 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:52.108873 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:52.109047 (+ 174us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 15:25:52.109149 (+ 102us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 15:25:52.109249 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:52.109269 (+ 20us) server_negotiation.cc:299] Negotiation successful
0810 15:25:52.109289 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260810 15:25:52.111284 31094 raft_consensus.cc:1261] T 84ddf516321341d682f00291b041a6f9 P aa343e60e15a4e3fb24f49dbb3aa37b3 [term 1 FOLLOWER]: Refusing update from remote peer a69ecd14acce486bbad8a4d162d66996: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 15:25:52.111296 31570 raft_consensus.cc:1261] T 84ddf516321341d682f00291b041a6f9 P 92842de48966403c9acb8cbb06797670 [term 1 FOLLOWER]: Refusing update from remote peer a69ecd14acce486bbad8a4d162d66996: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 15:25:52.111761 31712 consensus_queue.cc:1035] T 84ddf516321341d682f00291b041a6f9 P a69ecd14acce486bbad8a4d162d66996 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92842de48966403c9acb8cbb06797670" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 42797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 15:25:52.111953 31711 consensus_queue.cc:1035] T 84ddf516321341d682f00291b041a6f9 P a69ecd14acce486bbad8a4d162d66996 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa343e60e15a4e3fb24f49dbb3aa37b3" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 38595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 15:25:52.115936 31719 mvcc.cc:205] Tried to move back new op lower bound from 7316994261444800512 to 7316994261396209664. Current Snapshot: MvccSnapshot[applied={T|T < 7316994261444800512 or (T in {7316994261444800512})}]
I20260810 15:25:52.116729 31721 mvcc.cc:205] Tried to move back new op lower bound from 7316994261444800512 to 7316994261396209664. Current Snapshot: MvccSnapshot[applied={T|T < 7316994261444800512 or (T in {7316994261444800512})}]
I20260810 15:25:52.116986 29494 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39518:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 15:25:52.117105 29494 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39518:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 15:25:52.118500 29494 catalog_manager.cc:5782] T 00000000000000000000000000000000 P dc69d8e9c6814168941f833a163493a1: Sending DeleteTablet for 3 replicas of tablet 84ddf516321341d682f00291b041a6f9
I20260810 15:25:52.118798 31297 tablet_service.cc:1514] Processing DeleteTablet for tablet 84ddf516321341d682f00291b041a6f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 15:25:52 UTC) from {username='oryx', principal='oryx/127.18.68.190@KRBTEST.COM'} at 127.0.0.1:57370
I20260810 15:25:52.118881 31538 tablet_service.cc:1514] Processing DeleteTablet for tablet 84ddf516321341d682f00291b041a6f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 15:25:52 UTC) from {username='oryx', principal='oryx/127.18.68.190@KRBTEST.COM'} at 127.0.0.1:46178
I20260810 15:25:52.119061 31738 tablet_replica.cc:330] T 84ddf516321341d682f00291b041a6f9 P a69ecd14acce486bbad8a4d162d66996: stopping tablet replica
I20260810 15:25:52.119166 31738 raft_consensus.cc:2229] T 84ddf516321341d682f00291b041a6f9 P a69ecd14acce486bbad8a4d162d66996 [term 1 LEADER]: Raft consensus shutting down.
I20260810 15:25:52.119285 31738 raft_consensus.cc:2258] T 84ddf516321341d682f00291b041a6f9 P a69ecd14acce486bbad8a4d162d66996 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 15:25:52.119283 31057 tablet_service.cc:1514] Processing DeleteTablet for tablet 84ddf516321341d682f00291b041a6f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 15:25:52 UTC) from {username='oryx', principal='oryx/127.18.68.190@KRBTEST.COM'} at 127.0.0.1:35952
I20260810 15:25:52.119900 31738 ts_tablet_manager.cc:1905] T 84ddf516321341d682f00291b041a6f9 P a69ecd14acce486bbad8a4d162d66996: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 15:25:52.120581 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 29436
I20260810 15:25:52.132542 31738 ts_tablet_manager.cc:1918] T 84ddf516321341d682f00291b041a6f9 P a69ecd14acce486bbad8a4d162d66996: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 15:25:52.132656 31738 log.cc:1196] T 84ddf516321341d682f00291b041a6f9 P a69ecd14acce486bbad8a4d162d66996: Deleting WAL directory at /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/ts-1/wal/wals/84ddf516321341d682f00291b041a6f9
I20260810 15:25:52.132959 31738 ts_tablet_manager.cc:1939] T 84ddf516321341d682f00291b041a6f9 P a69ecd14acce486bbad8a4d162d66996: Deleting consensus metadata
I20260810 15:25:52.138521 31742 tablet_replica.cc:330] T 84ddf516321341d682f00291b041a6f9 P 92842de48966403c9acb8cbb06797670: stopping tablet replica
I20260810 15:25:52.138670 31742 raft_consensus.cc:2229] T 84ddf516321341d682f00291b041a6f9 P 92842de48966403c9acb8cbb06797670 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 15:25:52.138795 31742 raft_consensus.cc:2258] T 84ddf516321341d682f00291b041a6f9 P 92842de48966403c9acb8cbb06797670 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 15:25:52.138983 31743 tablet_replica.cc:330] T 84ddf516321341d682f00291b041a6f9 P aa343e60e15a4e3fb24f49dbb3aa37b3: stopping tablet replica
I20260810 15:25:52.139101 31743 raft_consensus.cc:2229] T 84ddf516321341d682f00291b041a6f9 P aa343e60e15a4e3fb24f49dbb3aa37b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 15:25:52.139221 31743 raft_consensus.cc:2258] T 84ddf516321341d682f00291b041a6f9 P aa343e60e15a4e3fb24f49dbb3aa37b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 15:25:52.140012 31743 ts_tablet_manager.cc:1905] T 84ddf516321341d682f00291b041a6f9 P aa343e60e15a4e3fb24f49dbb3aa37b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 15:25:52.142217 31743 ts_tablet_manager.cc:1918] T 84ddf516321341d682f00291b041a6f9 P aa343e60e15a4e3fb24f49dbb3aa37b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 15:25:52.142293 31743 log.cc:1196] T 84ddf516321341d682f00291b041a6f9 P aa343e60e15a4e3fb24f49dbb3aa37b3: Deleting WAL directory at /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/ts-0/wal/wals/84ddf516321341d682f00291b041a6f9
I20260810 15:25:52.142578 31743 ts_tablet_manager.cc:1939] T 84ddf516321341d682f00291b041a6f9 P aa343e60e15a4e3fb24f49dbb3aa37b3: Deleting consensus metadata
W20260810 15:25:52.144455 31215 connection.cc:535] server connection from 127.0.0.1:57370 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260810 15:25:52.144979 31742 ts_tablet_manager.cc:1905] T 84ddf516321341d682f00291b041a6f9 P 92842de48966403c9acb8cbb06797670: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 15:25:52.144999 30987 connection.cc:535] server connection from 127.0.0.1:35952 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260810 15:25:52.146704 31177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:52.119752 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59232 (local address 127.18.68.188:45629)
0810 15:25:52.119861 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:52.119863 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:52.120505 (+ 642us) server_negotiation.cc:407] Connection header received
0810 15:25:52.138427 (+ 17922us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:52.138429 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:52.138443 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:52.138509 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:52.139346 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:52.140169 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:52.141328 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:52.141681 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:52.141725 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:52.143638 (+ 1913us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:52.143639 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:52.143640 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:52.143648 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:52.145346 (+ 1698us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:52.145770 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:52.145771 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:52.145771 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:52.145832 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:52.146046 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:52.146047 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:52.146048 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:52.146232 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:52.146341 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:52.146504 (+ 163us) server_negotiation.cc:299] Negotiation successful
0810 15:25:52.146608 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260810 15:25:52.148146 31742 ts_tablet_manager.cc:1918] T 84ddf516321341d682f00291b041a6f9 P 92842de48966403c9acb8cbb06797670: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 15:25:52.148249 31742 log.cc:1196] T 84ddf516321341d682f00291b041a6f9 P 92842de48966403c9acb8cbb06797670: Deleting WAL directory at /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/ts-2/wal/wals/84ddf516321341d682f00291b041a6f9
I20260810 15:25:52.148558 31742 ts_tablet_manager.cc:1939] T 84ddf516321341d682f00291b041a6f9 P 92842de48966403c9acb8cbb06797670: Deleting consensus metadata
W20260810 15:25:52.148973 31459 connection.cc:441] server connection from 127.0.0.1:46178 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46178 (request call id 1) could send its response
I20260810 15:25:52.154747 31177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:52.147265 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59240 (local address 127.18.68.188:45629)
0810 15:25:52.147305 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:52.147307 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:52.147433 (+ 126us) server_negotiation.cc:407] Connection header received
0810 15:25:52.147533 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:52.147534 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:52.147544 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:52.147573 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:52.148752 (+ 1179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:52.149436 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:52.150180 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:52.150429 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:52.150497 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:52.151953 (+ 1456us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:52.151955 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:52.151955 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:52.151962 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:52.153569 (+ 1607us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:52.153929 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:52.153930 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:52.153930 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:52.153989 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:52.154220 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:52.154221 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:52.154221 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:52.154335 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:52.154449 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:52.154548 (+ 99us) server_negotiation.cc:299] Negotiation successful
0810 15:25:52.154618 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260810 15:25:52.156003 31661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:52.149302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57252 (local address 127.18.68.189:38325)
0810 15:25:52.149366 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:52.149368 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:52.149456 (+ 88us) server_negotiation.cc:407] Connection header received
0810 15:25:52.149562 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:52.149563 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:52.149577 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:52.149608 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:52.150365 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:52.150899 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:52.151571 (+ 672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:52.151801 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:52.151879 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:52.153260 (+ 1381us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:52.153262 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:52.153262 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:52.153270 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:52.154975 (+ 1705us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:52.155332 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:52.155333 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:52.155333 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:52.155393 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:52.155540 (+ 147us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:52.155540 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:52.155540 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:52.155668 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:52.155766 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:52.155825 (+ 59us) server_negotiation.cc:299] Negotiation successful
0810 15:25:52.155912 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260810 15:25:53.116335 31764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:53.116026 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46363 (local address 127.18.68.130:42423)
0810 15:25:53.116175 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:53.116270 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:46363: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":70,"threads_started":1}
W20260810 15:25:53.116703 31415 heartbeater.cc:644] Failed to heartbeat to 127.18.68.190:46363 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.18.68.190:46363: connect: Connection refused (error 111)
I20260810 15:25:53.116925 31765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:53.116587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46363 (local address 127.18.68.131:52841)
0810 15:25:53.116801 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:53.116872 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:46363: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":55,"threads_started":1}
I20260810 15:25:53.117111 31767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:53.116693 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46363 (local address 127.18.68.129:59895)
0810 15:25:53.117002 (+ 309us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:53.117073 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:46363: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":268,"thread_start_us":64,"threads_started":1}
W20260810 15:25:53.117281 31647 heartbeater.cc:644] Failed to heartbeat to 127.18.68.190:46363 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.18.68.190:46363: connect: Connection refused (error 111)
W20260810 15:25:53.117470 31174 heartbeater.cc:644] Failed to heartbeat to 127.18.68.190:46363 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.18.68.190:46363: connect: Connection refused (error 111)
I20260810 15:25:53.618847 31768 raft_consensus.cc:482] T 00000000000000000000000000000000 P 368b444be95f4679b16a674be8ad8be1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dc69d8e9c6814168941f833a163493a1)
I20260810 15:25:53.618989 31768 raft_consensus.cc:504] T 00000000000000000000000000000000 P 368b444be95f4679b16a674be8ad8be1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "dc69d8e9c6814168941f833a163493a1" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46363 } } peers { permanent_uuid: "368b444be95f4679b16a674be8ad8be1" member_type: VOTER last_known_addr { host: "127.18.68.189" port: 38325 } attrs { promote: false } } peers { permanent_uuid: "79b8b9b8839e47be8dd75bfe3818b5cd" member_type: VOTER last_known_addr { host: "127.18.68.188" port: 45629 } attrs { promote: false } }
I20260810 15:25:53.619271 31769 raft_consensus.cc:482] T 00000000000000000000000000000000 P 79b8b9b8839e47be8dd75bfe3818b5cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dc69d8e9c6814168941f833a163493a1)
I20260810 15:25:53.619343 31768 leader_election.cc:288] T 00000000000000000000000000000000 P 368b444be95f4679b16a674be8ad8be1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dc69d8e9c6814168941f833a163493a1 (127.18.68.190:46363), 79b8b9b8839e47be8dd75bfe3818b5cd (127.18.68.188:45629)
I20260810 15:25:53.619467 31769 raft_consensus.cc:504] T 00000000000000000000000000000000 P 79b8b9b8839e47be8dd75bfe3818b5cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "dc69d8e9c6814168941f833a163493a1" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46363 } } peers { permanent_uuid: "368b444be95f4679b16a674be8ad8be1" member_type: VOTER last_known_addr { host: "127.18.68.189" port: 38325 } attrs { promote: false } } peers { permanent_uuid: "79b8b9b8839e47be8dd75bfe3818b5cd" member_type: VOTER last_known_addr { host: "127.18.68.188" port: 45629 } attrs { promote: false } }
I20260810 15:25:53.619809 31769 leader_election.cc:288] T 00000000000000000000000000000000 P 79b8b9b8839e47be8dd75bfe3818b5cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dc69d8e9c6814168941f833a163493a1 (127.18.68.190:46363), 368b444be95f4679b16a674be8ad8be1 (127.18.68.189:38325)
I20260810 15:25:53.619910 31772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:53.619546 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46363 (local address 127.0.0.1:40050)
0810 15:25:53.619801 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:53.619861 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:46363: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":236,"thread_start_us":73,"threads_started":1}
W20260810 15:25:53.620078 30505 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.18.68.190:46363: connect: Connection refused (error 111)
I20260810 15:25:53.620133 31776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:53.619910 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46363 (local address 127.0.0.1:40062)
0810 15:25:53.620039 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:53.620094 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:46363: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":54,"threads_started":1}
W20260810 15:25:53.620262 30852 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.18.68.190:46363: connect: Connection refused (error 111)
I20260810 15:25:53.620605 31772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:53.620488 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46363 (local address 127.0.0.1:40064)
0810 15:25:53.620539 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:53.620572 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:46363: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260810 15:25:53.620702 30505 leader_election.cc:334] T 00000000000000000000000000000000 P 368b444be95f4679b16a674be8ad8be1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer dc69d8e9c6814168941f833a163493a1 (127.18.68.190:46363): Network error: Client connection negotiation failed: client connection to 127.18.68.190:46363: connect: Connection refused (error 111)
I20260810 15:25:53.620784 31776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:53.620682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46363 (local address 127.0.0.1:40076)
0810 15:25:53.620720 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:53.620751 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:46363: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":21}
W20260810 15:25:53.620872 30852 leader_election.cc:334] T 00000000000000000000000000000000 P 79b8b9b8839e47be8dd75bfe3818b5cd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer dc69d8e9c6814168941f833a163493a1 (127.18.68.190:46363): Network error: Client connection negotiation failed: client connection to 127.18.68.190:46363: connect: Connection refused (error 111)
I20260810 15:25:53.623780 31771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:53.619527 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.188:45629 (local address 127.0.0.1:59252)
0810 15:25:53.619713 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:53.619728 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:53.619816 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:53.620642 (+ 826us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:53.620644 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:53.620647 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:25:53.620887 (+ 240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:53.620891 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:53.621837 (+ 946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:53.621838 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:53.622807 (+ 969us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:53.622810 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:53.623496 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:53.623497 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:53.623569 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:53.623574 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 15:25:53.623648 (+ 74us) client_negotiation.cc:240] Negotiation successful
0810 15:25:53.623703 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":53,"threads_started":1}
I20260810 15:25:53.623842 31778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:53.620061 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.189:38325 (local address 127.0.0.1:57254)
0810 15:25:53.620154 (+ 93us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:53.620163 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:53.620216 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:53.620781 (+ 565us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:53.620782 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:53.620785 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:25:53.620863 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:53.620865 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:53.621861 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:53.621862 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:53.622722 (+ 860us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:53.622725 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:53.623496 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:53.623497 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:53.623613 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:53.623619 (+ 6us) client_negotiation.cc:769] Sending connection context
0810 15:25:53.623682 (+ 63us) client_negotiation.cc:240] Negotiation successful
0810 15:25:53.623725 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":78,"thread_start_us":48,"threads_started":1}
I20260810 15:25:53.623850 31774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:53.619653 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59252 (local address 127.18.68.188:45629)
0810 15:25:53.619753 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:53.619755 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:53.620137 (+ 382us) server_negotiation.cc:407] Connection header received
0810 15:25:53.620484 (+ 347us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:53.620485 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:53.620499 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:53.620617 (+ 118us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:25:53.620974 (+ 357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:53.621729 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:53.622889 (+ 1160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:53.623411 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:53.623474 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:53.623484 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:53.623702 (+ 218us) server_negotiation.cc:299] Negotiation successful
0810 15:25:53.623757 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76,"thread_start_us":49,"threads_started":1}
I20260810 15:25:53.623870 31781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:53.620298 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57254 (local address 127.18.68.189:38325)
0810 15:25:53.620423 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:53.620425 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:53.620433 (+ 8us) server_negotiation.cc:407] Connection header received
0810 15:25:53.620457 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:53.620457 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:53.620467 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:53.620930 (+ 463us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:25:53.620967 (+ 37us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:53.621753 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:53.622813 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:53.623396 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:53.623474 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:53.623484 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:53.623719 (+ 235us) server_negotiation.cc:299] Negotiation successful
0810 15:25:53.623767 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99,"thread_start_us":82,"threads_started":1}
I20260810 15:25:53.624297 30553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "79b8b9b8839e47be8dd75bfe3818b5cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "368b444be95f4679b16a674be8ad8be1" is_pre_election: true
I20260810 15:25:53.624298 30886 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "368b444be95f4679b16a674be8ad8be1" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "79b8b9b8839e47be8dd75bfe3818b5cd" is_pre_election: true
I20260810 15:25:53.624406 30886 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 79b8b9b8839e47be8dd75bfe3818b5cd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 368b444be95f4679b16a674be8ad8be1 in term 1.
I20260810 15:25:53.624406 30553 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 368b444be95f4679b16a674be8ad8be1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79b8b9b8839e47be8dd75bfe3818b5cd in term 1.
I20260810 15:25:53.624562 30502 leader_election.cc:302] T 00000000000000000000000000000000 P 368b444be95f4679b16a674be8ad8be1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 368b444be95f4679b16a674be8ad8be1, 79b8b9b8839e47be8dd75bfe3818b5cd; no voters: dc69d8e9c6814168941f833a163493a1
I20260810 15:25:53.624660 30852 leader_election.cc:302] T 00000000000000000000000000000000 P 79b8b9b8839e47be8dd75bfe3818b5cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 368b444be95f4679b16a674be8ad8be1, 79b8b9b8839e47be8dd75bfe3818b5cd; no voters: dc69d8e9c6814168941f833a163493a1
I20260810 15:25:53.624704 31768 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 368b444be95f4679b16a674be8ad8be1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260810 15:25:53.624737 31768 raft_consensus.cc:482] T 00000000000000000000000000000000 P 368b444be95f4679b16a674be8ad8be1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader dc69d8e9c6814168941f833a163493a1)
I20260810 15:25:53.624758 31768 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 368b444be95f4679b16a674be8ad8be1 [term 1 FOLLOWER]: Advancing to term 2
I20260810 15:25:53.624783 31769 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 79b8b9b8839e47be8dd75bfe3818b5cd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260810 15:25:53.624842 31769 raft_consensus.cc:482] T 00000000000000000000000000000000 P 79b8b9b8839e47be8dd75bfe3818b5cd [term 1 FOLLOWER]: Starting leader election (detected failure of leader dc69d8e9c6814168941f833a163493a1)
I20260810 15:25:53.624877 31769 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 79b8b9b8839e47be8dd75bfe3818b5cd [term 1 FOLLOWER]: Advancing to term 2
I20260810 15:25:53.625486 31768 raft_consensus.cc:504] T 00000000000000000000000000000000 P 368b444be95f4679b16a674be8ad8be1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "dc69d8e9c6814168941f833a163493a1" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46363 } } peers { permanent_uuid: "368b444be95f4679b16a674be8ad8be1" member_type: VOTER last_known_addr { host: "127.18.68.189" port: 38325 } attrs { promote: false } } peers { permanent_uuid: "79b8b9b8839e47be8dd75bfe3818b5cd" member_type: VOTER last_known_addr { host: "127.18.68.188" port: 45629 } attrs { promote: false } }
I20260810 15:25:53.625623 31768 leader_election.cc:288] T 00000000000000000000000000000000 P 368b444be95f4679b16a674be8ad8be1 [CANDIDATE]: Term 2 election: Requested vote from peers dc69d8e9c6814168941f833a163493a1 (127.18.68.190:46363), 79b8b9b8839e47be8dd75bfe3818b5cd (127.18.68.188:45629)
I20260810 15:25:53.625666 31769 raft_consensus.cc:504] T 00000000000000000000000000000000 P 79b8b9b8839e47be8dd75bfe3818b5cd [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "dc69d8e9c6814168941f833a163493a1" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46363 } } peers { permanent_uuid: "368b444be95f4679b16a674be8ad8be1" member_type: VOTER last_known_addr { host: "127.18.68.189" port: 38325 } attrs { promote: false } } peers { permanent_uuid: "79b8b9b8839e47be8dd75bfe3818b5cd" member_type: VOTER last_known_addr { host: "127.18.68.188" port: 45629 } attrs { promote: false } }
I20260810 15:25:53.625818 31769 leader_election.cc:288] T 00000000000000000000000000000000 P 79b8b9b8839e47be8dd75bfe3818b5cd [CANDIDATE]: Term 2 election: Requested vote from peers dc69d8e9c6814168941f833a163493a1 (127.18.68.190:46363), 368b444be95f4679b16a674be8ad8be1 (127.18.68.189:38325)
I20260810 15:25:53.625888 31771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:53.625706 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46363 (local address 127.0.0.1:40082)
0810 15:25:53.625821 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:53.625857 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:46363: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93}
I20260810 15:25:53.625820 30886 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "368b444be95f4679b16a674be8ad8be1" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "79b8b9b8839e47be8dd75bfe3818b5cd"
I20260810 15:25:53.625949 30886 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 79b8b9b8839e47be8dd75bfe3818b5cd [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 368b444be95f4679b16a674be8ad8be1 in current term 2: Already voted for candidate 79b8b9b8839e47be8dd75bfe3818b5cd in this term.
I20260810 15:25:53.626045 30553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "79b8b9b8839e47be8dd75bfe3818b5cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "368b444be95f4679b16a674be8ad8be1"
I20260810 15:25:53.626144 31778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:53.625913 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46363 (local address 127.0.0.1:40094)
0810 15:25:53.626089 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:53.626117 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:46363: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":160}
I20260810 15:25:53.626160 30553 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 368b444be95f4679b16a674be8ad8be1 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 79b8b9b8839e47be8dd75bfe3818b5cd in current term 2: Already voted for candidate 368b444be95f4679b16a674be8ad8be1 in this term.
I20260810 15:25:53.626446 31771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:53.626211 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46363 (local address 127.0.0.1:40100)
0810 15:25:53.626364 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:53.626398 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:46363: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":138}
I20260810 15:25:53.626531 31778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:53.626400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46363 (local address 127.0.0.1:40104)
0810 15:25:53.626459 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:53.626490 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:46363: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260810 15:25:53.626544 30505 leader_election.cc:334] T 00000000000000000000000000000000 P 368b444be95f4679b16a674be8ad8be1 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer dc69d8e9c6814168941f833a163493a1 (127.18.68.190:46363): Network error: Client connection negotiation failed: client connection to 127.18.68.190:46363: connect: Connection refused (error 111)
I20260810 15:25:53.626603 30505 leader_election.cc:302] T 00000000000000000000000000000000 P 368b444be95f4679b16a674be8ad8be1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 368b444be95f4679b16a674be8ad8be1; no voters: 79b8b9b8839e47be8dd75bfe3818b5cd, dc69d8e9c6814168941f833a163493a1
I20260810 15:25:53.626693 31768 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 368b444be95f4679b16a674be8ad8be1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260810 15:25:53.626724 30852 leader_election.cc:334] T 00000000000000000000000000000000 P 79b8b9b8839e47be8dd75bfe3818b5cd [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer dc69d8e9c6814168941f833a163493a1 (127.18.68.190:46363): Network error: Client connection negotiation failed: client connection to 127.18.68.190:46363: connect: Connection refused (error 111)
I20260810 15:25:53.626780 30852 leader_election.cc:302] T 00000000000000000000000000000000 P 79b8b9b8839e47be8dd75bfe3818b5cd [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79b8b9b8839e47be8dd75bfe3818b5cd; no voters: 368b444be95f4679b16a674be8ad8be1, dc69d8e9c6814168941f833a163493a1
I20260810 15:25:53.626848 31769 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 79b8b9b8839e47be8dd75bfe3818b5cd [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260810 15:25:54.117327 31784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:54.117050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46363 (local address 127.18.68.130:52691)
0810 15:25:54.117213 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:54.117264 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:46363: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":85,"threads_started":1}
I20260810 15:25:54.117930 31786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:54.117637 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46363 (local address 127.18.68.131:45877)
0810 15:25:54.117865 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:54.117894 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:46363: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":77,"threads_started":1}
I20260810 15:25:54.117945 31787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:54.117750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46363 (local address 127.18.68.129:60677)
0810 15:25:54.117872 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:54.117908 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:46363: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":61,"threads_started":1}
I20260810 15:25:55.118202 31789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:55.117931 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46363 (local address 127.18.68.130:36615)
0810 15:25:55.118083 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:55.118135 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:46363: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":76,"threads_started":1}
I20260810 15:25:55.118551 31791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:55.118376 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46363 (local address 127.18.68.131:32823)
0810 15:25:55.118472 (+ 96us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:55.118496 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:46363: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83,"thread_start_us":50,"threads_started":1}
I20260810 15:25:55.118573 31790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:55.118341 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46363 (local address 127.18.68.129:60761)
0810 15:25:55.118458 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:55.118490 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:46363: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":48,"threads_started":1}
I20260810 15:25:55.297924 31792 raft_consensus.cc:482] T 00000000000000000000000000000000 P 79b8b9b8839e47be8dd75bfe3818b5cd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 15:25:55.298035 31792 raft_consensus.cc:504] T 00000000000000000000000000000000 P 79b8b9b8839e47be8dd75bfe3818b5cd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "dc69d8e9c6814168941f833a163493a1" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46363 } } peers { permanent_uuid: "368b444be95f4679b16a674be8ad8be1" member_type: VOTER last_known_addr { host: "127.18.68.189" port: 38325 } attrs { promote: false } } peers { permanent_uuid: "79b8b9b8839e47be8dd75bfe3818b5cd" member_type: VOTER last_known_addr { host: "127.18.68.188" port: 45629 } attrs { promote: false } }
I20260810 15:25:55.298236 31792 leader_election.cc:288] T 00000000000000000000000000000000 P 79b8b9b8839e47be8dd75bfe3818b5cd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dc69d8e9c6814168941f833a163493a1 (127.18.68.190:46363), 368b444be95f4679b16a674be8ad8be1 (127.18.68.189:38325)
I20260810 15:25:55.298691 31794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:55.298423 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46363 (local address 127.0.0.1:40334)
0810 15:25:55.298543 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:55.298629 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:46363: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":71,"threads_started":1}
I20260810 15:25:55.298756 30553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "79b8b9b8839e47be8dd75bfe3818b5cd" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "368b444be95f4679b16a674be8ad8be1" is_pre_election: true
I20260810 15:25:55.298879 30553 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 368b444be95f4679b16a674be8ad8be1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79b8b9b8839e47be8dd75bfe3818b5cd in term 2.
I20260810 15:25:55.299206 30852 leader_election.cc:302] T 00000000000000000000000000000000 P 79b8b9b8839e47be8dd75bfe3818b5cd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 368b444be95f4679b16a674be8ad8be1, 79b8b9b8839e47be8dd75bfe3818b5cd; no voters:
I20260810 15:25:55.299263 31794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:55.299134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46363 (local address 127.0.0.1:40344)
0810 15:25:55.299188 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:55.299219 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:46363: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260810 15:25:55.299333 30852 leader_election.cc:334] T 00000000000000000000000000000000 P 79b8b9b8839e47be8dd75bfe3818b5cd [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer dc69d8e9c6814168941f833a163493a1 (127.18.68.190:46363): Network error: Client connection negotiation failed: client connection to 127.18.68.190:46363: connect: Connection refused (error 111)
I20260810 15:25:55.299340 31792 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 79b8b9b8839e47be8dd75bfe3818b5cd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260810 15:25:55.299430 31792 raft_consensus.cc:482] T 00000000000000000000000000000000 P 79b8b9b8839e47be8dd75bfe3818b5cd [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 15:25:55.299463 31792 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 79b8b9b8839e47be8dd75bfe3818b5cd [term 2 FOLLOWER]: Advancing to term 3
I20260810 15:25:55.300222 31792 raft_consensus.cc:504] T 00000000000000000000000000000000 P 79b8b9b8839e47be8dd75bfe3818b5cd [term 3 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "dc69d8e9c6814168941f833a163493a1" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46363 } } peers { permanent_uuid: "368b444be95f4679b16a674be8ad8be1" member_type: VOTER last_known_addr { host: "127.18.68.189" port: 38325 } attrs { promote: false } } peers { permanent_uuid: "79b8b9b8839e47be8dd75bfe3818b5cd" member_type: VOTER last_known_addr { host: "127.18.68.188" port: 45629 } attrs { promote: false } }
I20260810 15:25:55.300376 31792 leader_election.cc:288] T 00000000000000000000000000000000 P 79b8b9b8839e47be8dd75bfe3818b5cd [CANDIDATE]: Term 3 election: Requested vote from peers dc69d8e9c6814168941f833a163493a1 (127.18.68.190:46363), 368b444be95f4679b16a674be8ad8be1 (127.18.68.189:38325)
I20260810 15:25:55.300545 31794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:55.300456 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46363 (local address 127.0.0.1:40352)
0810 15:25:55.300491 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:55.300519 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:46363: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":18}
I20260810 15:25:55.300673 30553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "79b8b9b8839e47be8dd75bfe3818b5cd" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "368b444be95f4679b16a674be8ad8be1"
I20260810 15:25:55.300782 30553 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 368b444be95f4679b16a674be8ad8be1 [term 2 FOLLOWER]: Advancing to term 3
I20260810 15:25:55.300889 31794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:55.300812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46363 (local address 127.0.0.1:40368)
0810 15:25:55.300847 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:55.300868 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:46363: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
W20260810 15:25:55.300979 30852 leader_election.cc:334] T 00000000000000000000000000000000 P 79b8b9b8839e47be8dd75bfe3818b5cd [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer dc69d8e9c6814168941f833a163493a1 (127.18.68.190:46363): Network error: Client connection negotiation failed: client connection to 127.18.68.190:46363: connect: Connection refused (error 111)
I20260810 15:25:55.301523 30553 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 368b444be95f4679b16a674be8ad8be1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79b8b9b8839e47be8dd75bfe3818b5cd in term 3.
I20260810 15:25:55.301752 30852 leader_election.cc:302] T 00000000000000000000000000000000 P 79b8b9b8839e47be8dd75bfe3818b5cd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 368b444be95f4679b16a674be8ad8be1, 79b8b9b8839e47be8dd75bfe3818b5cd; no voters: dc69d8e9c6814168941f833a163493a1
I20260810 15:25:55.301854 31792 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 79b8b9b8839e47be8dd75bfe3818b5cd [term 3 FOLLOWER]: Leader election won for term 3
I20260810 15:25:55.301977 31792 raft_consensus.cc:686] T 00000000000000000000000000000000 P 79b8b9b8839e47be8dd75bfe3818b5cd [term 3 LEADER]: Becoming Leader. State: Replica: 79b8b9b8839e47be8dd75bfe3818b5cd, State: Running, Role: LEADER
I20260810 15:25:55.302134 31792 consensus_queue.cc:237] T 00000000000000000000000000000000 P 79b8b9b8839e47be8dd75bfe3818b5cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "dc69d8e9c6814168941f833a163493a1" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46363 } } peers { permanent_uuid: "368b444be95f4679b16a674be8ad8be1" member_type: VOTER last_known_addr { host: "127.18.68.189" port: 38325 } attrs { promote: false } } peers { permanent_uuid: "79b8b9b8839e47be8dd75bfe3818b5cd" member_type: VOTER last_known_addr { host: "127.18.68.188" port: 45629 } attrs { promote: false } }
I20260810 15:25:55.302529 31798 sys_catalog.cc:455] T 00000000000000000000000000000000 P 79b8b9b8839e47be8dd75bfe3818b5cd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 79b8b9b8839e47be8dd75bfe3818b5cd. Latest consensus state: current_term: 3 leader_uuid: "79b8b9b8839e47be8dd75bfe3818b5cd" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "dc69d8e9c6814168941f833a163493a1" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46363 } } peers { permanent_uuid: "368b444be95f4679b16a674be8ad8be1" member_type: VOTER last_known_addr { host: "127.18.68.189" port: 38325 } attrs { promote: false } } peers { permanent_uuid: "79b8b9b8839e47be8dd75bfe3818b5cd" member_type: VOTER last_known_addr { host: "127.18.68.188" port: 45629 } attrs { promote: false } } }
I20260810 15:25:55.302626 31798 sys_catalog.cc:458] T 00000000000000000000000000000000 P 79b8b9b8839e47be8dd75bfe3818b5cd [sys.catalog]: This master's current role is: LEADER
I20260810 15:25:55.302842 31800 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 15:25:55.303261 31800 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 15:25:55.303324 31800 catalog_manager.cc:1259] Loaded cluster ID: 282c713ec3e04fc6b63b8a8f3178953f
I20260810 15:25:55.303378 31800 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 15:25:55.303568 31800 catalog_manager.cc:1504] Loading token signing keys...
I20260810 15:25:55.303637 31800 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 79b8b9b8839e47be8dd75bfe3818b5cd: Loaded TSK: 0
I20260810 15:25:55.303819 31800 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 15:25:55.326719 30876 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59240:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 15:25:55.328362 30876 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 15:25:55.329488 31794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:55.329349 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46363 (local address 127.0.0.1:40386)
0810 15:25:55.329413 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:55.329458 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:46363: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260810 15:25:55.329490 30553 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 368b444be95f4679b16a674be8ad8be1 [term 3 FOLLOWER]: Refusing update from remote peer 79b8b9b8839e47be8dd75bfe3818b5cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 3 index: 14. (index mismatch)
I20260810 15:25:55.329741 31792 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 79b8b9b8839e47be8dd75bfe3818b5cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "368b444be95f4679b16a674be8ad8be1" member_type: VOTER last_known_addr { host: "127.18.68.189" port: 38325 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260810 15:25:55.329842 31794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:55.329775 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46363 (local address 127.0.0.1:40390)
0810 15:25:55.329801 (+ 26us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:55.329826 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:46363: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":15}
W20260810 15:25:55.329950 30852 consensus_peers.cc:487] T 00000000000000000000000000000000 P 79b8b9b8839e47be8dd75bfe3818b5cd -> Peer dc69d8e9c6814168941f833a163493a1 (127.18.68.190:46363): Couldn't send request to peer dc69d8e9c6814168941f833a163493a1. Status: Network error: Client connection negotiation failed: client connection to 127.18.68.190:46363: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260810 15:25:55.330538 31802 sys_catalog.cc:455] T 00000000000000000000000000000000 P 368b444be95f4679b16a674be8ad8be1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 79b8b9b8839e47be8dd75bfe3818b5cd. Latest consensus state: current_term: 3 leader_uuid: "79b8b9b8839e47be8dd75bfe3818b5cd" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "dc69d8e9c6814168941f833a163493a1" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46363 } } peers { permanent_uuid: "368b444be95f4679b16a674be8ad8be1" member_type: VOTER last_known_addr { host: "127.18.68.189" port: 38325 } attrs { promote: false } } peers { permanent_uuid: "79b8b9b8839e47be8dd75bfe3818b5cd" member_type: VOTER last_known_addr { host: "127.18.68.188" port: 45629 } attrs { promote: false } } }
I20260810 15:25:55.330672 31802 sys_catalog.cc:458] T 00000000000000000000000000000000 P 368b444be95f4679b16a674be8ad8be1 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 15:25:55.331207 31798 sys_catalog.cc:455] T 00000000000000000000000000000000 P 79b8b9b8839e47be8dd75bfe3818b5cd [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "79b8b9b8839e47be8dd75bfe3818b5cd" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "dc69d8e9c6814168941f833a163493a1" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46363 } } peers { permanent_uuid: "368b444be95f4679b16a674be8ad8be1" member_type: VOTER last_known_addr { host: "127.18.68.189" port: 38325 } attrs { promote: false } } peers { permanent_uuid: "79b8b9b8839e47be8dd75bfe3818b5cd" member_type: VOTER last_known_addr { host: "127.18.68.188" port: 45629 } attrs { promote: false } } }
I20260810 15:25:55.331314 31798 sys_catalog.cc:458] T 00000000000000000000000000000000 P 79b8b9b8839e47be8dd75bfe3818b5cd [sys.catalog]: This master's current role is: LEADER
I20260810 15:25:55.331348 31802 sys_catalog.cc:455] T 00000000000000000000000000000000 P 368b444be95f4679b16a674be8ad8be1 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "79b8b9b8839e47be8dd75bfe3818b5cd" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "dc69d8e9c6814168941f833a163493a1" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46363 } } peers { permanent_uuid: "368b444be95f4679b16a674be8ad8be1" member_type: VOTER last_known_addr { host: "127.18.68.189" port: 38325 } attrs { promote: false } } peers { permanent_uuid: "79b8b9b8839e47be8dd75bfe3818b5cd" member_type: VOTER last_known_addr { host: "127.18.68.188" port: 45629 } attrs { promote: false } } }
I20260810 15:25:55.331451 31802 sys_catalog.cc:458] T 00000000000000000000000000000000 P 368b444be95f4679b16a674be8ad8be1 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 15:25:55.337085 31818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:55.333751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46180 (local address 127.18.68.131:42797)
0810 15:25:55.333883 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:55.333885 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:55.333894 (+ 9us) server_negotiation.cc:407] Connection header received
0810 15:25:55.333922 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:55.333923 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:55.333934 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:55.334009 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:25:55.334280 (+ 271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:55.334867 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:55.336345 (+ 1478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:55.336715 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:55.336799 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:55.336811 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:55.336970 (+ 159us) server_negotiation.cc:299] Negotiation successful
0810 15:25:55.337012 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":107,"thread_start_us":75,"threads_started":1}
I20260810 15:25:55.337075 31794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:55.333528 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.131:42797 (local address 127.0.0.1:46180)
0810 15:25:55.333583 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:55.333594 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:55.333652 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:55.334014 (+ 362us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:55.334016 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:55.334017 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:25:55.334101 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:55.334103 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:55.334956 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:55.334957 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:55.336068 (+ 1111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:55.336070 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:55.336810 (+ 740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:55.336811 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:55.336875 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:55.336879 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 15:25:55.336961 (+ 82us) client_negotiation.cc:240] Negotiation successful
0810 15:25:55.337006 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260810 15:25:55.337375 31811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:55.333549 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.129:38595 (local address 127.0.0.1:35960)
0810 15:25:55.333844 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:55.333855 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:55.333915 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:55.334121 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:55.334122 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:55.334124 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:25:55.334181 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:55.334183 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:55.335213 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:55.335213 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:55.336269 (+ 1056us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:55.336270 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:55.337098 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:55.337099 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:55.337165 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:55.337170 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 15:25:55.337251 (+ 81us) client_negotiation.cc:240] Negotiation successful
0810 15:25:55.337295 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":272,"mutex_wait_us":35,"thread_start_us":84,"threads_started":1}
I20260810 15:25:55.337400 31813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:55.333615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35960 (local address 127.18.68.129:38595)
0810 15:25:55.333791 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:55.333794 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:55.333974 (+ 180us) server_negotiation.cc:407] Connection header received
0810 15:25:55.334003 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:55.334004 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:55.334015 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:55.334116 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:25:55.334257 (+ 141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:55.335125 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:55.336350 (+ 1225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:55.336973 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:55.337041 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:55.337053 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:55.337272 (+ 219us) server_negotiation.cc:299] Negotiation successful
0810 15:25:55.337325 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":153,"thread_start_us":77,"threads_started":1}
I20260810 15:25:55.337543 31538 tablet_service.cc:1467] Processing CreateTablet for tablet 152aa575b30e4abfa8acd1f6b5ded2c2 (DEFAULT_TABLE table=test-table [id=708123b96287440a8b34999fc0513651]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 15:25:55.337697 31538 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 152aa575b30e4abfa8acd1f6b5ded2c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:25:55.338048 31814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:55.333635 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.130:45317 (local address 127.0.0.1:57396)
0810 15:25:55.334180 (+ 545us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:55.334191 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:55.334241 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:55.334395 (+ 154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:55.334396 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:55.334397 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:25:55.334437 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:55.334438 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:55.335374 (+ 936us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:55.335376 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:55.336627 (+ 1251us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:55.336630 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:55.337820 (+ 1190us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:55.337821 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:55.337887 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:55.337891 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 15:25:55.337951 (+ 60us) client_negotiation.cc:240] Negotiation successful
0810 15:25:55.337988 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":525,"thread_start_us":94,"threads_started":1}
I20260810 15:25:55.338050 31816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:55.333731 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57396 (local address 127.18.68.130:45317)
0810 15:25:55.333860 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:55.333862 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:55.334239 (+ 377us) server_negotiation.cc:407] Connection header received
0810 15:25:55.334302 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:55.334303 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:55.334315 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:55.334384 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:25:55.334494 (+ 110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:55.335277 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:55.336732 (+ 1455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:55.337737 (+ 1005us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:55.337821 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:55.337832 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:55.337956 (+ 124us) server_negotiation.cc:299] Negotiation successful
0810 15:25:55.337987 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":103,"thread_start_us":66,"threads_started":1}
I20260810 15:25:55.338353 31057 tablet_service.cc:1467] Processing CreateTablet for tablet 152aa575b30e4abfa8acd1f6b5ded2c2 (DEFAULT_TABLE table=test-table [id=708123b96287440a8b34999fc0513651]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 15:25:55.338474 31057 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 152aa575b30e4abfa8acd1f6b5ded2c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:25:55.339258 31820 tablet_bootstrap.cc:492] T 152aa575b30e4abfa8acd1f6b5ded2c2 P 92842de48966403c9acb8cbb06797670: Bootstrap starting.
I20260810 15:25:55.339622 31297 tablet_service.cc:1467] Processing CreateTablet for tablet 152aa575b30e4abfa8acd1f6b5ded2c2 (DEFAULT_TABLE table=test-table [id=708123b96287440a8b34999fc0513651]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 15:25:55.339691 31820 tablet_bootstrap.cc:654] T 152aa575b30e4abfa8acd1f6b5ded2c2 P 92842de48966403c9acb8cbb06797670: Neither blocks nor log segments found. Creating new log.
I20260810 15:25:55.339746 31297 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 152aa575b30e4abfa8acd1f6b5ded2c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:25:55.340335 31820 tablet_bootstrap.cc:492] T 152aa575b30e4abfa8acd1f6b5ded2c2 P 92842de48966403c9acb8cbb06797670: No bootstrap required, opened a new log
I20260810 15:25:55.340384 31820 ts_tablet_manager.cc:1397] T 152aa575b30e4abfa8acd1f6b5ded2c2 P 92842de48966403c9acb8cbb06797670: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260810 15:25:55.340574 31820 raft_consensus.cc:348] T 152aa575b30e4abfa8acd1f6b5ded2c2 P 92842de48966403c9acb8cbb06797670 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92842de48966403c9acb8cbb06797670" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 42797 } } peers { permanent_uuid: "aa343e60e15a4e3fb24f49dbb3aa37b3" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 38595 } } peers { permanent_uuid: "a69ecd14acce486bbad8a4d162d66996" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 45317 } }
I20260810 15:25:55.340663 31820 raft_consensus.cc:374] T 152aa575b30e4abfa8acd1f6b5ded2c2 P 92842de48966403c9acb8cbb06797670 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:25:55.340680 31820 raft_consensus.cc:729] T 152aa575b30e4abfa8acd1f6b5ded2c2 P 92842de48966403c9acb8cbb06797670 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92842de48966403c9acb8cbb06797670, State: Initialized, Role: FOLLOWER
I20260810 15:25:55.340757 31820 consensus_queue.cc:260] T 152aa575b30e4abfa8acd1f6b5ded2c2 P 92842de48966403c9acb8cbb06797670 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92842de48966403c9acb8cbb06797670" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 42797 } } peers { permanent_uuid: "aa343e60e15a4e3fb24f49dbb3aa37b3" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 38595 } } peers { permanent_uuid: "a69ecd14acce486bbad8a4d162d66996" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 45317 } }
I20260810 15:25:55.341019 31820 ts_tablet_manager.cc:1428] T 152aa575b30e4abfa8acd1f6b5ded2c2 P 92842de48966403c9acb8cbb06797670: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260810 15:25:55.341351 31826 tablet_bootstrap.cc:492] T 152aa575b30e4abfa8acd1f6b5ded2c2 P a69ecd14acce486bbad8a4d162d66996: Bootstrap starting.
I20260810 15:25:55.341485 31791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:55.341130 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46363 (local address 127.18.68.131:60191)
0810 15:25:55.341428 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:55.341460 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:46363: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":281}
I20260810 15:25:55.341667 31646 heartbeater.cc:503] Master 127.18.68.188:45629 was elected leader, sending a full tablet report...
I20260810 15:25:55.341812 31826 tablet_bootstrap.cc:654] T 152aa575b30e4abfa8acd1f6b5ded2c2 P a69ecd14acce486bbad8a4d162d66996: Neither blocks nor log segments found. Creating new log.
I20260810 15:25:55.342268 31791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:55.342182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46363 (local address 127.18.68.131:37333)
0810 15:25:55.342216 (+ 34us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:55.342244 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:46363: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":17}
I20260810 15:25:55.342465 31826 tablet_bootstrap.cc:492] T 152aa575b30e4abfa8acd1f6b5ded2c2 P a69ecd14acce486bbad8a4d162d66996: No bootstrap required, opened a new log
I20260810 15:25:55.342514 31826 ts_tablet_manager.cc:1397] T 152aa575b30e4abfa8acd1f6b5ded2c2 P a69ecd14acce486bbad8a4d162d66996: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260810 15:25:55.342643 31823 tablet_bootstrap.cc:492] T 152aa575b30e4abfa8acd1f6b5ded2c2 P aa343e60e15a4e3fb24f49dbb3aa37b3: Bootstrap starting.
I20260810 15:25:55.342660 31826 raft_consensus.cc:348] T 152aa575b30e4abfa8acd1f6b5ded2c2 P a69ecd14acce486bbad8a4d162d66996 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92842de48966403c9acb8cbb06797670" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 42797 } } peers { permanent_uuid: "aa343e60e15a4e3fb24f49dbb3aa37b3" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 38595 } } peers { permanent_uuid: "a69ecd14acce486bbad8a4d162d66996" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 45317 } }
I20260810 15:25:55.342746 31826 raft_consensus.cc:374] T 152aa575b30e4abfa8acd1f6b5ded2c2 P a69ecd14acce486bbad8a4d162d66996 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:25:55.342785 31826 raft_consensus.cc:729] T 152aa575b30e4abfa8acd1f6b5ded2c2 P a69ecd14acce486bbad8a4d162d66996 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a69ecd14acce486bbad8a4d162d66996, State: Initialized, Role: FOLLOWER
I20260810 15:25:55.342839 31826 consensus_queue.cc:260] T 152aa575b30e4abfa8acd1f6b5ded2c2 P a69ecd14acce486bbad8a4d162d66996 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92842de48966403c9acb8cbb06797670" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 42797 } } peers { permanent_uuid: "aa343e60e15a4e3fb24f49dbb3aa37b3" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 38595 } } peers { permanent_uuid: "a69ecd14acce486bbad8a4d162d66996" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 45317 } }
I20260810 15:25:55.343039 31826 ts_tablet_manager.cc:1428] T 152aa575b30e4abfa8acd1f6b5ded2c2 P a69ecd14acce486bbad8a4d162d66996: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260810 15:25:55.343094 31823 tablet_bootstrap.cc:654] T 152aa575b30e4abfa8acd1f6b5ded2c2 P aa343e60e15a4e3fb24f49dbb3aa37b3: Neither blocks nor log segments found. Creating new log.
I20260810 15:25:55.343443 31789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:55.343270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46363 (local address 127.18.68.130:60685)
0810 15:25:55.343381 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:55.343409 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:46363: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94}
I20260810 15:25:55.343621 31823 tablet_bootstrap.cc:492] T 152aa575b30e4abfa8acd1f6b5ded2c2 P aa343e60e15a4e3fb24f49dbb3aa37b3: No bootstrap required, opened a new log
I20260810 15:25:55.343683 31823 ts_tablet_manager.cc:1397] T 152aa575b30e4abfa8acd1f6b5ded2c2 P aa343e60e15a4e3fb24f49dbb3aa37b3: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260810 15:25:55.343834 31823 raft_consensus.cc:348] T 152aa575b30e4abfa8acd1f6b5ded2c2 P aa343e60e15a4e3fb24f49dbb3aa37b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92842de48966403c9acb8cbb06797670" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 42797 } } peers { permanent_uuid: "aa343e60e15a4e3fb24f49dbb3aa37b3" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 38595 } } peers { permanent_uuid: "a69ecd14acce486bbad8a4d162d66996" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 45317 } }
I20260810 15:25:55.343923 31823 raft_consensus.cc:374] T 152aa575b30e4abfa8acd1f6b5ded2c2 P aa343e60e15a4e3fb24f49dbb3aa37b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:25:55.343976 31823 raft_consensus.cc:729] T 152aa575b30e4abfa8acd1f6b5ded2c2 P aa343e60e15a4e3fb24f49dbb3aa37b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa343e60e15a4e3fb24f49dbb3aa37b3, State: Initialized, Role: FOLLOWER
I20260810 15:25:55.344023 31823 consensus_queue.cc:260] T 152aa575b30e4abfa8acd1f6b5ded2c2 P aa343e60e15a4e3fb24f49dbb3aa37b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92842de48966403c9acb8cbb06797670" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 42797 } } peers { permanent_uuid: "aa343e60e15a4e3fb24f49dbb3aa37b3" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 38595 } } peers { permanent_uuid: "a69ecd14acce486bbad8a4d162d66996" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 45317 } }
I20260810 15:25:55.344079 31789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:55.343881 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46363 (local address 127.18.68.130:54521)
0810 15:25:55.344025 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:55.344055 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:46363: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129}
I20260810 15:25:55.344221 31823 ts_tablet_manager.cc:1428] T 152aa575b30e4abfa8acd1f6b5ded2c2 P aa343e60e15a4e3fb24f49dbb3aa37b3: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260810 15:25:55.344512 31790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:55.344381 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46363 (local address 127.18.68.129:44599)
0810 15:25:55.344423 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:55.344456 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:46363: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
I20260810 15:25:55.344796 31173 heartbeater.cc:503] Master 127.18.68.188:45629 was elected leader, sending a full tablet report...
I20260810 15:25:55.344882 31790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:55.344727 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46363 (local address 127.18.68.129:38811)
0810 15:25:55.344766 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:55.344798 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:46363: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":21}
W20260810 15:25:55.432864 31176 tablet.cc:2369] T 152aa575b30e4abfa8acd1f6b5ded2c2 P aa343e60e15a4e3fb24f49dbb3aa37b3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 15:25:55.451151 31825 raft_consensus.cc:482] T 152aa575b30e4abfa8acd1f6b5ded2c2 P 92842de48966403c9acb8cbb06797670 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 15:25:55.451263 31825 raft_consensus.cc:504] T 152aa575b30e4abfa8acd1f6b5ded2c2 P 92842de48966403c9acb8cbb06797670 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92842de48966403c9acb8cbb06797670" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 42797 } } peers { permanent_uuid: "aa343e60e15a4e3fb24f49dbb3aa37b3" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 38595 } } peers { permanent_uuid: "a69ecd14acce486bbad8a4d162d66996" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 45317 } }
I20260810 15:25:55.451606 31825 leader_election.cc:288] T 152aa575b30e4abfa8acd1f6b5ded2c2 P 92842de48966403c9acb8cbb06797670 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa343e60e15a4e3fb24f49dbb3aa37b3 (127.18.68.129:38595), a69ecd14acce486bbad8a4d162d66996 (127.18.68.130:45317)
I20260810 15:25:55.454473 31813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:55.451838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.131:45467 (local address 127.18.68.129:38595)
0810 15:25:55.451884 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:55.451886 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:55.451895 (+ 9us) server_negotiation.cc:407] Connection header received
0810 15:25:55.451954 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:55.451955 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:55.451967 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:55.452044 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:25:55.452222 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:55.452715 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:55.453687 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:55.454052 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:55.454197 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:55.454209 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:55.454369 (+ 160us) server_negotiation.cc:299] Negotiation successful
0810 15:25:55.454410 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260810 15:25:55.454473 31791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:55.451765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.129:38595 (local address 127.18.68.131:45467)
0810 15:25:55.451825 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:55.451838 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:55.451896 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:55.452049 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:55.452050 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:55.452052 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:25:55.452138 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:55.452140 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:55.452803 (+ 663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:55.452804 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:55.453578 (+ 774us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:55.453580 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:55.454202 (+ 622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:55.454203 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:55.454280 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:55.454284 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 15:25:55.454349 (+ 65us) client_negotiation.cc:240] Negotiation successful
0810 15:25:55.454394 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40}
I20260810 15:25:55.454649 31816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:55.451874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.131:39303 (local address 127.18.68.130:45317)
0810 15:25:55.451930 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:55.451932 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:55.452090 (+ 158us) server_negotiation.cc:407] Connection header received
0810 15:25:55.452160 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:55.452161 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:55.452170 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:55.452243 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:25:55.452414 (+ 171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:55.452887 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:55.453847 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:55.454271 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:55.454352 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:55.454362 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:55.454544 (+ 182us) server_negotiation.cc:299] Negotiation successful
0810 15:25:55.454581 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260810 15:25:55.454663 31836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:55.451795 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.130:45317 (local address 127.18.68.131:39303)
0810 15:25:55.452004 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:55.452013 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:55.452096 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:55.452261 (+ 165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:55.452261 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:55.452263 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:25:55.452339 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:55.452340 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:55.452979 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:55.452980 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:55.453744 (+ 764us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:55.453746 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:55.454392 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:55.454394 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:55.454454 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:55.454457 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 15:25:55.454533 (+ 76us) client_negotiation.cc:240] Negotiation successful
0810 15:25:55.454581 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":133,"threads_started":1}
I20260810 15:25:55.454787 31094 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "152aa575b30e4abfa8acd1f6b5ded2c2" candidate_uuid: "92842de48966403c9acb8cbb06797670" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa343e60e15a4e3fb24f49dbb3aa37b3" is_pre_election: true
I20260810 15:25:55.454907 31094 raft_consensus.cc:2454] T 152aa575b30e4abfa8acd1f6b5ded2c2 P aa343e60e15a4e3fb24f49dbb3aa37b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92842de48966403c9acb8cbb06797670 in term 0.
I20260810 15:25:55.454928 31331 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "152aa575b30e4abfa8acd1f6b5ded2c2" candidate_uuid: "92842de48966403c9acb8cbb06797670" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a69ecd14acce486bbad8a4d162d66996" is_pre_election: true
I20260810 15:25:55.455075 31331 raft_consensus.cc:2454] T 152aa575b30e4abfa8acd1f6b5ded2c2 P a69ecd14acce486bbad8a4d162d66996 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92842de48966403c9acb8cbb06797670 in term 0.
I20260810 15:25:55.455123 31457 leader_election.cc:302] T 152aa575b30e4abfa8acd1f6b5ded2c2 P 92842de48966403c9acb8cbb06797670 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92842de48966403c9acb8cbb06797670, aa343e60e15a4e3fb24f49dbb3aa37b3; no voters:
I20260810 15:25:55.455276 31825 raft_consensus.cc:2781] T 152aa575b30e4abfa8acd1f6b5ded2c2 P 92842de48966403c9acb8cbb06797670 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 15:25:55.455312 31825 raft_consensus.cc:482] T 152aa575b30e4abfa8acd1f6b5ded2c2 P 92842de48966403c9acb8cbb06797670 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 15:25:55.455327 31825 raft_consensus.cc:3037] T 152aa575b30e4abfa8acd1f6b5ded2c2 P 92842de48966403c9acb8cbb06797670 [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:25:55.456007 31825 raft_consensus.cc:504] T 152aa575b30e4abfa8acd1f6b5ded2c2 P 92842de48966403c9acb8cbb06797670 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92842de48966403c9acb8cbb06797670" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 42797 } } peers { permanent_uuid: "aa343e60e15a4e3fb24f49dbb3aa37b3" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 38595 } } peers { permanent_uuid: "a69ecd14acce486bbad8a4d162d66996" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 45317 } }
I20260810 15:25:55.456163 31825 leader_election.cc:288] T 152aa575b30e4abfa8acd1f6b5ded2c2 P 92842de48966403c9acb8cbb06797670 [CANDIDATE]: Term 1 election: Requested vote from peers aa343e60e15a4e3fb24f49dbb3aa37b3 (127.18.68.129:38595), a69ecd14acce486bbad8a4d162d66996 (127.18.68.130:45317)
I20260810 15:25:55.456347 31331 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "152aa575b30e4abfa8acd1f6b5ded2c2" candidate_uuid: "92842de48966403c9acb8cbb06797670" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a69ecd14acce486bbad8a4d162d66996"
I20260810 15:25:55.456426 31331 raft_consensus.cc:3037] T 152aa575b30e4abfa8acd1f6b5ded2c2 P a69ecd14acce486bbad8a4d162d66996 [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:25:55.456453 31094 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "152aa575b30e4abfa8acd1f6b5ded2c2" candidate_uuid: "92842de48966403c9acb8cbb06797670" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa343e60e15a4e3fb24f49dbb3aa37b3"
I20260810 15:25:55.456552 31094 raft_consensus.cc:3037] T 152aa575b30e4abfa8acd1f6b5ded2c2 P aa343e60e15a4e3fb24f49dbb3aa37b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:25:55.457142 31331 raft_consensus.cc:2454] T 152aa575b30e4abfa8acd1f6b5ded2c2 P a69ecd14acce486bbad8a4d162d66996 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92842de48966403c9acb8cbb06797670 in term 1.
I20260810 15:25:55.457257 31094 raft_consensus.cc:2454] T 152aa575b30e4abfa8acd1f6b5ded2c2 P aa343e60e15a4e3fb24f49dbb3aa37b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92842de48966403c9acb8cbb06797670 in term 1.
I20260810 15:25:55.457351 31461 leader_election.cc:302] T 152aa575b30e4abfa8acd1f6b5ded2c2 P 92842de48966403c9acb8cbb06797670 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92842de48966403c9acb8cbb06797670, a69ecd14acce486bbad8a4d162d66996; no voters:
I20260810 15:25:55.457471 31825 raft_consensus.cc:2781] T 152aa575b30e4abfa8acd1f6b5ded2c2 P 92842de48966403c9acb8cbb06797670 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 15:25:55.457655 31825 raft_consensus.cc:686] T 152aa575b30e4abfa8acd1f6b5ded2c2 P 92842de48966403c9acb8cbb06797670 [term 1 LEADER]: Becoming Leader. State: Replica: 92842de48966403c9acb8cbb06797670, State: Running, Role: LEADER
I20260810 15:25:55.457746 31825 consensus_queue.cc:237] T 152aa575b30e4abfa8acd1f6b5ded2c2 P 92842de48966403c9acb8cbb06797670 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92842de48966403c9acb8cbb06797670" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 42797 } } peers { permanent_uuid: "aa343e60e15a4e3fb24f49dbb3aa37b3" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 38595 } } peers { permanent_uuid: "a69ecd14acce486bbad8a4d162d66996" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 45317 } }
I20260810 15:25:55.458024 31836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:55.457923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46363 (local address 127.18.68.131:58843)
0810 15:25:55.457958 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:55.457988 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:46363: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":16}
I20260810 15:25:55.458741 30879 catalog_manager.cc:5495] T 152aa575b30e4abfa8acd1f6b5ded2c2 P 92842de48966403c9acb8cbb06797670 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92842de48966403c9acb8cbb06797670 (127.18.68.131). New cstate: current_term: 1 leader_uuid: "92842de48966403c9acb8cbb06797670" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92842de48966403c9acb8cbb06797670" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 42797 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aa343e60e15a4e3fb24f49dbb3aa37b3" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 38595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a69ecd14acce486bbad8a4d162d66996" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 45317 } health_report { overall_health: UNKNOWN } } }
I20260810 15:25:55.483242 31818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:55.480929 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46194 (local address 127.18.68.131:42797)
0810 15:25:55.481010 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:55.481012 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:55.481021 (+ 9us) server_negotiation.cc:407] Connection header received
0810 15:25:55.481069 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:55.481070 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:55.481092 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:55.481162 (+ 70us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 15:25:55.481290 (+ 128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:55.481764 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:55.482528 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:55.482725 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:55.482779 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:55.482905 (+ 126us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 15:25:55.483003 (+ 98us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 15:25:55.483057 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:55.483162 (+ 105us) server_negotiation.cc:299] Negotiation successful
0810 15:25:55.483181 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260810 15:25:55.484558 31094 raft_consensus.cc:1261] T 152aa575b30e4abfa8acd1f6b5ded2c2 P aa343e60e15a4e3fb24f49dbb3aa37b3 [term 1 FOLLOWER]: Refusing update from remote peer 92842de48966403c9acb8cbb06797670: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 15:25:55.484644 31331 raft_consensus.cc:1261] T 152aa575b30e4abfa8acd1f6b5ded2c2 P a69ecd14acce486bbad8a4d162d66996 [term 1 FOLLOWER]: Refusing update from remote peer 92842de48966403c9acb8cbb06797670: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 15:25:55.484894 31839 consensus_queue.cc:1035] T 152aa575b30e4abfa8acd1f6b5ded2c2 P 92842de48966403c9acb8cbb06797670 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa343e60e15a4e3fb24f49dbb3aa37b3" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 38595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 15:25:55.485030 31825 consensus_queue.cc:1035] T 152aa575b30e4abfa8acd1f6b5ded2c2 P 92842de48966403c9acb8cbb06797670 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a69ecd14acce486bbad8a4d162d66996" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 45317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 15:25:55.485633 31414 heartbeater.cc:503] Master 127.18.68.188:45629 was elected leader, sending a full tablet report...
I20260810 15:25:55.485975 31789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:55.485862 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46363 (local address 127.18.68.130:52035)
0810 15:25:55.485899 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:55.485938 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:46363: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":19}
I20260810 15:25:55.485976 31790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:55.485870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46363 (local address 127.18.68.129:35437)
0810 15:25:55.485914 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:55.485945 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:46363: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260810 15:25:55.487000 31842 mvcc.cc:205] Tried to move back new op lower bound from 7316994275262001152 to 7316994275155628032. Current Snapshot: MvccSnapshot[applied={T|T < 7316994275262001152}]
I20260810 15:25:55.487396 31836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:55.487246 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46363 (local address 127.18.68.131:36363)
0810 15:25:55.487326 (+ 80us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:55.487360 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:46363: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260810 15:25:55.487847 31790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:55.487736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46363 (local address 127.18.68.129:33563)
0810 15:25:55.487797 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:55.487820 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:46363: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260810 15:25:55.488685 31836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:55.488294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46363 (local address 127.18.68.131:35107)
0810 15:25:55.488625 (+ 331us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:55.488656 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:46363: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":316}
I20260810 15:25:55.489066 31789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:55.488966 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46363 (local address 127.18.68.130:32801)
0810 15:25:55.489003 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:55.489033 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:46363: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":19}
I20260810 15:25:55.490453 30879 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59240:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 15:25:55.490556 30879 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59240:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 15:25:55.492013 30879 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 79b8b9b8839e47be8dd75bfe3818b5cd: Sending DeleteTablet for 3 replicas of tablet 152aa575b30e4abfa8acd1f6b5ded2c2
I20260810 15:25:55.492306 31538 tablet_service.cc:1514] Processing DeleteTablet for tablet 152aa575b30e4abfa8acd1f6b5ded2c2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 15:25:55 UTC) from {username='oryx', principal='oryx/127.18.68.188@KRBTEST.COM'} at 127.0.0.1:46180
I20260810 15:25:55.492386 31057 tablet_service.cc:1514] Processing DeleteTablet for tablet 152aa575b30e4abfa8acd1f6b5ded2c2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 15:25:55 UTC) from {username='oryx', principal='oryx/127.18.68.188@KRBTEST.COM'} at 127.0.0.1:35960
I20260810 15:25:55.492385 31297 tablet_service.cc:1514] Processing DeleteTablet for tablet 152aa575b30e4abfa8acd1f6b5ded2c2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 15:25:55 UTC) from {username='oryx', principal='oryx/127.18.68.188@KRBTEST.COM'} at 127.0.0.1:57396
I20260810 15:25:55.492508 31853 tablet_replica.cc:330] T 152aa575b30e4abfa8acd1f6b5ded2c2 P 92842de48966403c9acb8cbb06797670: stopping tablet replica
I20260810 15:25:55.492563 31853 raft_consensus.cc:2229] T 152aa575b30e4abfa8acd1f6b5ded2c2 P 92842de48966403c9acb8cbb06797670 [term 1 LEADER]: Raft consensus shutting down.
I20260810 15:25:55.492655 31853 raft_consensus.cc:2258] T 152aa575b30e4abfa8acd1f6b5ded2c2 P 92842de48966403c9acb8cbb06797670 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 15:25:55.492786 31859 tablet_replica.cc:330] T 152aa575b30e4abfa8acd1f6b5ded2c2 P aa343e60e15a4e3fb24f49dbb3aa37b3: stopping tablet replica
I20260810 15:25:55.492908 31857 tablet_replica.cc:330] T 152aa575b30e4abfa8acd1f6b5ded2c2 P a69ecd14acce486bbad8a4d162d66996: stopping tablet replica
I20260810 15:25:55.492970 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 30800
I20260810 15:25:55.493175 31853 ts_tablet_manager.cc:1905] T 152aa575b30e4abfa8acd1f6b5ded2c2 P 92842de48966403c9acb8cbb06797670: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 15:25:55.493005 31857 raft_consensus.cc:2229] T 152aa575b30e4abfa8acd1f6b5ded2c2 P a69ecd14acce486bbad8a4d162d66996 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 15:25:55.493804 31857 raft_consensus.cc:2258] T 152aa575b30e4abfa8acd1f6b5ded2c2 P a69ecd14acce486bbad8a4d162d66996 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 15:25:55.495258 31853 ts_tablet_manager.cc:1918] T 152aa575b30e4abfa8acd1f6b5ded2c2 P 92842de48966403c9acb8cbb06797670: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 15:25:55.495321 31853 log.cc:1196] T 152aa575b30e4abfa8acd1f6b5ded2c2 P 92842de48966403c9acb8cbb06797670: Deleting WAL directory at /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/ts-2/wal/wals/152aa575b30e4abfa8acd1f6b5ded2c2
I20260810 15:25:55.495592 31853 ts_tablet_manager.cc:1939] T 152aa575b30e4abfa8acd1f6b5ded2c2 P 92842de48966403c9acb8cbb06797670: Deleting consensus metadata
I20260810 15:25:55.496667 31857 ts_tablet_manager.cc:1905] T 152aa575b30e4abfa8acd1f6b5ded2c2 P a69ecd14acce486bbad8a4d162d66996: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 15:25:55.498723 31857 ts_tablet_manager.cc:1918] T 152aa575b30e4abfa8acd1f6b5ded2c2 P a69ecd14acce486bbad8a4d162d66996: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 15:25:55.498798 31857 log.cc:1196] T 152aa575b30e4abfa8acd1f6b5ded2c2 P a69ecd14acce486bbad8a4d162d66996: Deleting WAL directory at /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786375520124696-18706-0/minicluster-data/ts-1/wal/wals/152aa575b30e4abfa8acd1f6b5ded2c2
I20260810 15:25:55.499073 31857 ts_tablet_manager.cc:1939] T 152aa575b30e4abfa8acd1f6b5ded2c2 P a69ecd14acce486bbad8a4d162d66996: Deleting consensus metadata
I20260810 15:25:55.503808 30854 catalog_manager.cc:4841] TS a69ecd14acce486bbad8a4d162d66996 (127.18.68.130:45317): tablet 152aa575b30e4abfa8acd1f6b5ded2c2 (table test-table [id=708123b96287440a8b34999fc0513651]) successfully deleted
I20260810 15:25:55.503931 30854 catalog_manager.cc:4841] TS 92842de48966403c9acb8cbb06797670 (127.18.68.131:42797): tablet 152aa575b30e4abfa8acd1f6b5ded2c2 (table test-table [id=708123b96287440a8b34999fc0513651]) successfully deleted
I20260810 15:25:55.510428 31814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:55.510285 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.129:38595 (local address 127.0.0.1:35974)
0810 15:25:55.510349 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:55.510379 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.129:38595: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260810 15:25:55.510453 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 31183
W20260810 15:25:55.516238 30849 catalog_manager.cc:4584] TS aa343e60e15a4e3fb24f49dbb3aa37b3 (127.18.68.129:38595): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 152aa575b30e4abfa8acd1f6b5ded2c2: Network error: Client connection negotiation failed: client connection to 127.18.68.129:38595: connect: Connection refused (error 111)
I20260810 15:25:55.525638 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 31432
I20260810 15:25:55.541347 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 30298
I20260810 15:25:55.556437 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 30623
2026-08-10T15:25:55Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (6864 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 15:25:55 dist-test-slave-2p8l krb5kdc[31864](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 15:25:55 dist-test-slave-2p8l krb5kdc[31864](info): set up 2 sockets
Aug 10 15:25:55 dist-test-slave-2p8l krb5kdc[31864](info): commencing operation
krb5kdc: starting...
W20260810 15:25:56.875015 18706 mini_kdc.cc:121] Time spent starting KDC: real 1.288s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/krb5kdc/test-user.keytab.
Aug 10 15:25:56 dist-test-slave-2p8l krb5kdc[31864](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375556, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T15:25:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T15:25:56Z Disabled control of system clock
WARNING: no policy specified for oryx/127.18.68.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.18.68.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.18.68.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/krb5kdc/oryx_127.18.68.190.keytab.
Entry for principal oryx/127.18.68.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/krb5kdc/oryx_127.18.68.190.keytab.
I20260810 15:25:57.001897 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.190:44713
--webserver_interface=127.18.68.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/krb5kdc/oryx_127.18.68.190.keytab
--principal=oryx/127.18.68.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:39649
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.68.190:44713
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:25:57.088285 31888 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:25:57.088500 31888 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:25:57.088522 31888 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:25:57.089617 31888 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 15:25:57.089653 31888 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260810 15:25:57.089666 31888 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:25:57.089679 31888 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:25:57.089692 31888 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 15:25:57.089704 31888 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 15:25:57.091195 31888 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:39649
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.68.190:44713
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/krb5kdc/oryx_127.18.68.190.keytab
--principal=oryx/127.18.68.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.190:44713
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.68.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31888
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:25:57.091392 31888 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:25:57.091560 31888 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:25:57.096529 31901 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:57.096529 31897 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:25:57.096894 31888 server_base.cc:1034] running on GCE node
W20260810 15:25:57.096565 31898 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:25:57.097258 31888 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:25:57.097566 31888 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:25:57.098722 31888 hybrid_clock.cc:648] HybridClock initialized: now 1786375557098702 us; error 42 us; skew 500 ppm
Aug 10 15:25:57 dist-test-slave-2p8l krb5kdc[31864](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375557, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.68.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:25:57.101246 31888 init.cc:377] Logged in from keytab as oryx/127.18.68.190@KRBTEST.COM (short username oryx)
I20260810 15:25:57.101703 31888 webserver.cc:460] Webserver started at http://127.18.68.190:45869/ using document root <none> and password file <none>
I20260810 15:25:57.101935 31888 fs_manager.cc:359] Metadata directory not provided
I20260810 15:25:57.101980 31888 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:25:57.102128 31888 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:25:57.103240 31888 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/minicluster-data/master-0/data/instance:
uuid: "a9407d5b536b43818777ecc7b5d82e0b"
format_stamp: "Formatted at 2026-08-10 15:25:57 on dist-test-slave-2p8l"
server_key: "96855f041939978dc52868a0c8ffc6d4"
server_key_iv: "7904b19542f60974c22f92eef2a8817f"
server_key_version: "encryptionkey@0"
I20260810 15:25:57.103613 31888 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/minicluster-data/master-0/wal/instance:
uuid: "a9407d5b536b43818777ecc7b5d82e0b"
format_stamp: "Formatted at 2026-08-10 15:25:57 on dist-test-slave-2p8l"
server_key: "96855f041939978dc52868a0c8ffc6d4"
server_key_iv: "7904b19542f60974c22f92eef2a8817f"
server_key_version: "encryptionkey@0"
I20260810 15:25:57.105073 31888 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 15:25:57.105880 31913 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:57.106230 31888 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:25:57.106312 31888 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/minicluster-data/master-0/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/minicluster-data/master-0/wal
uuid: "a9407d5b536b43818777ecc7b5d82e0b"
format_stamp: "Formatted at 2026-08-10 15:25:57 on dist-test-slave-2p8l"
server_key: "96855f041939978dc52868a0c8ffc6d4"
server_key_iv: "7904b19542f60974c22f92eef2a8817f"
server_key_version: "encryptionkey@0"
I20260810 15:25:57.106402 31888 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:25:57.132776 31888 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:25:57.134859 31888 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:25:57.135015 31888 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:25:57.139804 31888 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.190:44713
I20260810 15:25:57.139894 32021 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.190:44713 every 8 connection(s)
I20260810 15:25:57.140241 31888 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
I20260810 15:25:57.141148 32022 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:25:57.144846 32022 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a9407d5b536b43818777ecc7b5d82e0b: Bootstrap starting.
I20260810 15:25:57.145743 32022 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a9407d5b536b43818777ecc7b5d82e0b: Neither blocks nor log segments found. Creating new log.
I20260810 15:25:57.146147 32022 log.cc:824] T 00000000000000000000000000000000 P a9407d5b536b43818777ecc7b5d82e0b: Log is configured to *not* fsync() on all Append() calls
I20260810 15:25:57.147006 32022 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a9407d5b536b43818777ecc7b5d82e0b: No bootstrap required, opened a new log
I20260810 15:25:57.147612 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 31888
I20260810 15:25:57.147751 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/minicluster-data/master-0/wal/instance
I20260810 15:25:57.147998 18706 external_mini_cluster.cc:1428] Setting key bcaf752e3313bda7ef02428ae2d5ecfe
I20260810 15:25:57.150518 32022 raft_consensus.cc:348] T 00000000000000000000000000000000 P a9407d5b536b43818777ecc7b5d82e0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9407d5b536b43818777ecc7b5d82e0b" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 44713 } }
I20260810 15:25:57.150765 32022 raft_consensus.cc:374] T 00000000000000000000000000000000 P a9407d5b536b43818777ecc7b5d82e0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:25:57.150818 32022 raft_consensus.cc:729] T 00000000000000000000000000000000 P a9407d5b536b43818777ecc7b5d82e0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9407d5b536b43818777ecc7b5d82e0b, State: Initialized, Role: FOLLOWER
I20260810 15:25:57.150985 32022 consensus_queue.cc:260] T 00000000000000000000000000000000 P a9407d5b536b43818777ecc7b5d82e0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9407d5b536b43818777ecc7b5d82e0b" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 44713 } }
I20260810 15:25:57.151081 32022 raft_consensus.cc:388] T 00000000000000000000000000000000 P a9407d5b536b43818777ecc7b5d82e0b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 15:25:57.151122 32022 raft_consensus.cc:482] T 00000000000000000000000000000000 P a9407d5b536b43818777ecc7b5d82e0b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 15:25:57.151178 32022 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a9407d5b536b43818777ecc7b5d82e0b [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:25:57.152114 32022 raft_consensus.cc:504] T 00000000000000000000000000000000 P a9407d5b536b43818777ecc7b5d82e0b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9407d5b536b43818777ecc7b5d82e0b" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 44713 } }
I20260810 15:25:57.152243 32022 leader_election.cc:302] T 00000000000000000000000000000000 P a9407d5b536b43818777ecc7b5d82e0b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a9407d5b536b43818777ecc7b5d82e0b; no voters:
I20260810 15:25:57.152429 32022 leader_election.cc:288] T 00000000000000000000000000000000 P a9407d5b536b43818777ecc7b5d82e0b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 15:25:57.152462 32027 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a9407d5b536b43818777ecc7b5d82e0b [term 1 FOLLOWER]: Leader election won for term 1
I20260810 15:25:57.152601 32027 raft_consensus.cc:686] T 00000000000000000000000000000000 P a9407d5b536b43818777ecc7b5d82e0b [term 1 LEADER]: Becoming Leader. State: Replica: a9407d5b536b43818777ecc7b5d82e0b, State: Running, Role: LEADER
I20260810 15:25:57.152714 32022 sys_catalog.cc:564] T 00000000000000000000000000000000 P a9407d5b536b43818777ecc7b5d82e0b [sys.catalog]: configured and running, proceeding with master startup.
I20260810 15:25:57.152691 32027 consensus_queue.cc:237] T 00000000000000000000000000000000 P a9407d5b536b43818777ecc7b5d82e0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9407d5b536b43818777ecc7b5d82e0b" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 44713 } }
I20260810 15:25:57.153015 32030 sys_catalog.cc:455] T 00000000000000000000000000000000 P a9407d5b536b43818777ecc7b5d82e0b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a9407d5b536b43818777ecc7b5d82e0b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9407d5b536b43818777ecc7b5d82e0b" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 44713 } } }
I20260810 15:25:57.153115 32030 sys_catalog.cc:458] T 00000000000000000000000000000000 P a9407d5b536b43818777ecc7b5d82e0b [sys.catalog]: This master's current role is: LEADER
I20260810 15:25:57.152997 32027 sys_catalog.cc:455] T 00000000000000000000000000000000 P a9407d5b536b43818777ecc7b5d82e0b [sys.catalog]: SysCatalogTable state changed. Reason: New leader a9407d5b536b43818777ecc7b5d82e0b. Latest consensus state: current_term: 1 leader_uuid: "a9407d5b536b43818777ecc7b5d82e0b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9407d5b536b43818777ecc7b5d82e0b" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 44713 } } }
I20260810 15:25:57.153259 32027 sys_catalog.cc:458] T 00000000000000000000000000000000 P a9407d5b536b43818777ecc7b5d82e0b [sys.catalog]: This master's current role is: LEADER
W20260810 15:25:57.154585 32058 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a9407d5b536b43818777ecc7b5d82e0b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 15:25:57.155416 32058 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 15:25:57.155472 32035 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 15:25:57.155647 32035 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 15:25:57.157394 32035 catalog_manager.cc:1347] Generated new cluster ID: 371a84dd03fc4752bc0451ce895fbfe6
I20260810 15:25:57.157497 32035 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 10 15:25:57 dist-test-slave-2p8l krb5kdc[31864](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375556, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM
I20260810 15:25:57.164873 32026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:57.148616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35870 (local address 127.18.68.190:44713)
0810 15:25:57.148784 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:57.148794 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:57.148826 (+ 32us) server_negotiation.cc:407] Connection header received
0810 15:25:57.151996 (+ 3170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:57.152006 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:57.152077 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:57.152254 (+ 177us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:57.153374 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:57.154819 (+ 1445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:57.155950 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:57.156567 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:57.156671 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:57.159946 (+ 3275us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:57.159951 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:57.159952 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:57.159967 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:57.162982 (+ 3015us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:57.163441 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:57.163445 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:57.163445 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:57.163578 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:57.163809 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:57.163810 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:57.163810 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:57.164115 (+ 305us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:57.164334 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:57.164462 (+ 128us) server_negotiation.cc:299] Negotiation successful
0810 15:25:57.164645 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121,"thread_start_us":92,"threads_started":1}
I20260810 15:25:57.167923 32035 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 15:25:57.168910 32035 catalog_manager.cc:1504] Loading token signing keys...
I20260810 15:25:57.176973 32035 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a9407d5b536b43818777ecc7b5d82e0b: Generated new TSK 0
I20260810 15:25:57.177182 32035 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.18.68.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.18.68.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.18.68.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/krb5kdc/oryx_127.18.68.129.keytab.
Entry for principal oryx/127.18.68.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/krb5kdc/oryx_127.18.68.129.keytab.
I20260810 15:25:57.214917 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.68.129:0
--local_ip_for_outbound_sockets=127.18.68.129
--webserver_interface=127.18.68.129
--webserver_port=0
--tserver_master_addrs=127.18.68.190:44713
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/krb5kdc/oryx_127.18.68.129.keytab
--principal=oryx/127.18.68.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:39649
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:25:57.298554 32066 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:25:57.298759 32066 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:25:57.298785 32066 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:25:57.300028 32066 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:25:57.300068 32066 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:25:57.300089 32066 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 15:25:57.300107 32066 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.68.129
I20260810 15:25:57.301643 32066 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:39649
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/krb5kdc/oryx_127.18.68.129.keytab
--principal=oryx/127.18.68.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.68.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.68.129
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.18.68.190:44713
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32066
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.68.129
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:25:57.301889 32066 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:25:57.302162 32066 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:25:57.307408 32077 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:57.307417 32079 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:25:57.307478 32066 server_base.cc:1034] running on GCE node
W20260810 15:25:57.307423 32074 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:25:57.307874 32066 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:25:57.308149 32066 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:25:57.309321 32066 hybrid_clock.cc:648] HybridClock initialized: now 1786375557309307 us; error 42 us; skew 500 ppm
Aug 10 15:25:57 dist-test-slave-2p8l krb5kdc[31864](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375557, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.68.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:25:57.312059 32066 init.cc:377] Logged in from keytab as oryx/127.18.68.129@KRBTEST.COM (short username oryx)
I20260810 15:25:57.312484 32066 webserver.cc:460] Webserver started at http://127.18.68.129:34595/ using document root <none> and password file <none>
I20260810 15:25:57.312737 32066 fs_manager.cc:359] Metadata directory not provided
I20260810 15:25:57.312811 32066 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:25:57.312959 32066 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:25:57.313978 32066 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/minicluster-data/ts-0/data/instance:
uuid: "8634a1a1351c4aee98e49d7a28011068"
format_stamp: "Formatted at 2026-08-10 15:25:57 on dist-test-slave-2p8l"
server_key: "b2690b17b37d9caa2c23a187442c8efc"
server_key_iv: "23e1957ff2a3467c23ccafe66cecf55b"
server_key_version: "encryptionkey@0"
I20260810 15:25:57.314400 32066 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/minicluster-data/ts-0/wal/instance:
uuid: "8634a1a1351c4aee98e49d7a28011068"
format_stamp: "Formatted at 2026-08-10 15:25:57 on dist-test-slave-2p8l"
server_key: "b2690b17b37d9caa2c23a187442c8efc"
server_key_iv: "23e1957ff2a3467c23ccafe66cecf55b"
server_key_version: "encryptionkey@0"
I20260810 15:25:57.315775 32066 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:25:57.316527 32094 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:57.316708 32066 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 15:25:57.316818 32066 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/minicluster-data/ts-0/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/minicluster-data/ts-0/wal
uuid: "8634a1a1351c4aee98e49d7a28011068"
format_stamp: "Formatted at 2026-08-10 15:25:57 on dist-test-slave-2p8l"
server_key: "b2690b17b37d9caa2c23a187442c8efc"
server_key_iv: "23e1957ff2a3467c23ccafe66cecf55b"
server_key_version: "encryptionkey@0"
I20260810 15:25:57.316895 32066 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:25:57.325136 32066 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:25:57.327243 32066 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:25:57.327409 32066 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:25:57.327925 32066 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 15:25:57.328002 32066 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:57.328044 32066 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 15:25:57.328073 32066 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:57.335110 32066 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.129:35769
Aug 10 15:25:57 dist-test-slave-2p8l krb5kdc[31864](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375557, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.68.129@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM
I20260810 15:25:57.335184 32282 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.129:35769 every 8 connection(s)
I20260810 15:25:57.335498 32066 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/minicluster-data/ts-0/data/info.pb
I20260810 15:25:57.338249 32026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:57.328428 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.129:33861 (local address 127.18.68.190:44713)
0810 15:25:57.328501 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:57.328504 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:57.328666 (+ 162us) server_negotiation.cc:407] Connection header received
0810 15:25:57.329172 (+ 506us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:57.329174 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:57.329191 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:57.329274 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:57.330170 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:57.331034 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:57.332646 (+ 1612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:57.333008 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:57.333091 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:57.335700 (+ 2609us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:57.335702 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:57.335703 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:57.335716 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:57.337050 (+ 1334us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:57.337411 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:57.337411 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:57.337412 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:57.337463 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:57.337691 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:57.337692 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:57.337692 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:57.337792 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:57.337843 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:57.338040 (+ 197us) server_negotiation.cc:299] Negotiation successful
0810 15:25:57.338178 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260810 15:25:57.338430 32111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:57.328381 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:44713 (local address 127.18.68.129:33861)
0810 15:25:57.328535 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:57.328575 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:57.329053 (+ 478us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:57.329362 (+ 309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:57.329366 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:57.329713 (+ 347us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:25:57.329997 (+ 284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:57.330003 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:57.331144 (+ 1141us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:57.331145 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:57.332534 (+ 1389us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:57.332537 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:57.333111 (+ 574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:57.333112 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:57.333230 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:57.333744 (+ 514us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:25:57.333756 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:25:57.335566 (+ 1810us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:25:57.337126 (+ 1560us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:57.337132 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:57.337134 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:57.337342 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:57.337530 (+ 188us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:57.337531 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:57.337531 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:57.337635 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:57.337833 (+ 198us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:25:57.337835 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:25:57.337936 (+ 101us) client_negotiation.cc:769] Sending connection context
0810 15:25:57.338010 (+ 74us) client_negotiation.cc:240] Negotiation successful
0810 15:25:57.338208 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":85,"threads_started":1}
I20260810 15:25:57.338954 32286 heartbeater.cc:347] Connected to a master server at 127.18.68.190:44713
I20260810 15:25:57.339041 32286 heartbeater.cc:464] Registering TS with master...
I20260810 15:25:57.339250 32286 heartbeater.cc:511] Master 127.18.68.190:44713 requested a full tablet report, sending...
I20260810 15:25:57.339777 31941 ts_manager.cc:194] Registered new tserver with Master: 8634a1a1351c4aee98e49d7a28011068 (127.18.68.129:35769)
I20260810 15:25:57.340567 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 32066
I20260810 15:25:57.340704 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/minicluster-data/ts-0/wal/instance
I20260810 15:25:57.340756 31941 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.18.68.129@KRBTEST.COM'} at 127.18.68.129:33861
I20260810 15:25:57.340960 18706 external_mini_cluster.cc:1428] Setting key 9843213d9957b68006098bad6e06a4d6
I20260810 15:25:57.346200 32026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:57.340104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.129:59287 (local address 127.18.68.190:44713)
0810 15:25:57.340147 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:57.340149 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:57.340216 (+ 67us) server_negotiation.cc:407] Connection header received
0810 15:25:57.340280 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:57.340281 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:57.340289 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:57.340330 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:57.340689 (+ 359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:57.341359 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:57.342168 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:57.342460 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:57.342549 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:57.343431 (+ 882us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:57.343433 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:57.343433 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:57.343441 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:57.345014 (+ 1573us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:57.345419 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:57.345420 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:57.345420 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:57.345468 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:57.345700 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:57.345701 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:57.345701 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:57.345796 (+ 95us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:57.345846 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:57.346009 (+ 163us) server_negotiation.cc:299] Negotiation successful
0810 15:25:57.346122 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260810 15:25:57.346299 32302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:57.340000 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:44713 (local address 127.18.68.129:59287)
0810 15:25:57.340141 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:57.340160 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:57.340223 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:57.340342 (+ 119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:57.340343 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:57.340533 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:25:57.340600 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:57.340602 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:57.341467 (+ 865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:57.341467 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:57.342045 (+ 578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:57.342047 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:57.342561 (+ 514us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:57.342562 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:57.342631 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:57.343056 (+ 425us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:25:57.343061 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:25:57.343341 (+ 280us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:25:57.345102 (+ 1761us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:57.345103 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:57.345104 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:57.345338 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:57.345534 (+ 196us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:57.345535 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:57.345535 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:57.345607 (+ 72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:57.345862 (+ 255us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:25:57.345863 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:25:57.345915 (+ 52us) client_negotiation.cc:769] Sending connection context
0810 15:25:57.345996 (+ 81us) client_negotiation.cc:240] Negotiation successful
0810 15:25:57.346146 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":83,"threads_started":1}
WARNING: no policy specified for oryx/127.18.68.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.18.68.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.18.68.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/krb5kdc/oryx_127.18.68.130.keytab.
Entry for principal oryx/127.18.68.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/krb5kdc/oryx_127.18.68.130.keytab.
I20260810 15:25:57.369338 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.68.130:0
--local_ip_for_outbound_sockets=127.18.68.130
--webserver_interface=127.18.68.130
--webserver_port=0
--tserver_master_addrs=127.18.68.190:44713
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/krb5kdc/oryx_127.18.68.130.keytab
--principal=oryx/127.18.68.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:39649
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:25:57.452597 32310 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:25:57.452869 32310 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:25:57.452913 32310 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:25:57.454330 32310 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:25:57.454397 32310 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:25:57.454432 32310 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 15:25:57.454474 32310 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.68.130
I20260810 15:25:57.455986 32310 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:39649
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/krb5kdc/oryx_127.18.68.130.keytab
--principal=oryx/127.18.68.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.68.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.68.130
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.18.68.190:44713
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32310
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.68.130
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:25:57.456256 32310 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:25:57.456498 32310 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:25:57.461433 32326 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:57.461475 32324 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:57.461442 32322 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:25:57.461720 32310 server_base.cc:1034] running on GCE node
I20260810 15:25:57.461958 32310 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:25:57.462246 32310 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:25:57.463409 32310 hybrid_clock.cc:648] HybridClock initialized: now 1786375557463400 us; error 28 us; skew 500 ppm
Aug 10 15:25:57 dist-test-slave-2p8l krb5kdc[31864](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375557, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.68.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:25:57.466114 32310 init.cc:377] Logged in from keytab as oryx/127.18.68.130@KRBTEST.COM (short username oryx)
I20260810 15:25:57.466562 32310 webserver.cc:460] Webserver started at http://127.18.68.130:45411/ using document root <none> and password file <none>
I20260810 15:25:57.466742 32310 fs_manager.cc:359] Metadata directory not provided
I20260810 15:25:57.466784 32310 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:25:57.466871 32310 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:25:57.467806 32310 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/minicluster-data/ts-1/data/instance:
uuid: "de300fca51d9412da200cd66cd386b77"
format_stamp: "Formatted at 2026-08-10 15:25:57 on dist-test-slave-2p8l"
server_key: "a2a910e18eff5b9d22b48a3e548b29db"
server_key_iv: "39b463296af6db45e2ae29e79e75aa76"
server_key_version: "encryptionkey@0"
I20260810 15:25:57.468099 32310 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/minicluster-data/ts-1/wal/instance:
uuid: "de300fca51d9412da200cd66cd386b77"
format_stamp: "Formatted at 2026-08-10 15:25:57 on dist-test-slave-2p8l"
server_key: "a2a910e18eff5b9d22b48a3e548b29db"
server_key_iv: "39b463296af6db45e2ae29e79e75aa76"
server_key_version: "encryptionkey@0"
I20260810 15:25:57.469359 32310 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 15:25:57.470124 32336 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:57.470299 32310 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:25:57.470394 32310 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/minicluster-data/ts-1/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/minicluster-data/ts-1/wal
uuid: "de300fca51d9412da200cd66cd386b77"
format_stamp: "Formatted at 2026-08-10 15:25:57 on dist-test-slave-2p8l"
server_key: "a2a910e18eff5b9d22b48a3e548b29db"
server_key_iv: "39b463296af6db45e2ae29e79e75aa76"
server_key_version: "encryptionkey@0"
I20260810 15:25:57.470449 32310 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:25:57.478255 32310 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:25:57.480439 32310 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:25:57.480549 32310 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:25:57.480980 32310 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 15:25:57.481021 32310 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:57.481051 32310 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 15:25:57.481106 32310 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 10 15:25:57 dist-test-slave-2p8l krb5kdc[31864](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375557, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.68.130@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM
I20260810 15:25:57.488322 32310 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.130:42597
I20260810 15:25:57.488379 32559 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.130:42597 every 8 connection(s)
I20260810 15:25:57.488714 32310 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/minicluster-data/ts-1/data/info.pb
I20260810 15:25:57.491426 32026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:57.481516 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.130:44521 (local address 127.18.68.190:44713)
0810 15:25:57.481595 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:57.481598 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:57.481746 (+ 148us) server_negotiation.cc:407] Connection header received
0810 15:25:57.482296 (+ 550us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:57.482298 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:57.482312 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:57.482403 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:57.483208 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:57.484038 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:57.485634 (+ 1596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:57.485962 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:57.486037 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:57.488723 (+ 2686us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:57.488724 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:57.488725 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:57.488734 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:57.490202 (+ 1468us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:57.490605 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:57.490606 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:57.490606 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:57.490659 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:57.490868 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:57.490870 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:57.490870 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:57.490992 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:57.491058 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:57.491295 (+ 237us) server_negotiation.cc:299] Negotiation successful
0810 15:25:57.491364 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260810 15:25:57.491580 32351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:57.481440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:44713 (local address 127.18.68.130:44521)
0810 15:25:57.481616 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:57.481658 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:57.482195 (+ 537us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:57.482481 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:57.482485 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:57.482815 (+ 330us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:25:57.483092 (+ 277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:57.483098 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:57.484156 (+ 1058us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:57.484157 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:57.485532 (+ 1375us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:57.485535 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:57.486091 (+ 556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:57.486092 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:57.486254 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:57.486739 (+ 485us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:25:57.486749 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:25:57.488622 (+ 1873us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:25:57.490274 (+ 1652us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:57.490280 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:57.490282 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:57.490497 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:57.490704 (+ 207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:57.490705 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:57.490705 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:57.490790 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:57.491061 (+ 271us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:25:57.491066 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:25:57.491177 (+ 111us) client_negotiation.cc:769] Sending connection context
0810 15:25:57.491260 (+ 83us) client_negotiation.cc:240] Negotiation successful
0810 15:25:57.491376 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":91,"threads_started":1}
I20260810 15:25:57.492111 32561 heartbeater.cc:347] Connected to a master server at 127.18.68.190:44713
I20260810 15:25:57.492204 32561 heartbeater.cc:464] Registering TS with master...
I20260810 15:25:57.492401 32561 heartbeater.cc:511] Master 127.18.68.190:44713 requested a full tablet report, sending...
I20260810 15:25:57.492781 31945 ts_manager.cc:194] Registered new tserver with Master: de300fca51d9412da200cd66cd386b77 (127.18.68.130:42597)
I20260810 15:25:57.493242 31945 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.18.68.130@KRBTEST.COM'} at 127.18.68.130:44521
I20260810 15:25:57.494839 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 32310
I20260810 15:25:57.494966 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/minicluster-data/ts-1/wal/instance
I20260810 15:25:57.495167 18706 external_mini_cluster.cc:1428] Setting key 88833acba4d571b7089ea0147ea103f1
I20260810 15:25:57.499148 32576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:57.493190 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:44713 (local address 127.18.68.130:57053)
0810 15:25:57.493440 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:57.493451 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:57.493516 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:57.493623 (+ 107us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:57.493624 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:57.493832 (+ 208us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:25:57.493896 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:57.493898 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:57.494613 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:57.494614 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:57.495213 (+ 599us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:57.495215 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:57.495618 (+ 403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:57.495619 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:57.495688 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:57.496142 (+ 454us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:25:57.496146 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:25:57.496415 (+ 269us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:25:57.498116 (+ 1701us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:57.498118 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:57.498118 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:57.498298 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:57.498513 (+ 215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:57.498513 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:57.498513 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:57.498564 (+ 51us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:57.498910 (+ 346us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:25:57.498911 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:25:57.498948 (+ 37us) client_negotiation.cc:769] Sending connection context
0810 15:25:57.499001 (+ 53us) client_negotiation.cc:240] Negotiation successful
0810 15:25:57.499077 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":226,"thread_start_us":201,"threads_started":1}
I20260810 15:25:57.499385 32026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:57.493249 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.130:57053 (local address 127.18.68.190:44713)
0810 15:25:57.493288 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:57.493290 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:57.493526 (+ 236us) server_negotiation.cc:407] Connection header received
0810 15:25:57.493550 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:57.493551 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:57.493562 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:57.493618 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:57.494006 (+ 388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:57.494525 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:57.495298 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:57.495540 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:57.495626 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:57.496509 (+ 883us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:57.496510 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:57.496511 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:57.496518 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:57.497986 (+ 1468us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:57.498376 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:57.498378 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:57.498378 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:57.498445 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:57.498633 (+ 188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:57.498634 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:57.498635 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:57.498839 (+ 204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:57.498918 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:57.499030 (+ 112us) server_negotiation.cc:299] Negotiation successful
0810 15:25:57.499116 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
WARNING: no policy specified for oryx/127.18.68.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.18.68.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.18.68.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/krb5kdc/oryx_127.18.68.131.keytab.
Entry for principal oryx/127.18.68.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/krb5kdc/oryx_127.18.68.131.keytab.
I20260810 15:25:57.520955 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.68.131:0
--local_ip_for_outbound_sockets=127.18.68.131
--webserver_interface=127.18.68.131
--webserver_port=0
--tserver_master_addrs=127.18.68.190:44713
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/krb5kdc/oryx_127.18.68.131.keytab
--principal=oryx/127.18.68.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:39649
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:25:57.604000 32579 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:25:57.604216 32579 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:25:57.604240 32579 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:25:57.605340 32579 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:25:57.605376 32579 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:25:57.605396 32579 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 15:25:57.605412 32579 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.68.131
I20260810 15:25:57.607095 32579 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:39649
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/krb5kdc/oryx_127.18.68.131.keytab
--principal=oryx/127.18.68.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.68.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.68.131
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.18.68.190:44713
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32579
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.68.131
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:25:57.607299 32579 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:25:57.607478 32579 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:25:57.612517 32590 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:57.612519 32592 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:25:57.612507 32589 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:25:57.612831 32579 server_base.cc:1034] running on GCE node
I20260810 15:25:57.613054 32579 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:25:57.613292 32579 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:25:57.614462 32579 hybrid_clock.cc:648] HybridClock initialized: now 1786375557614451 us; error 29 us; skew 500 ppm
Aug 10 15:25:57 dist-test-slave-2p8l krb5kdc[31864](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375557, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.68.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:25:57.617097 32579 init.cc:377] Logged in from keytab as oryx/127.18.68.131@KRBTEST.COM (short username oryx)
I20260810 15:25:57.617529 32579 webserver.cc:460] Webserver started at http://127.18.68.131:33585/ using document root <none> and password file <none>
I20260810 15:25:57.617796 32579 fs_manager.cc:359] Metadata directory not provided
I20260810 15:25:57.617870 32579 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:25:57.618021 32579 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:25:57.619073 32579 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/minicluster-data/ts-2/data/instance:
uuid: "da89159b612c4f32ad4b826d61f0b6ef"
format_stamp: "Formatted at 2026-08-10 15:25:57 on dist-test-slave-2p8l"
server_key: "74cd9714e44a6722296e01079cd0f4f8"
server_key_iv: "3adb51365854280b91b163e425640b5e"
server_key_version: "encryptionkey@0"
I20260810 15:25:57.619453 32579 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/minicluster-data/ts-2/wal/instance:
uuid: "da89159b612c4f32ad4b826d61f0b6ef"
format_stamp: "Formatted at 2026-08-10 15:25:57 on dist-test-slave-2p8l"
server_key: "74cd9714e44a6722296e01079cd0f4f8"
server_key_iv: "3adb51365854280b91b163e425640b5e"
server_key_version: "encryptionkey@0"
I20260810 15:25:57.620905 32579 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 15:25:57.621658 32602 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:57.621876 32579 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:25:57.621986 32579 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/minicluster-data/ts-2/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/minicluster-data/ts-2/wal
uuid: "da89159b612c4f32ad4b826d61f0b6ef"
format_stamp: "Formatted at 2026-08-10 15:25:57 on dist-test-slave-2p8l"
server_key: "74cd9714e44a6722296e01079cd0f4f8"
server_key_iv: "3adb51365854280b91b163e425640b5e"
server_key_version: "encryptionkey@0"
I20260810 15:25:57.622062 32579 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:25:57.648548 32579 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:25:57.650702 32579 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:25:57.650878 32579 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:25:57.651441 32579 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 15:25:57.651510 32579 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:57.651557 32579 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 15:25:57.651582 32579 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 10 15:25:57 dist-test-slave-2p8l krb5kdc[31864](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375557, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.68.131@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM
I20260810 15:25:57.659543 32579 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.131:44627
I20260810 15:25:57.659633 332 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.131:44627 every 8 connection(s)
I20260810 15:25:57.659960 32579 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/minicluster-data/ts-2/data/info.pb
I20260810 15:25:57.662743 32026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:57.651965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.131:37899 (local address 127.18.68.190:44713)
0810 15:25:57.652018 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:57.652020 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:57.652268 (+ 248us) server_negotiation.cc:407] Connection header received
0810 15:25:57.652919 (+ 651us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:57.652921 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:57.652935 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:57.652985 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:57.653944 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:57.654881 (+ 937us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:57.656518 (+ 1637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:57.656857 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:57.656932 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:57.659801 (+ 2869us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:57.659803 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:57.659803 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:57.659817 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:57.661224 (+ 1407us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:57.661661 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:57.661662 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:57.661663 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:57.661726 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:57.662046 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:57.662047 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:57.662047 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:57.662272 (+ 225us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:57.662338 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:57.662603 (+ 265us) server_negotiation.cc:299] Negotiation successful
0810 15:25:57.662679 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260810 15:25:57.662942 32618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:57.651956 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:44713 (local address 127.18.68.131:37899)
0810 15:25:57.652137 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:57.652173 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:57.652813 (+ 640us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:57.653074 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:57.653078 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:57.653516 (+ 438us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:25:57.653829 (+ 313us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:57.653837 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:57.655011 (+ 1174us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:57.655012 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:57.656390 (+ 1378us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:57.656393 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:57.656971 (+ 578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:57.656972 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:57.657119 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:57.657774 (+ 655us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:25:57.657783 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:25:57.659712 (+ 1929us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:25:57.661299 (+ 1587us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:57.661306 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:57.661308 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:57.661528 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:57.661830 (+ 302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:57.661831 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:57.661831 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:57.661949 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:57.662347 (+ 398us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:25:57.662353 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:25:57.662474 (+ 121us) client_negotiation.cc:769] Sending connection context
0810 15:25:57.662567 (+ 93us) client_negotiation.cc:240] Negotiation successful
0810 15:25:57.662732 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":90,"threads_started":1}
I20260810 15:25:57.663432 333 heartbeater.cc:347] Connected to a master server at 127.18.68.190:44713
I20260810 15:25:57.663542 333 heartbeater.cc:464] Registering TS with master...
I20260810 15:25:57.663758 333 heartbeater.cc:511] Master 127.18.68.190:44713 requested a full tablet report, sending...
I20260810 15:25:57.664341 31941 ts_manager.cc:194] Registered new tserver with Master: da89159b612c4f32ad4b826d61f0b6ef (127.18.68.131:44627)
I20260810 15:25:57.664800 31941 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.18.68.131@KRBTEST.COM'} at 127.18.68.131:37899
I20260810 15:25:57.666293 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 32579
I20260810 15:25:57.666402 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/minicluster-data/ts-2/wal/instance
I20260810 15:25:57.666607 18706 external_mini_cluster.cc:1428] Setting key 5ee7bd3ece604d0803442b2db6faded2
I20260810 15:25:57.667474 18706 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 15:25:57.671172 342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:57.664583 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:44713 (local address 127.18.68.131:41905)
0810 15:25:57.664737 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:57.664749 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:57.664815 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:57.665032 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:57.665033 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:57.665257 (+ 224us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:25:57.665323 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:57.665325 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:57.666152 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:57.666154 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:57.667005 (+ 851us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:57.667008 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:57.667447 (+ 439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:57.667448 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:57.667516 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:57.667966 (+ 450us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:25:57.667971 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:25:57.668365 (+ 394us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:25:57.670224 (+ 1859us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:57.670225 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:57.670225 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:57.670383 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:57.670592 (+ 209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:57.670593 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:57.670593 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:57.670641 (+ 48us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:57.670942 (+ 301us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:25:57.670942 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:25:57.670979 (+ 37us) client_negotiation.cc:769] Sending connection context
0810 15:25:57.671026 (+ 47us) client_negotiation.cc:240] Negotiation successful
0810 15:25:57.671102 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":77,"threads_started":1}
I20260810 15:25:57.671267 32026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:57.664652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.131:41905 (local address 127.18.68.190:44713)
0810 15:25:57.664697 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:57.664699 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:57.664820 (+ 121us) server_negotiation.cc:407] Connection header received
0810 15:25:57.664933 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:57.664933 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:57.664947 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:57.665017 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:57.665411 (+ 394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:57.666019 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:57.667085 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:57.667370 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:57.667435 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:57.668451 (+ 1016us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:57.668452 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:57.668452 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:57.668458 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:57.670136 (+ 1678us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:57.670456 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:57.670458 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:57.670458 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:57.670524 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:57.670726 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:57.670727 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:57.670727 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:57.670872 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:57.670949 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:57.671065 (+ 116us) server_negotiation.cc:299] Negotiation successful
0810 15:25:57.671145 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
Aug 10 15:25:57 dist-test-slave-2p8l krb5kdc[31864](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375557, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 10 15:25:57 dist-test-slave-2p8l krb5kdc[31864](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 15:25:57 dist-test-slave-2p8l krb5kdc[31864](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
W20260810 15:25:57.692049 32026 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 15:25:57.686437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35872 (local address 127.18.68.190:44713)
0810 15:25:57.686523 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:57.686526 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:57.686537 (+ 11us) server_negotiation.cc:407] Connection header received
0810 15:25:57.686572 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:57.686573 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:57.686581 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:57.686653 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:57.687264 (+ 611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:57.687809 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:57.688518 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:57.688712 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:57.688767 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:57.691947 (+ 3180us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35872: BlockingRecv error: recv got EOF from 127.0.0.1:35872 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Aug 10 15:25:57 dist-test-slave-2p8l krb5kdc[31864](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375557, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM
I20260810 15:25:57.699816 32026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:57.693096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35882 (local address 127.18.68.190:44713)
0810 15:25:57.693183 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:57.693185 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:57.693267 (+ 82us) server_negotiation.cc:407] Connection header received
0810 15:25:57.693341 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:57.693342 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:57.693352 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:57.693401 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:57.693877 (+ 476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:57.694482 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:57.695125 (+ 643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:57.695299 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:57.695348 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:57.697367 (+ 2019us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:57.697368 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:57.697368 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:57.697375 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:57.698760 (+ 1385us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:57.699098 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:57.699099 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:57.699099 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:57.699149 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:57.699317 (+ 168us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:57.699317 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:57.699318 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:57.699411 (+ 93us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:57.699485 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:57.699624 (+ 139us) server_negotiation.cc:299] Negotiation successful
0810 15:25:57.699703 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260810 15:25:57.701418 31941 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35882:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 15:25:57.703147 31941 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 15:25:57.709889 365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:57.705698 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.130:42597 (local address 127.0.0.1:34390)
0810 15:25:57.706173 (+ 475us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:57.706184 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:57.706232 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:57.706545 (+ 313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:57.706546 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:57.706548 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:25:57.706598 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:57.706600 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:57.707455 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:57.707456 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:57.708750 (+ 1294us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:57.708753 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:57.709553 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:57.709554 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:57.709644 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:57.709657 (+ 13us) client_negotiation.cc:769] Sending connection context
0810 15:25:57.709744 (+ 87us) client_negotiation.cc:240] Negotiation successful
0810 15:25:57.709800 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":438,"mutex_wait_us":1,"thread_start_us":96,"threads_started":1}
I20260810 15:25:57.709903 369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:57.705824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34390 (local address 127.18.68.130:42597)
0810 15:25:57.706038 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:57.706043 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:57.706297 (+ 254us) server_negotiation.cc:407] Connection header received
0810 15:25:57.706378 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:57.706381 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:57.706398 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:57.706473 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:25:57.706681 (+ 208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:57.707364 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:57.708846 (+ 1482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:57.709422 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:57.709511 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:57.709592 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:57.709760 (+ 168us) server_negotiation.cc:299] Negotiation successful
0810 15:25:57.709801 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":183,"thread_start_us":99,"threads_started":1}
I20260810 15:25:57.710000 370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:57.705896 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.131:44627 (local address 127.0.0.1:47638)
0810 15:25:57.706160 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:57.706170 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:57.706222 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:57.706539 (+ 317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:57.706541 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:57.706542 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:25:57.706584 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:57.706586 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:57.707809 (+ 1223us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:57.707810 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:57.708731 (+ 921us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:57.708733 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:57.709754 (+ 1021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:57.709755 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:57.709822 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:57.709827 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 15:25:57.709876 (+ 49us) client_negotiation.cc:240] Negotiation successful
0810 15:25:57.709925 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":247,"mutex_wait_us":32,"thread_start_us":67,"threads_started":1}
I20260810 15:25:57.710300 373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:57.706090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47638 (local address 127.18.68.131:44627)
0810 15:25:57.706298 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:57.706302 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:57.706311 (+ 9us) server_negotiation.cc:407] Connection header received
0810 15:25:57.706379 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:57.706381 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:57.706396 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:57.706471 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:25:57.706669 (+ 198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:57.707705 (+ 1036us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:57.708818 (+ 1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:57.709540 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:57.709623 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:57.709714 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:57.710142 (+ 428us) server_negotiation.cc:299] Negotiation successful
0810 15:25:57.710193 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":178,"thread_start_us":98,"threads_started":1}
I20260810 15:25:57.710472 364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:57.705663 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.129:35769 (local address 127.0.0.1:56958)
0810 15:25:57.705857 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:57.705900 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:57.705967 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:57.706389 (+ 422us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:57.706392 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:57.706395 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:25:57.706469 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:57.706471 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:57.707815 (+ 1344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:57.707816 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:57.708936 (+ 1120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:57.708938 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:57.709935 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:57.709936 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:57.710277 (+ 341us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:57.710281 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 15:25:57.710341 (+ 60us) client_negotiation.cc:240] Negotiation successful
0810 15:25:57.710431 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":169,"mutex_wait_us":28,"thread_start_us":88,"threads_started":1}
I20260810 15:25:57.710755 366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:57.705800 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56958 (local address 127.18.68.129:35769)
0810 15:25:57.706128 (+ 328us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:57.706133 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:57.706146 (+ 13us) server_negotiation.cc:407] Connection header received
0810 15:25:57.706191 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:57.706193 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:57.706210 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:57.706300 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:25:57.706554 (+ 254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:57.707718 (+ 1164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:57.709000 (+ 1282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:57.709773 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:57.709837 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:57.709904 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:57.710590 (+ 686us) server_negotiation.cc:299] Negotiation successful
0810 15:25:57.710638 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":286,"thread_start_us":76,"threads_started":1}
I20260810 15:25:57.710747 32423 tablet_service.cc:1467] Processing CreateTablet for tablet c725ec055f9a4dfea92c32772c994a46 (DEFAULT_TABLE table=test-table [id=e398003cf90146eeabdc2247e589cb8a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 15:25:57.711182 32423 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c725ec055f9a4dfea92c32772c994a46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:25:57.711440 32178 tablet_service.cc:1467] Processing CreateTablet for tablet c725ec055f9a4dfea92c32772c994a46 (DEFAULT_TABLE table=test-table [id=e398003cf90146eeabdc2247e589cb8a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 15:25:57.711786 32178 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c725ec055f9a4dfea92c32772c994a46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:25:57.714736 32688 tablet_service.cc:1467] Processing CreateTablet for tablet c725ec055f9a4dfea92c32772c994a46 (DEFAULT_TABLE table=test-table [id=e398003cf90146eeabdc2247e589cb8a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 15:25:57.715065 32688 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c725ec055f9a4dfea92c32772c994a46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:25:57.715567 374 tablet_bootstrap.cc:492] T c725ec055f9a4dfea92c32772c994a46 P de300fca51d9412da200cd66cd386b77: Bootstrap starting.
I20260810 15:25:57.715864 378 tablet_bootstrap.cc:492] T c725ec055f9a4dfea92c32772c994a46 P 8634a1a1351c4aee98e49d7a28011068: Bootstrap starting.
I20260810 15:25:57.716365 374 tablet_bootstrap.cc:654] T c725ec055f9a4dfea92c32772c994a46 P de300fca51d9412da200cd66cd386b77: Neither blocks nor log segments found. Creating new log.
I20260810 15:25:57.716391 378 tablet_bootstrap.cc:654] T c725ec055f9a4dfea92c32772c994a46 P 8634a1a1351c4aee98e49d7a28011068: Neither blocks nor log segments found. Creating new log.
I20260810 15:25:57.716704 378 log.cc:824] T c725ec055f9a4dfea92c32772c994a46 P 8634a1a1351c4aee98e49d7a28011068: Log is configured to *not* fsync() on all Append() calls
I20260810 15:25:57.716717 374 log.cc:824] T c725ec055f9a4dfea92c32772c994a46 P de300fca51d9412da200cd66cd386b77: Log is configured to *not* fsync() on all Append() calls
I20260810 15:25:57.717623 374 tablet_bootstrap.cc:492] T c725ec055f9a4dfea92c32772c994a46 P de300fca51d9412da200cd66cd386b77: No bootstrap required, opened a new log
I20260810 15:25:57.717700 374 ts_tablet_manager.cc:1397] T c725ec055f9a4dfea92c32772c994a46 P de300fca51d9412da200cd66cd386b77: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 15:25:57.717792 378 tablet_bootstrap.cc:492] T c725ec055f9a4dfea92c32772c994a46 P 8634a1a1351c4aee98e49d7a28011068: No bootstrap required, opened a new log
I20260810 15:25:57.717859 378 ts_tablet_manager.cc:1397] T c725ec055f9a4dfea92c32772c994a46 P 8634a1a1351c4aee98e49d7a28011068: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 15:25:57.719025 383 tablet_bootstrap.cc:492] T c725ec055f9a4dfea92c32772c994a46 P da89159b612c4f32ad4b826d61f0b6ef: Bootstrap starting.
I20260810 15:25:57.719728 383 tablet_bootstrap.cc:654] T c725ec055f9a4dfea92c32772c994a46 P da89159b612c4f32ad4b826d61f0b6ef: Neither blocks nor log segments found. Creating new log.
I20260810 15:25:57.719630 378 raft_consensus.cc:348] T c725ec055f9a4dfea92c32772c994a46 P 8634a1a1351c4aee98e49d7a28011068 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8634a1a1351c4aee98e49d7a28011068" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35769 } } peers { permanent_uuid: "de300fca51d9412da200cd66cd386b77" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 42597 } } peers { permanent_uuid: "da89159b612c4f32ad4b826d61f0b6ef" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 44627 } }
I20260810 15:25:57.719734 374 raft_consensus.cc:348] T c725ec055f9a4dfea92c32772c994a46 P de300fca51d9412da200cd66cd386b77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8634a1a1351c4aee98e49d7a28011068" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35769 } } peers { permanent_uuid: "de300fca51d9412da200cd66cd386b77" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 42597 } } peers { permanent_uuid: "da89159b612c4f32ad4b826d61f0b6ef" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 44627 } }
I20260810 15:25:57.719813 378 raft_consensus.cc:374] T c725ec055f9a4dfea92c32772c994a46 P 8634a1a1351c4aee98e49d7a28011068 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:25:57.719880 378 raft_consensus.cc:729] T c725ec055f9a4dfea92c32772c994a46 P 8634a1a1351c4aee98e49d7a28011068 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8634a1a1351c4aee98e49d7a28011068, State: Initialized, Role: FOLLOWER
I20260810 15:25:57.719884 374 raft_consensus.cc:374] T c725ec055f9a4dfea92c32772c994a46 P de300fca51d9412da200cd66cd386b77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:25:57.719925 374 raft_consensus.cc:729] T c725ec055f9a4dfea92c32772c994a46 P de300fca51d9412da200cd66cd386b77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de300fca51d9412da200cd66cd386b77, State: Initialized, Role: FOLLOWER
I20260810 15:25:57.720036 378 consensus_queue.cc:260] T c725ec055f9a4dfea92c32772c994a46 P 8634a1a1351c4aee98e49d7a28011068 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8634a1a1351c4aee98e49d7a28011068" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35769 } } peers { permanent_uuid: "de300fca51d9412da200cd66cd386b77" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 42597 } } peers { permanent_uuid: "da89159b612c4f32ad4b826d61f0b6ef" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 44627 } }
I20260810 15:25:57.720047 374 consensus_queue.cc:260] T c725ec055f9a4dfea92c32772c994a46 P de300fca51d9412da200cd66cd386b77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8634a1a1351c4aee98e49d7a28011068" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35769 } } peers { permanent_uuid: "de300fca51d9412da200cd66cd386b77" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 42597 } } peers { permanent_uuid: "da89159b612c4f32ad4b826d61f0b6ef" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 44627 } }
I20260810 15:25:57.720259 383 log.cc:824] T c725ec055f9a4dfea92c32772c994a46 P da89159b612c4f32ad4b826d61f0b6ef: Log is configured to *not* fsync() on all Append() calls
I20260810 15:25:57.720357 378 ts_tablet_manager.cc:1428] T c725ec055f9a4dfea92c32772c994a46 P 8634a1a1351c4aee98e49d7a28011068: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260810 15:25:57.720361 374 ts_tablet_manager.cc:1428] T c725ec055f9a4dfea92c32772c994a46 P de300fca51d9412da200cd66cd386b77: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260810 15:25:57.720515 32286 heartbeater.cc:503] Master 127.18.68.190:44713 was elected leader, sending a full tablet report...
I20260810 15:25:57.720839 32561 heartbeater.cc:503] Master 127.18.68.190:44713 was elected leader, sending a full tablet report...
I20260810 15:25:57.720995 383 tablet_bootstrap.cc:492] T c725ec055f9a4dfea92c32772c994a46 P da89159b612c4f32ad4b826d61f0b6ef: No bootstrap required, opened a new log
I20260810 15:25:57.721053 383 ts_tablet_manager.cc:1397] T c725ec055f9a4dfea92c32772c994a46 P da89159b612c4f32ad4b826d61f0b6ef: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 15:25:57.722766 383 raft_consensus.cc:348] T c725ec055f9a4dfea92c32772c994a46 P da89159b612c4f32ad4b826d61f0b6ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8634a1a1351c4aee98e49d7a28011068" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35769 } } peers { permanent_uuid: "de300fca51d9412da200cd66cd386b77" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 42597 } } peers { permanent_uuid: "da89159b612c4f32ad4b826d61f0b6ef" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 44627 } }
I20260810 15:25:57.722887 383 raft_consensus.cc:374] T c725ec055f9a4dfea92c32772c994a46 P da89159b612c4f32ad4b826d61f0b6ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:25:57.722909 383 raft_consensus.cc:729] T c725ec055f9a4dfea92c32772c994a46 P da89159b612c4f32ad4b826d61f0b6ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da89159b612c4f32ad4b826d61f0b6ef, State: Initialized, Role: FOLLOWER
I20260810 15:25:57.723037 383 consensus_queue.cc:260] T c725ec055f9a4dfea92c32772c994a46 P da89159b612c4f32ad4b826d61f0b6ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8634a1a1351c4aee98e49d7a28011068" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35769 } } peers { permanent_uuid: "de300fca51d9412da200cd66cd386b77" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 42597 } } peers { permanent_uuid: "da89159b612c4f32ad4b826d61f0b6ef" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 44627 } }
I20260810 15:25:57.723302 383 ts_tablet_manager.cc:1428] T c725ec055f9a4dfea92c32772c994a46 P da89159b612c4f32ad4b826d61f0b6ef: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260810 15:25:57.723354 333 heartbeater.cc:503] Master 127.18.68.190:44713 was elected leader, sending a full tablet report...
W20260810 15:25:57.739583 32562 tablet.cc:2369] T c725ec055f9a4dfea92c32772c994a46 P de300fca51d9412da200cd66cd386b77: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 15:25:57.836423 32287 tablet.cc:2369] T c725ec055f9a4dfea92c32772c994a46 P 8634a1a1351c4aee98e49d7a28011068: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 15:25:57.910712 335 tablet.cc:2369] T c725ec055f9a4dfea92c32772c994a46 P da89159b612c4f32ad4b826d61f0b6ef: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 15:25:57.911164 385 raft_consensus.cc:482] T c725ec055f9a4dfea92c32772c994a46 P 8634a1a1351c4aee98e49d7a28011068 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 15:25:57.911273 385 raft_consensus.cc:504] T c725ec055f9a4dfea92c32772c994a46 P 8634a1a1351c4aee98e49d7a28011068 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8634a1a1351c4aee98e49d7a28011068" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35769 } } peers { permanent_uuid: "de300fca51d9412da200cd66cd386b77" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 42597 } } peers { permanent_uuid: "da89159b612c4f32ad4b826d61f0b6ef" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 44627 } }
I20260810 15:25:57.911566 385 leader_election.cc:288] T c725ec055f9a4dfea92c32772c994a46 P 8634a1a1351c4aee98e49d7a28011068 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de300fca51d9412da200cd66cd386b77 (127.18.68.130:42597), da89159b612c4f32ad4b826d61f0b6ef (127.18.68.131:44627)
I20260810 15:25:57.914644 394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:57.911769 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.130:42597 (local address 127.18.68.129:40413)
0810 15:25:57.911891 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:57.911918 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:57.912012 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:57.912221 (+ 209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:57.912223 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:57.912225 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:25:57.912301 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:57.912303 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:57.912966 (+ 663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:57.912967 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:57.913796 (+ 829us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:57.913798 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:57.914381 (+ 583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:57.914382 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:57.914457 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:57.914461 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 15:25:57.914517 (+ 56us) client_negotiation.cc:240] Negotiation successful
0810 15:25:57.914557 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":77,"threads_started":1}
I20260810 15:25:57.914669 369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:57.911884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.129:40413 (local address 127.18.68.130:42597)
0810 15:25:57.911951 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:57.911954 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:57.911998 (+ 44us) server_negotiation.cc:407] Connection header received
0810 15:25:57.912129 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:57.912131 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:57.912144 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:57.912206 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:25:57.912382 (+ 176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:57.912889 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:57.913885 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:57.914304 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:57.914362 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:57.914369 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:57.914535 (+ 166us) server_negotiation.cc:299] Negotiation successful
0810 15:25:57.914579 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260810 15:25:57.914776 373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:57.912119 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.129:33251 (local address 127.18.68.131:44627)
0810 15:25:57.912167 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:57.912169 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:57.912180 (+ 11us) server_negotiation.cc:407] Connection header received
0810 15:25:57.912223 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:57.912224 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:57.912233 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:57.912284 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:25:57.912484 (+ 200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:57.912982 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:57.913957 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:57.914391 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:57.914465 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:57.914473 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:57.914671 (+ 198us) server_negotiation.cc:299] Negotiation successful
0810 15:25:57.914714 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260810 15:25:57.914991 395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:57.911982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.131:44627 (local address 127.18.68.129:33251)
0810 15:25:57.912090 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:57.912102 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:57.912161 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:57.912305 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:57.912306 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:57.912310 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:25:57.912403 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:57.912405 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:57.913069 (+ 664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:57.913069 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:57.913857 (+ 788us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:57.913860 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:57.914480 (+ 620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:57.914481 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:57.914584 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:57.914588 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 15:25:57.914649 (+ 61us) client_negotiation.cc:240] Negotiation successful
0810 15:25:57.914690 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":92,"thread_start_us":73,"threads_started":1}
I20260810 15:25:57.915119 32462 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c725ec055f9a4dfea92c32772c994a46" candidate_uuid: "8634a1a1351c4aee98e49d7a28011068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de300fca51d9412da200cd66cd386b77" is_pre_election: true
I20260810 15:25:57.915278 32462 raft_consensus.cc:2454] T c725ec055f9a4dfea92c32772c994a46 P de300fca51d9412da200cd66cd386b77 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8634a1a1351c4aee98e49d7a28011068 in term 0.
I20260810 15:25:57.915338 32721 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c725ec055f9a4dfea92c32772c994a46" candidate_uuid: "8634a1a1351c4aee98e49d7a28011068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da89159b612c4f32ad4b826d61f0b6ef" is_pre_election: true
I20260810 15:25:57.915504 32721 raft_consensus.cc:2454] T c725ec055f9a4dfea92c32772c994a46 P da89159b612c4f32ad4b826d61f0b6ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8634a1a1351c4aee98e49d7a28011068 in term 0.
I20260810 15:25:57.915506 32099 leader_election.cc:302] T c725ec055f9a4dfea92c32772c994a46 P 8634a1a1351c4aee98e49d7a28011068 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8634a1a1351c4aee98e49d7a28011068, de300fca51d9412da200cd66cd386b77; no voters:
I20260810 15:25:57.915645 385 raft_consensus.cc:2781] T c725ec055f9a4dfea92c32772c994a46 P 8634a1a1351c4aee98e49d7a28011068 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 15:25:57.915714 385 raft_consensus.cc:482] T c725ec055f9a4dfea92c32772c994a46 P 8634a1a1351c4aee98e49d7a28011068 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 15:25:57.915732 385 raft_consensus.cc:3037] T c725ec055f9a4dfea92c32772c994a46 P 8634a1a1351c4aee98e49d7a28011068 [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:25:57.916481 385 raft_consensus.cc:504] T c725ec055f9a4dfea92c32772c994a46 P 8634a1a1351c4aee98e49d7a28011068 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8634a1a1351c4aee98e49d7a28011068" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35769 } } peers { permanent_uuid: "de300fca51d9412da200cd66cd386b77" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 42597 } } peers { permanent_uuid: "da89159b612c4f32ad4b826d61f0b6ef" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 44627 } }
I20260810 15:25:57.916623 385 leader_election.cc:288] T c725ec055f9a4dfea92c32772c994a46 P 8634a1a1351c4aee98e49d7a28011068 [CANDIDATE]: Term 1 election: Requested vote from peers de300fca51d9412da200cd66cd386b77 (127.18.68.130:42597), da89159b612c4f32ad4b826d61f0b6ef (127.18.68.131:44627)
I20260810 15:25:57.916826 32462 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c725ec055f9a4dfea92c32772c994a46" candidate_uuid: "8634a1a1351c4aee98e49d7a28011068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de300fca51d9412da200cd66cd386b77"
I20260810 15:25:57.916851 32721 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c725ec055f9a4dfea92c32772c994a46" candidate_uuid: "8634a1a1351c4aee98e49d7a28011068" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da89159b612c4f32ad4b826d61f0b6ef"
I20260810 15:25:57.916934 32721 raft_consensus.cc:3037] T c725ec055f9a4dfea92c32772c994a46 P da89159b612c4f32ad4b826d61f0b6ef [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:25:57.916930 32462 raft_consensus.cc:3037] T c725ec055f9a4dfea92c32772c994a46 P de300fca51d9412da200cd66cd386b77 [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:25:57.917661 32462 raft_consensus.cc:2454] T c725ec055f9a4dfea92c32772c994a46 P de300fca51d9412da200cd66cd386b77 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8634a1a1351c4aee98e49d7a28011068 in term 1.
I20260810 15:25:57.917704 32721 raft_consensus.cc:2454] T c725ec055f9a4dfea92c32772c994a46 P da89159b612c4f32ad4b826d61f0b6ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8634a1a1351c4aee98e49d7a28011068 in term 1.
I20260810 15:25:57.917887 32099 leader_election.cc:302] T c725ec055f9a4dfea92c32772c994a46 P 8634a1a1351c4aee98e49d7a28011068 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8634a1a1351c4aee98e49d7a28011068, da89159b612c4f32ad4b826d61f0b6ef; no voters:
I20260810 15:25:57.918090 385 raft_consensus.cc:2781] T c725ec055f9a4dfea92c32772c994a46 P 8634a1a1351c4aee98e49d7a28011068 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 15:25:57.918244 385 raft_consensus.cc:686] T c725ec055f9a4dfea92c32772c994a46 P 8634a1a1351c4aee98e49d7a28011068 [term 1 LEADER]: Becoming Leader. State: Replica: 8634a1a1351c4aee98e49d7a28011068, State: Running, Role: LEADER
I20260810 15:25:57.918342 385 consensus_queue.cc:237] T c725ec055f9a4dfea92c32772c994a46 P 8634a1a1351c4aee98e49d7a28011068 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8634a1a1351c4aee98e49d7a28011068" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35769 } } peers { permanent_uuid: "de300fca51d9412da200cd66cd386b77" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 42597 } } peers { permanent_uuid: "da89159b612c4f32ad4b826d61f0b6ef" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 44627 } }
I20260810 15:25:57.919179 31945 catalog_manager.cc:5495] T c725ec055f9a4dfea92c32772c994a46 P 8634a1a1351c4aee98e49d7a28011068 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8634a1a1351c4aee98e49d7a28011068 (127.18.68.129). New cstate: current_term: 1 leader_uuid: "8634a1a1351c4aee98e49d7a28011068" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8634a1a1351c4aee98e49d7a28011068" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "de300fca51d9412da200cd66cd386b77" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 42597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da89159b612c4f32ad4b826d61f0b6ef" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 44627 } health_report { overall_health: UNKNOWN } } }
I20260810 15:25:57.941085 366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:57.938782 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56962 (local address 127.18.68.129:35769)
0810 15:25:57.938866 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:57.938869 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:57.938879 (+ 10us) server_negotiation.cc:407] Connection header received
0810 15:25:57.938927 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:57.938928 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:57.938947 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:57.939009 (+ 62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 15:25:57.939161 (+ 152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:57.939620 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:57.940423 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:57.940610 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:57.940685 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:57.940818 (+ 133us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 15:25:57.940914 (+ 96us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 15:25:57.940973 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:57.941007 (+ 34us) server_negotiation.cc:299] Negotiation successful
0810 15:25:57.941025 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260810 15:25:57.943126 32462 raft_consensus.cc:1261] T c725ec055f9a4dfea92c32772c994a46 P de300fca51d9412da200cd66cd386b77 [term 1 FOLLOWER]: Refusing update from remote peer 8634a1a1351c4aee98e49d7a28011068: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 15:25:57.943127 32721 raft_consensus.cc:1261] T c725ec055f9a4dfea92c32772c994a46 P da89159b612c4f32ad4b826d61f0b6ef [term 1 FOLLOWER]: Refusing update from remote peer 8634a1a1351c4aee98e49d7a28011068: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 15:25:57.943472 385 consensus_queue.cc:1035] T c725ec055f9a4dfea92c32772c994a46 P 8634a1a1351c4aee98e49d7a28011068 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de300fca51d9412da200cd66cd386b77" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 42597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 15:25:57.943630 396 consensus_queue.cc:1035] T c725ec055f9a4dfea92c32772c994a46 P 8634a1a1351c4aee98e49d7a28011068 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da89159b612c4f32ad4b826d61f0b6ef" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 44627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 15:25:57.946643 403 mvcc.cc:205] Tried to move back new op lower bound from 7316994285331988480 to 7316994285234106368. Current Snapshot: MvccSnapshot[applied={T|T < 7316994285331988480}]
I20260810 15:25:57.946859 409 mvcc.cc:205] Tried to move back new op lower bound from 7316994285331988480 to 7316994285234106368. Current Snapshot: MvccSnapshot[applied={T|T < 7316994285331988480}]
I20260810 15:25:57.947319 410 mvcc.cc:205] Tried to move back new op lower bound from 7316994285331988480 to 7316994285234106368. Current Snapshot: MvccSnapshot[applied={T|T < 7316994285331988480 or (T in {7316994285331988480})}]
I20260810 15:25:57.949349 31940 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35882:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 15:25:57.949455 31940 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35882:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 15:25:57.950251 31940 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a9407d5b536b43818777ecc7b5d82e0b: Sending DeleteTablet for 3 replicas of tablet c725ec055f9a4dfea92c32772c994a46
I20260810 15:25:57.950573 32178 tablet_service.cc:1514] Processing DeleteTablet for tablet c725ec055f9a4dfea92c32772c994a46 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 15:25:57 UTC) from {username='oryx', principal='oryx/127.18.68.190@KRBTEST.COM'} at 127.0.0.1:56958
I20260810 15:25:57.950647 32688 tablet_service.cc:1514] Processing DeleteTablet for tablet c725ec055f9a4dfea92c32772c994a46 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 15:25:57 UTC) from {username='oryx', principal='oryx/127.18.68.190@KRBTEST.COM'} at 127.0.0.1:47638
I20260810 15:25:57.950835 32423 tablet_service.cc:1514] Processing DeleteTablet for tablet c725ec055f9a4dfea92c32772c994a46 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 15:25:57 UTC) from {username='oryx', principal='oryx/127.18.68.190@KRBTEST.COM'} at 127.0.0.1:34390
I20260810 15:25:57.951061 423 tablet_replica.cc:330] T c725ec055f9a4dfea92c32772c994a46 P de300fca51d9412da200cd66cd386b77: stopping tablet replica
I20260810 15:25:57.951195 423 raft_consensus.cc:2229] T c725ec055f9a4dfea92c32772c994a46 P de300fca51d9412da200cd66cd386b77 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 15:25:57.951320 423 raft_consensus.cc:2258] T c725ec055f9a4dfea92c32772c994a46 P de300fca51d9412da200cd66cd386b77 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 15:25:57.951360 31940 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35882:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 15:25:57.951496 31940 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 15:25:57.951846 423 ts_tablet_manager.cc:1905] T c725ec055f9a4dfea92c32772c994a46 P de300fca51d9412da200cd66cd386b77: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 15:25:57.952808 32178 tablet_service.cc:1467] Processing CreateTablet for tablet 9a7f56e59ba44589ae4a52dc61fec4ea (DEFAULT_TABLE table=test-table [id=685160f224ae4469b76987bd71a82293]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 15:25:57.952927 32178 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a7f56e59ba44589ae4a52dc61fec4ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:25:57.953264 32688 tablet_service.cc:1467] Processing CreateTablet for tablet 9a7f56e59ba44589ae4a52dc61fec4ea (DEFAULT_TABLE table=test-table [id=685160f224ae4469b76987bd71a82293]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 15:25:57.953404 32688 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a7f56e59ba44589ae4a52dc61fec4ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:25:57.953557 423 ts_tablet_manager.cc:1918] T c725ec055f9a4dfea92c32772c994a46 P de300fca51d9412da200cd66cd386b77: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 15:25:57.953642 423 log.cc:1196] T c725ec055f9a4dfea92c32772c994a46 P de300fca51d9412da200cd66cd386b77: Deleting WAL directory at /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/minicluster-data/ts-1/wal/wals/c725ec055f9a4dfea92c32772c994a46
I20260810 15:25:57.953956 423 ts_tablet_manager.cc:1939] T c725ec055f9a4dfea92c32772c994a46 P de300fca51d9412da200cd66cd386b77: Deleting consensus metadata
I20260810 15:25:57.954809 383 tablet_bootstrap.cc:492] T 9a7f56e59ba44589ae4a52dc61fec4ea P da89159b612c4f32ad4b826d61f0b6ef: Bootstrap starting.
I20260810 15:25:57.954825 378 tablet_bootstrap.cc:492] T 9a7f56e59ba44589ae4a52dc61fec4ea P 8634a1a1351c4aee98e49d7a28011068: Bootstrap starting.
I20260810 15:25:57.955240 383 tablet_bootstrap.cc:654] T 9a7f56e59ba44589ae4a52dc61fec4ea P da89159b612c4f32ad4b826d61f0b6ef: Neither blocks nor log segments found. Creating new log.
I20260810 15:25:57.955317 378 tablet_bootstrap.cc:654] T 9a7f56e59ba44589ae4a52dc61fec4ea P 8634a1a1351c4aee98e49d7a28011068: Neither blocks nor log segments found. Creating new log.
I20260810 15:25:57.955838 32423 tablet_service.cc:1467] Processing CreateTablet for tablet 9a7f56e59ba44589ae4a52dc61fec4ea (DEFAULT_TABLE table=test-table [id=685160f224ae4469b76987bd71a82293]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 15:25:57.955935 383 tablet_bootstrap.cc:492] T 9a7f56e59ba44589ae4a52dc61fec4ea P da89159b612c4f32ad4b826d61f0b6ef: No bootstrap required, opened a new log
I20260810 15:25:57.955966 32423 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a7f56e59ba44589ae4a52dc61fec4ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:25:57.955982 383 ts_tablet_manager.cc:1397] T 9a7f56e59ba44589ae4a52dc61fec4ea P da89159b612c4f32ad4b826d61f0b6ef: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260810 15:25:57.956154 383 raft_consensus.cc:348] T 9a7f56e59ba44589ae4a52dc61fec4ea P da89159b612c4f32ad4b826d61f0b6ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8634a1a1351c4aee98e49d7a28011068" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35769 } } peers { permanent_uuid: "de300fca51d9412da200cd66cd386b77" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 42597 } } peers { permanent_uuid: "da89159b612c4f32ad4b826d61f0b6ef" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 44627 } }
I20260810 15:25:57.956240 383 raft_consensus.cc:374] T 9a7f56e59ba44589ae4a52dc61fec4ea P da89159b612c4f32ad4b826d61f0b6ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:25:57.956269 383 raft_consensus.cc:729] T 9a7f56e59ba44589ae4a52dc61fec4ea P da89159b612c4f32ad4b826d61f0b6ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da89159b612c4f32ad4b826d61f0b6ef, State: Initialized, Role: FOLLOWER
I20260810 15:25:57.956316 383 consensus_queue.cc:260] T 9a7f56e59ba44589ae4a52dc61fec4ea P da89159b612c4f32ad4b826d61f0b6ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8634a1a1351c4aee98e49d7a28011068" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35769 } } peers { permanent_uuid: "de300fca51d9412da200cd66cd386b77" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 42597 } } peers { permanent_uuid: "da89159b612c4f32ad4b826d61f0b6ef" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 44627 } }
I20260810 15:25:57.956413 383 ts_tablet_manager.cc:1428] T 9a7f56e59ba44589ae4a52dc61fec4ea P da89159b612c4f32ad4b826d61f0b6ef: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260810 15:25:57.957171 374 tablet_bootstrap.cc:492] T 9a7f56e59ba44589ae4a52dc61fec4ea P de300fca51d9412da200cd66cd386b77: Bootstrap starting.
I20260810 15:25:57.957482 31921 catalog_manager.cc:4841] TS de300fca51d9412da200cd66cd386b77 (127.18.68.130:42597): tablet c725ec055f9a4dfea92c32772c994a46 (table test-table [id=e398003cf90146eeabdc2247e589cb8a]) successfully deleted
I20260810 15:25:57.957584 374 tablet_bootstrap.cc:654] T 9a7f56e59ba44589ae4a52dc61fec4ea P de300fca51d9412da200cd66cd386b77: Neither blocks nor log segments found. Creating new log.
I20260810 15:25:57.957865 378 tablet_bootstrap.cc:492] T 9a7f56e59ba44589ae4a52dc61fec4ea P 8634a1a1351c4aee98e49d7a28011068: No bootstrap required, opened a new log
I20260810 15:25:57.957922 378 ts_tablet_manager.cc:1397] T 9a7f56e59ba44589ae4a52dc61fec4ea P 8634a1a1351c4aee98e49d7a28011068: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260810 15:25:57.958099 378 raft_consensus.cc:348] T 9a7f56e59ba44589ae4a52dc61fec4ea P 8634a1a1351c4aee98e49d7a28011068 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8634a1a1351c4aee98e49d7a28011068" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35769 } } peers { permanent_uuid: "de300fca51d9412da200cd66cd386b77" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 42597 } } peers { permanent_uuid: "da89159b612c4f32ad4b826d61f0b6ef" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 44627 } }
I20260810 15:25:57.958175 378 raft_consensus.cc:374] T 9a7f56e59ba44589ae4a52dc61fec4ea P 8634a1a1351c4aee98e49d7a28011068 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:25:57.958207 378 raft_consensus.cc:729] T 9a7f56e59ba44589ae4a52dc61fec4ea P 8634a1a1351c4aee98e49d7a28011068 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8634a1a1351c4aee98e49d7a28011068, State: Initialized, Role: FOLLOWER
I20260810 15:25:57.958252 378 consensus_queue.cc:260] T 9a7f56e59ba44589ae4a52dc61fec4ea P 8634a1a1351c4aee98e49d7a28011068 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8634a1a1351c4aee98e49d7a28011068" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35769 } } peers { permanent_uuid: "de300fca51d9412da200cd66cd386b77" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 42597 } } peers { permanent_uuid: "da89159b612c4f32ad4b826d61f0b6ef" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 44627 } }
I20260810 15:25:57.958298 374 tablet_bootstrap.cc:492] T 9a7f56e59ba44589ae4a52dc61fec4ea P de300fca51d9412da200cd66cd386b77: No bootstrap required, opened a new log
I20260810 15:25:57.958343 374 ts_tablet_manager.cc:1397] T 9a7f56e59ba44589ae4a52dc61fec4ea P de300fca51d9412da200cd66cd386b77: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260810 15:25:57.958356 378 ts_tablet_manager.cc:1428] T 9a7f56e59ba44589ae4a52dc61fec4ea P 8634a1a1351c4aee98e49d7a28011068: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260810 15:25:57.958493 374 raft_consensus.cc:348] T 9a7f56e59ba44589ae4a52dc61fec4ea P de300fca51d9412da200cd66cd386b77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8634a1a1351c4aee98e49d7a28011068" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35769 } } peers { permanent_uuid: "de300fca51d9412da200cd66cd386b77" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 42597 } } peers { permanent_uuid: "da89159b612c4f32ad4b826d61f0b6ef" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 44627 } }
I20260810 15:25:57.958590 374 raft_consensus.cc:374] T 9a7f56e59ba44589ae4a52dc61fec4ea P de300fca51d9412da200cd66cd386b77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:25:57.958652 374 raft_consensus.cc:729] T 9a7f56e59ba44589ae4a52dc61fec4ea P de300fca51d9412da200cd66cd386b77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de300fca51d9412da200cd66cd386b77, State: Initialized, Role: FOLLOWER
I20260810 15:25:57.958709 374 consensus_queue.cc:260] T 9a7f56e59ba44589ae4a52dc61fec4ea P de300fca51d9412da200cd66cd386b77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8634a1a1351c4aee98e49d7a28011068" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35769 } } peers { permanent_uuid: "de300fca51d9412da200cd66cd386b77" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 42597 } } peers { permanent_uuid: "da89159b612c4f32ad4b826d61f0b6ef" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 44627 } }
I20260810 15:25:57.958810 374 ts_tablet_manager.cc:1428] T 9a7f56e59ba44589ae4a52dc61fec4ea P de300fca51d9412da200cd66cd386b77: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260810 15:25:57.962198 421 tablet_replica.cc:330] T c725ec055f9a4dfea92c32772c994a46 P da89159b612c4f32ad4b826d61f0b6ef: stopping tablet replica
I20260810 15:25:57.962183 420 tablet_replica.cc:330] T c725ec055f9a4dfea92c32772c994a46 P 8634a1a1351c4aee98e49d7a28011068: stopping tablet replica
I20260810 15:25:57.962325 420 raft_consensus.cc:2229] T c725ec055f9a4dfea92c32772c994a46 P 8634a1a1351c4aee98e49d7a28011068 [term 1 LEADER]: Raft consensus shutting down.
I20260810 15:25:57.962325 421 raft_consensus.cc:2229] T c725ec055f9a4dfea92c32772c994a46 P da89159b612c4f32ad4b826d61f0b6ef [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 15:25:57.962447 421 raft_consensus.cc:2258] T c725ec055f9a4dfea92c32772c994a46 P da89159b612c4f32ad4b826d61f0b6ef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 15:25:57.962464 420 raft_consensus.cc:2258] T c725ec055f9a4dfea92c32772c994a46 P 8634a1a1351c4aee98e49d7a28011068 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 15:25:57.962922 421 ts_tablet_manager.cc:1905] T c725ec055f9a4dfea92c32772c994a46 P da89159b612c4f32ad4b826d61f0b6ef: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 15:25:57.962975 420 ts_tablet_manager.cc:1905] T c725ec055f9a4dfea92c32772c994a46 P 8634a1a1351c4aee98e49d7a28011068: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 15:25:57.964762 421 ts_tablet_manager.cc:1918] T c725ec055f9a4dfea92c32772c994a46 P da89159b612c4f32ad4b826d61f0b6ef: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 15:25:57.964769 420 ts_tablet_manager.cc:1918] T c725ec055f9a4dfea92c32772c994a46 P 8634a1a1351c4aee98e49d7a28011068: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 15:25:57.964854 420 log.cc:1196] T c725ec055f9a4dfea92c32772c994a46 P 8634a1a1351c4aee98e49d7a28011068: Deleting WAL directory at /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/minicluster-data/ts-0/wal/wals/c725ec055f9a4dfea92c32772c994a46
I20260810 15:25:57.964857 421 log.cc:1196] T c725ec055f9a4dfea92c32772c994a46 P da89159b612c4f32ad4b826d61f0b6ef: Deleting WAL directory at /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/minicluster-data/ts-2/wal/wals/c725ec055f9a4dfea92c32772c994a46
I20260810 15:25:57.965127 421 ts_tablet_manager.cc:1939] T c725ec055f9a4dfea92c32772c994a46 P da89159b612c4f32ad4b826d61f0b6ef: Deleting consensus metadata
I20260810 15:25:57.965154 420 ts_tablet_manager.cc:1939] T c725ec055f9a4dfea92c32772c994a46 P 8634a1a1351c4aee98e49d7a28011068: Deleting consensus metadata
I20260810 15:25:57.965538 31921 catalog_manager.cc:4841] TS da89159b612c4f32ad4b826d61f0b6ef (127.18.68.131:44627): tablet c725ec055f9a4dfea92c32772c994a46 (table test-table [id=e398003cf90146eeabdc2247e589cb8a]) successfully deleted
I20260810 15:25:57.965629 31915 catalog_manager.cc:4841] TS 8634a1a1351c4aee98e49d7a28011068 (127.18.68.129:35769): tablet c725ec055f9a4dfea92c32772c994a46 (table test-table [id=e398003cf90146eeabdc2247e589cb8a]) successfully deleted
I20260810 15:25:58.134624 391 raft_consensus.cc:482] T 9a7f56e59ba44589ae4a52dc61fec4ea P de300fca51d9412da200cd66cd386b77 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 15:25:58.134755 391 raft_consensus.cc:504] T 9a7f56e59ba44589ae4a52dc61fec4ea P de300fca51d9412da200cd66cd386b77 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8634a1a1351c4aee98e49d7a28011068" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35769 } } peers { permanent_uuid: "de300fca51d9412da200cd66cd386b77" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 42597 } } peers { permanent_uuid: "da89159b612c4f32ad4b826d61f0b6ef" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 44627 } }
I20260810 15:25:58.135172 391 leader_election.cc:288] T 9a7f56e59ba44589ae4a52dc61fec4ea P de300fca51d9412da200cd66cd386b77 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8634a1a1351c4aee98e49d7a28011068 (127.18.68.129:35769), da89159b612c4f32ad4b826d61f0b6ef (127.18.68.131:44627)
I20260810 15:25:58.138267 366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:58.135503 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.130:48267 (local address 127.18.68.129:35769)
0810 15:25:58.135564 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:58.135566 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:58.135604 (+ 38us) server_negotiation.cc:407] Connection header received
0810 15:25:58.135705 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:58.135706 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:58.135724 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:58.135792 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:25:58.135971 (+ 179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:58.136451 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:58.137476 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:58.137850 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:58.137936 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:58.137945 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:58.138153 (+ 208us) server_negotiation.cc:299] Negotiation successful
0810 15:25:58.138201 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260810 15:25:58.138320 431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:58.135400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.129:35769 (local address 127.18.68.130:48267)
0810 15:25:58.135542 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:58.135553 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:58.135620 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:58.135797 (+ 177us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:58.135798 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:58.135801 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:25:58.135893 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:58.135895 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:58.136570 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:58.136572 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:58.137372 (+ 800us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:58.137374 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:58.137945 (+ 571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:58.137946 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:58.138028 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:58.138032 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 15:25:58.138144 (+ 112us) client_negotiation.cc:240] Negotiation successful
0810 15:25:58.138189 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":64,"threads_started":1}
I20260810 15:25:58.138414 373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:58.135516 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.130:56653 (local address 127.18.68.131:44627)
0810 15:25:58.135572 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:58.135574 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:58.135604 (+ 30us) server_negotiation.cc:407] Connection header received
0810 15:25:58.135716 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:58.135718 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:58.135728 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:58.135812 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:25:58.135970 (+ 158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:58.136570 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:58.137602 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:58.137988 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:58.138117 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:58.138127 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:58.138297 (+ 170us) server_negotiation.cc:299] Negotiation successful
0810 15:25:58.138343 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260810 15:25:58.138674 429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:58.135393 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.131:44627 (local address 127.18.68.130:56653)
0810 15:25:58.135535 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:58.135549 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:58.135630 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:58.135815 (+ 185us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:58.135816 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:58.135819 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:25:58.135893 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:58.135895 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:58.136686 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:58.136688 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:58.137493 (+ 805us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:58.137495 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:58.138098 (+ 603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:58.138099 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:58.138176 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:58.138180 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 15:25:58.138526 (+ 346us) client_negotiation.cc:240] Negotiation successful
0810 15:25:58.138585 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":69,"threads_started":1}
I20260810 15:25:58.138677 32212 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a7f56e59ba44589ae4a52dc61fec4ea" candidate_uuid: "de300fca51d9412da200cd66cd386b77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8634a1a1351c4aee98e49d7a28011068" is_pre_election: true
I20260810 15:25:58.138831 32212 raft_consensus.cc:2454] T 9a7f56e59ba44589ae4a52dc61fec4ea P 8634a1a1351c4aee98e49d7a28011068 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de300fca51d9412da200cd66cd386b77 in term 0.
I20260810 15:25:58.138974 32721 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a7f56e59ba44589ae4a52dc61fec4ea" candidate_uuid: "de300fca51d9412da200cd66cd386b77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da89159b612c4f32ad4b826d61f0b6ef" is_pre_election: true
I20260810 15:25:58.139091 32721 raft_consensus.cc:2454] T 9a7f56e59ba44589ae4a52dc61fec4ea P da89159b612c4f32ad4b826d61f0b6ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de300fca51d9412da200cd66cd386b77 in term 0.
I20260810 15:25:58.139294 32337 leader_election.cc:302] T 9a7f56e59ba44589ae4a52dc61fec4ea P de300fca51d9412da200cd66cd386b77 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8634a1a1351c4aee98e49d7a28011068, de300fca51d9412da200cd66cd386b77; no voters:
I20260810 15:25:58.139465 391 raft_consensus.cc:2781] T 9a7f56e59ba44589ae4a52dc61fec4ea P de300fca51d9412da200cd66cd386b77 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 15:25:58.139559 391 raft_consensus.cc:482] T 9a7f56e59ba44589ae4a52dc61fec4ea P de300fca51d9412da200cd66cd386b77 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 15:25:58.139585 391 raft_consensus.cc:3037] T 9a7f56e59ba44589ae4a52dc61fec4ea P de300fca51d9412da200cd66cd386b77 [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:25:58.140375 391 raft_consensus.cc:504] T 9a7f56e59ba44589ae4a52dc61fec4ea P de300fca51d9412da200cd66cd386b77 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8634a1a1351c4aee98e49d7a28011068" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35769 } } peers { permanent_uuid: "de300fca51d9412da200cd66cd386b77" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 42597 } } peers { permanent_uuid: "da89159b612c4f32ad4b826d61f0b6ef" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 44627 } }
I20260810 15:25:58.140540 391 leader_election.cc:288] T 9a7f56e59ba44589ae4a52dc61fec4ea P de300fca51d9412da200cd66cd386b77 [CANDIDATE]: Term 1 election: Requested vote from peers 8634a1a1351c4aee98e49d7a28011068 (127.18.68.129:35769), da89159b612c4f32ad4b826d61f0b6ef (127.18.68.131:44627)
I20260810 15:25:58.140707 32721 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a7f56e59ba44589ae4a52dc61fec4ea" candidate_uuid: "de300fca51d9412da200cd66cd386b77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da89159b612c4f32ad4b826d61f0b6ef"
I20260810 15:25:58.140735 32212 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a7f56e59ba44589ae4a52dc61fec4ea" candidate_uuid: "de300fca51d9412da200cd66cd386b77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8634a1a1351c4aee98e49d7a28011068"
I20260810 15:25:58.140806 32721 raft_consensus.cc:3037] T 9a7f56e59ba44589ae4a52dc61fec4ea P da89159b612c4f32ad4b826d61f0b6ef [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:25:58.140833 32212 raft_consensus.cc:3037] T 9a7f56e59ba44589ae4a52dc61fec4ea P 8634a1a1351c4aee98e49d7a28011068 [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:25:58.141508 32212 raft_consensus.cc:2454] T 9a7f56e59ba44589ae4a52dc61fec4ea P 8634a1a1351c4aee98e49d7a28011068 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de300fca51d9412da200cd66cd386b77 in term 1.
I20260810 15:25:58.141604 32721 raft_consensus.cc:2454] T 9a7f56e59ba44589ae4a52dc61fec4ea P da89159b612c4f32ad4b826d61f0b6ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de300fca51d9412da200cd66cd386b77 in term 1.
I20260810 15:25:58.141695 32337 leader_election.cc:302] T 9a7f56e59ba44589ae4a52dc61fec4ea P de300fca51d9412da200cd66cd386b77 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8634a1a1351c4aee98e49d7a28011068, de300fca51d9412da200cd66cd386b77; no voters:
I20260810 15:25:58.141777 391 raft_consensus.cc:2781] T 9a7f56e59ba44589ae4a52dc61fec4ea P de300fca51d9412da200cd66cd386b77 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 15:25:58.141906 391 raft_consensus.cc:686] T 9a7f56e59ba44589ae4a52dc61fec4ea P de300fca51d9412da200cd66cd386b77 [term 1 LEADER]: Becoming Leader. State: Replica: de300fca51d9412da200cd66cd386b77, State: Running, Role: LEADER
I20260810 15:25:58.141976 391 consensus_queue.cc:237] T 9a7f56e59ba44589ae4a52dc61fec4ea P de300fca51d9412da200cd66cd386b77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8634a1a1351c4aee98e49d7a28011068" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35769 } } peers { permanent_uuid: "de300fca51d9412da200cd66cd386b77" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 42597 } } peers { permanent_uuid: "da89159b612c4f32ad4b826d61f0b6ef" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 44627 } }
I20260810 15:25:58.142699 31940 catalog_manager.cc:5495] T 9a7f56e59ba44589ae4a52dc61fec4ea P de300fca51d9412da200cd66cd386b77 reported cstate change: term changed from 0 to 1, leader changed from <none> to de300fca51d9412da200cd66cd386b77 (127.18.68.130). New cstate: current_term: 1 leader_uuid: "de300fca51d9412da200cd66cd386b77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8634a1a1351c4aee98e49d7a28011068" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de300fca51d9412da200cd66cd386b77" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 42597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da89159b612c4f32ad4b826d61f0b6ef" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 44627 } health_report { overall_health: UNKNOWN } } }
Aug 10 15:25:58 dist-test-slave-2p8l krb5kdc[31864](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375557, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.68.190@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM
I20260810 15:25:58.206276 32026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:58.198827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35888 (local address 127.18.68.190:44713)
0810 15:25:58.198916 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:58.198919 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:58.199051 (+ 132us) server_negotiation.cc:407] Connection header received
0810 15:25:58.199124 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:58.199125 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:58.199135 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:58.199209 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:58.199691 (+ 482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:58.200176 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:58.200887 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:58.201070 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:58.201186 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:58.203427 (+ 2241us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:58.203428 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:58.203429 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:58.203437 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:58.205013 (+ 1576us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:58.205414 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:58.205416 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:58.205416 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:58.205473 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:58.205671 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:58.205672 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:58.205672 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:58.205783 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:58.205861 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:58.206014 (+ 153us) server_negotiation.cc:299] Negotiation successful
0810 15:25:58.206196 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":107,"server-negotiator.queue_time_us":37}
I20260810 15:25:58.206284 447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:58.198745 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:44713 (local address 127.0.0.1:35888)
0810 15:25:58.198962 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:58.198973 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:58.199070 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:58.199213 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:58.199214 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:58.199547 (+ 333us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:25:58.199594 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:58.199596 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:58.200261 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:58.200262 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:58.200795 (+ 533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:58.200797 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:58.201186 (+ 389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:58.201186 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:58.201241 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:58.201827 (+ 586us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:25:58.201832 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:25:58.203334 (+ 1502us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:25:58.205114 (+ 1780us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:58.205122 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:58.205125 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:58.205321 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:58.205541 (+ 220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:25:58.205543 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:25:58.205543 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:25:58.205602 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:25:58.205851 (+ 249us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:25:58.205859 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:25:58.205912 (+ 53us) client_negotiation.cc:769] Sending connection context
0810 15:25:58.205989 (+ 77us) client_negotiation.cc:240] Negotiation successful
0810 15:25:58.206145 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":188,"mutex_wait_us":2,"thread_start_us":134,"threads_started":1}
I20260810 15:25:58.208348 31940 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.18.68.190@KRBTEST.COM'} at 127.0.0.1:35888:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260810 15:25:58.208560 31940 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 15:25:58.210166 32423 tablet_service.cc:1467] Processing CreateTablet for tablet 2d12137b945b45f797afe96306525759 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=443b562c3c8e4b56ab97ac9aa7ed3cad]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 15:25:58.210175 32178 tablet_service.cc:1467] Processing CreateTablet for tablet 2d12137b945b45f797afe96306525759 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=443b562c3c8e4b56ab97ac9aa7ed3cad]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 15:25:58.210224 32688 tablet_service.cc:1467] Processing CreateTablet for tablet 2d12137b945b45f797afe96306525759 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=443b562c3c8e4b56ab97ac9aa7ed3cad]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 15:25:58.210345 32423 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2d12137b945b45f797afe96306525759. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:25:58.210345 32178 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2d12137b945b45f797afe96306525759. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:25:58.210388 32688 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2d12137b945b45f797afe96306525759. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:25:58.211624 383 tablet_bootstrap.cc:492] T 2d12137b945b45f797afe96306525759 P da89159b612c4f32ad4b826d61f0b6ef: Bootstrap starting.
I20260810 15:25:58.211872 378 tablet_bootstrap.cc:492] T 2d12137b945b45f797afe96306525759 P 8634a1a1351c4aee98e49d7a28011068: Bootstrap starting.
I20260810 15:25:58.211872 374 tablet_bootstrap.cc:492] T 2d12137b945b45f797afe96306525759 P de300fca51d9412da200cd66cd386b77: Bootstrap starting.
I20260810 15:25:58.212034 383 tablet_bootstrap.cc:654] T 2d12137b945b45f797afe96306525759 P da89159b612c4f32ad4b826d61f0b6ef: Neither blocks nor log segments found. Creating new log.
I20260810 15:25:58.212214 378 tablet_bootstrap.cc:654] T 2d12137b945b45f797afe96306525759 P 8634a1a1351c4aee98e49d7a28011068: Neither blocks nor log segments found. Creating new log.
I20260810 15:25:58.212327 374 tablet_bootstrap.cc:654] T 2d12137b945b45f797afe96306525759 P de300fca51d9412da200cd66cd386b77: Neither blocks nor log segments found. Creating new log.
I20260810 15:25:58.212837 378 tablet_bootstrap.cc:492] T 2d12137b945b45f797afe96306525759 P 8634a1a1351c4aee98e49d7a28011068: No bootstrap required, opened a new log
I20260810 15:25:58.212903 378 ts_tablet_manager.cc:1397] T 2d12137b945b45f797afe96306525759 P 8634a1a1351c4aee98e49d7a28011068: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260810 15:25:58.212929 383 tablet_bootstrap.cc:492] T 2d12137b945b45f797afe96306525759 P da89159b612c4f32ad4b826d61f0b6ef: No bootstrap required, opened a new log
I20260810 15:25:58.212978 383 ts_tablet_manager.cc:1397] T 2d12137b945b45f797afe96306525759 P da89159b612c4f32ad4b826d61f0b6ef: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260810 15:25:58.213022 378 raft_consensus.cc:348] T 2d12137b945b45f797afe96306525759 P 8634a1a1351c4aee98e49d7a28011068 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de300fca51d9412da200cd66cd386b77" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 42597 } } peers { permanent_uuid: "8634a1a1351c4aee98e49d7a28011068" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35769 } } peers { permanent_uuid: "da89159b612c4f32ad4b826d61f0b6ef" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 44627 } }
I20260810 15:25:58.213070 374 tablet_bootstrap.cc:492] T 2d12137b945b45f797afe96306525759 P de300fca51d9412da200cd66cd386b77: No bootstrap required, opened a new log
I20260810 15:25:58.213104 378 raft_consensus.cc:374] T 2d12137b945b45f797afe96306525759 P 8634a1a1351c4aee98e49d7a28011068 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:25:58.213127 374 ts_tablet_manager.cc:1397] T 2d12137b945b45f797afe96306525759 P de300fca51d9412da200cd66cd386b77: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260810 15:25:58.213135 378 raft_consensus.cc:729] T 2d12137b945b45f797afe96306525759 P 8634a1a1351c4aee98e49d7a28011068 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8634a1a1351c4aee98e49d7a28011068, State: Initialized, Role: FOLLOWER
I20260810 15:25:58.213133 383 raft_consensus.cc:348] T 2d12137b945b45f797afe96306525759 P da89159b612c4f32ad4b826d61f0b6ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de300fca51d9412da200cd66cd386b77" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 42597 } } peers { permanent_uuid: "8634a1a1351c4aee98e49d7a28011068" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35769 } } peers { permanent_uuid: "da89159b612c4f32ad4b826d61f0b6ef" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 44627 } }
I20260810 15:25:58.213210 383 raft_consensus.cc:374] T 2d12137b945b45f797afe96306525759 P da89159b612c4f32ad4b826d61f0b6ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:25:58.213195 378 consensus_queue.cc:260] T 2d12137b945b45f797afe96306525759 P 8634a1a1351c4aee98e49d7a28011068 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de300fca51d9412da200cd66cd386b77" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 42597 } } peers { permanent_uuid: "8634a1a1351c4aee98e49d7a28011068" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35769 } } peers { permanent_uuid: "da89159b612c4f32ad4b826d61f0b6ef" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 44627 } }
I20260810 15:25:58.213238 383 raft_consensus.cc:729] T 2d12137b945b45f797afe96306525759 P da89159b612c4f32ad4b826d61f0b6ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da89159b612c4f32ad4b826d61f0b6ef, State: Initialized, Role: FOLLOWER
I20260810 15:25:58.213276 383 consensus_queue.cc:260] T 2d12137b945b45f797afe96306525759 P da89159b612c4f32ad4b826d61f0b6ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de300fca51d9412da200cd66cd386b77" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 42597 } } peers { permanent_uuid: "8634a1a1351c4aee98e49d7a28011068" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35769 } } peers { permanent_uuid: "da89159b612c4f32ad4b826d61f0b6ef" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 44627 } }
I20260810 15:25:58.213295 378 ts_tablet_manager.cc:1428] T 2d12137b945b45f797afe96306525759 P 8634a1a1351c4aee98e49d7a28011068: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260810 15:25:58.213280 374 raft_consensus.cc:348] T 2d12137b945b45f797afe96306525759 P de300fca51d9412da200cd66cd386b77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de300fca51d9412da200cd66cd386b77" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 42597 } } peers { permanent_uuid: "8634a1a1351c4aee98e49d7a28011068" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35769 } } peers { permanent_uuid: "da89159b612c4f32ad4b826d61f0b6ef" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 44627 } }
I20260810 15:25:58.213357 374 raft_consensus.cc:374] T 2d12137b945b45f797afe96306525759 P de300fca51d9412da200cd66cd386b77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:25:58.213377 383 ts_tablet_manager.cc:1428] T 2d12137b945b45f797afe96306525759 P da89159b612c4f32ad4b826d61f0b6ef: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260810 15:25:58.213385 374 raft_consensus.cc:729] T 2d12137b945b45f797afe96306525759 P de300fca51d9412da200cd66cd386b77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de300fca51d9412da200cd66cd386b77, State: Initialized, Role: FOLLOWER
I20260810 15:25:58.213433 374 consensus_queue.cc:260] T 2d12137b945b45f797afe96306525759 P de300fca51d9412da200cd66cd386b77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de300fca51d9412da200cd66cd386b77" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 42597 } } peers { permanent_uuid: "8634a1a1351c4aee98e49d7a28011068" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35769 } } peers { permanent_uuid: "da89159b612c4f32ad4b826d61f0b6ef" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 44627 } }
I20260810 15:25:58.213426 413 tablet_replica.cc:439] T 2d12137b945b45f797afe96306525759 P 8634a1a1351c4aee98e49d7a28011068: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de300fca51d9412da200cd66cd386b77" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 42597 } } peers { permanent_uuid: "8634a1a1351c4aee98e49d7a28011068" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35769 } } peers { permanent_uuid: "da89159b612c4f32ad4b826d61f0b6ef" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 44627 } } }
I20260810 15:25:58.213497 413 tablet_replica.cc:442] T 2d12137b945b45f797afe96306525759 P 8634a1a1351c4aee98e49d7a28011068: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 15:25:58.213514 374 ts_tablet_manager.cc:1428] T 2d12137b945b45f797afe96306525759 P de300fca51d9412da200cd66cd386b77: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:58.213501 393 tablet_replica.cc:439] T 2d12137b945b45f797afe96306525759 P da89159b612c4f32ad4b826d61f0b6ef: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de300fca51d9412da200cd66cd386b77" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 42597 } } peers { permanent_uuid: "8634a1a1351c4aee98e49d7a28011068" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35769 } } peers { permanent_uuid: "da89159b612c4f32ad4b826d61f0b6ef" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 44627 } } }
I20260810 15:25:58.213574 393 tablet_replica.cc:442] T 2d12137b945b45f797afe96306525759 P da89159b612c4f32ad4b826d61f0b6ef: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 15:25:58.213685 391 tablet_replica.cc:439] T 2d12137b945b45f797afe96306525759 P de300fca51d9412da200cd66cd386b77: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de300fca51d9412da200cd66cd386b77" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 42597 } } peers { permanent_uuid: "8634a1a1351c4aee98e49d7a28011068" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35769 } } peers { permanent_uuid: "da89159b612c4f32ad4b826d61f0b6ef" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 44627 } } }
I20260810 15:25:58.213761 391 tablet_replica.cc:442] T 2d12137b945b45f797afe96306525759 P de300fca51d9412da200cd66cd386b77: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 15:25:58.300076 393 raft_consensus.cc:482] T 2d12137b945b45f797afe96306525759 P da89159b612c4f32ad4b826d61f0b6ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 15:25:58.300192 393 raft_consensus.cc:504] T 2d12137b945b45f797afe96306525759 P da89159b612c4f32ad4b826d61f0b6ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de300fca51d9412da200cd66cd386b77" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 42597 } } peers { permanent_uuid: "8634a1a1351c4aee98e49d7a28011068" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35769 } } peers { permanent_uuid: "da89159b612c4f32ad4b826d61f0b6ef" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 44627 } }
I20260810 15:25:58.300544 393 leader_election.cc:288] T 2d12137b945b45f797afe96306525759 P da89159b612c4f32ad4b826d61f0b6ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de300fca51d9412da200cd66cd386b77 (127.18.68.130:42597), 8634a1a1351c4aee98e49d7a28011068 (127.18.68.129:35769)
I20260810 15:25:58.303604 457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:58.300758 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.130:42597 (local address 127.18.68.131:46391)
0810 15:25:58.300960 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:58.300978 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:58.301064 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:58.301237 (+ 173us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:58.301237 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:58.301258 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:25:58.301331 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:58.301333 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:58.301972 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:58.301973 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:58.302767 (+ 794us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:58.302770 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:58.303331 (+ 561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:58.303332 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:58.303405 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:58.303410 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 15:25:58.303465 (+ 55us) client_negotiation.cc:240] Negotiation successful
0810 15:25:58.303502 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":188,"mutex_wait_us":66,"thread_start_us":92,"threads_started":1}
I20260810 15:25:58.303601 369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:58.300825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.131:46391 (local address 127.18.68.130:42597)
0810 15:25:58.300896 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:58.300899 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:58.301078 (+ 179us) server_negotiation.cc:407] Connection header received
0810 15:25:58.301139 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:58.301140 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:58.301150 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:58.301225 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:25:58.301407 (+ 182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:58.301862 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:58.302886 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:58.303256 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:58.303314 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:58.303321 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:58.303470 (+ 149us) server_negotiation.cc:299] Negotiation successful
0810 15:25:58.303517 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260810 15:25:58.303723 366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:58.300852 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.131:47453 (local address 127.18.68.129:35769)
0810 15:25:58.300928 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:58.300930 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:58.301048 (+ 118us) server_negotiation.cc:407] Connection header received
0810 15:25:58.301081 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:58.301082 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:58.301093 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:58.301144 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:25:58.301338 (+ 194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:58.301851 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:58.302846 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:58.303331 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:58.303416 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:58.303425 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:58.303599 (+ 174us) server_negotiation.cc:299] Negotiation successful
0810 15:25:58.303646 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260810 15:25:58.303956 455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:58.300755 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.129:35769 (local address 127.18.68.131:47453)
0810 15:25:58.300943 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:58.300953 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:58.301010 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:58.301159 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:58.301160 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:58.301162 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:25:58.301252 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:58.301255 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:58.301930 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:58.301931 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:58.302753 (+ 822us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:58.302756 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:58.303443 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:58.303444 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:58.303518 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:58.303522 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 15:25:58.303577 (+ 55us) client_negotiation.cc:240] Negotiation successful
0810 15:25:58.303622 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":106,"threads_started":1}
I20260810 15:25:58.303977 32462 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d12137b945b45f797afe96306525759" candidate_uuid: "da89159b612c4f32ad4b826d61f0b6ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de300fca51d9412da200cd66cd386b77" is_pre_election: true
I20260810 15:25:58.304096 32462 raft_consensus.cc:2454] T 2d12137b945b45f797afe96306525759 P de300fca51d9412da200cd66cd386b77 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da89159b612c4f32ad4b826d61f0b6ef in term 0.
I20260810 15:25:58.304214 32212 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d12137b945b45f797afe96306525759" candidate_uuid: "da89159b612c4f32ad4b826d61f0b6ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8634a1a1351c4aee98e49d7a28011068" is_pre_election: true
I20260810 15:25:58.304296 32212 raft_consensus.cc:2454] T 2d12137b945b45f797afe96306525759 P 8634a1a1351c4aee98e49d7a28011068 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da89159b612c4f32ad4b826d61f0b6ef in term 0.
I20260810 15:25:58.304272 32611 leader_election.cc:302] T 2d12137b945b45f797afe96306525759 P da89159b612c4f32ad4b826d61f0b6ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: da89159b612c4f32ad4b826d61f0b6ef, de300fca51d9412da200cd66cd386b77; no voters:
I20260810 15:25:58.304404 393 raft_consensus.cc:2781] T 2d12137b945b45f797afe96306525759 P da89159b612c4f32ad4b826d61f0b6ef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 15:25:58.304447 393 raft_consensus.cc:482] T 2d12137b945b45f797afe96306525759 P da89159b612c4f32ad4b826d61f0b6ef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 15:25:58.304471 393 raft_consensus.cc:3037] T 2d12137b945b45f797afe96306525759 P da89159b612c4f32ad4b826d61f0b6ef [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:25:58.305341 393 raft_consensus.cc:504] T 2d12137b945b45f797afe96306525759 P da89159b612c4f32ad4b826d61f0b6ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de300fca51d9412da200cd66cd386b77" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 42597 } } peers { permanent_uuid: "8634a1a1351c4aee98e49d7a28011068" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35769 } } peers { permanent_uuid: "da89159b612c4f32ad4b826d61f0b6ef" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 44627 } }
I20260810 15:25:58.305471 393 leader_election.cc:288] T 2d12137b945b45f797afe96306525759 P da89159b612c4f32ad4b826d61f0b6ef [CANDIDATE]: Term 1 election: Requested vote from peers de300fca51d9412da200cd66cd386b77 (127.18.68.130:42597), 8634a1a1351c4aee98e49d7a28011068 (127.18.68.129:35769)
I20260810 15:25:58.305729 32462 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d12137b945b45f797afe96306525759" candidate_uuid: "da89159b612c4f32ad4b826d61f0b6ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de300fca51d9412da200cd66cd386b77"
I20260810 15:25:58.305810 32462 raft_consensus.cc:3037] T 2d12137b945b45f797afe96306525759 P de300fca51d9412da200cd66cd386b77 [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:25:58.305783 32212 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d12137b945b45f797afe96306525759" candidate_uuid: "da89159b612c4f32ad4b826d61f0b6ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8634a1a1351c4aee98e49d7a28011068"
I20260810 15:25:58.305886 32212 raft_consensus.cc:3037] T 2d12137b945b45f797afe96306525759 P 8634a1a1351c4aee98e49d7a28011068 [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:25:58.306540 32462 raft_consensus.cc:2454] T 2d12137b945b45f797afe96306525759 P de300fca51d9412da200cd66cd386b77 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da89159b612c4f32ad4b826d61f0b6ef in term 1.
I20260810 15:25:58.306574 32212 raft_consensus.cc:2454] T 2d12137b945b45f797afe96306525759 P 8634a1a1351c4aee98e49d7a28011068 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da89159b612c4f32ad4b826d61f0b6ef in term 1.
I20260810 15:25:58.306767 32606 leader_election.cc:302] T 2d12137b945b45f797afe96306525759 P da89159b612c4f32ad4b826d61f0b6ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8634a1a1351c4aee98e49d7a28011068, da89159b612c4f32ad4b826d61f0b6ef; no voters:
I20260810 15:25:58.306882 393 raft_consensus.cc:2781] T 2d12137b945b45f797afe96306525759 P da89159b612c4f32ad4b826d61f0b6ef [term 1 FOLLOWER]: Leader election won for term 1
I20260810 15:25:58.307030 393 raft_consensus.cc:686] T 2d12137b945b45f797afe96306525759 P da89159b612c4f32ad4b826d61f0b6ef [term 1 LEADER]: Becoming Leader. State: Replica: da89159b612c4f32ad4b826d61f0b6ef, State: Running, Role: LEADER
I20260810 15:25:58.307101 393 consensus_queue.cc:237] T 2d12137b945b45f797afe96306525759 P da89159b612c4f32ad4b826d61f0b6ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de300fca51d9412da200cd66cd386b77" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 42597 } } peers { permanent_uuid: "8634a1a1351c4aee98e49d7a28011068" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35769 } } peers { permanent_uuid: "da89159b612c4f32ad4b826d61f0b6ef" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 44627 } }
I20260810 15:25:58.307449 458 tablet_replica.cc:439] T 2d12137b945b45f797afe96306525759 P da89159b612c4f32ad4b826d61f0b6ef: TxnStatusTablet state changed. Reason: New leader da89159b612c4f32ad4b826d61f0b6ef. Latest consensus state: current_term: 1 leader_uuid: "da89159b612c4f32ad4b826d61f0b6ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de300fca51d9412da200cd66cd386b77" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 42597 } } peers { permanent_uuid: "8634a1a1351c4aee98e49d7a28011068" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35769 } } peers { permanent_uuid: "da89159b612c4f32ad4b826d61f0b6ef" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 44627 } } }
I20260810 15:25:58.307528 458 tablet_replica.cc:442] T 2d12137b945b45f797afe96306525759 P da89159b612c4f32ad4b826d61f0b6ef: This TxnStatusTablet replica's current role is: LEADER
I20260810 15:25:58.307713 462 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260810 15:25:58.307826 462 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260810 15:25:58.307845 31945 catalog_manager.cc:5495] T 2d12137b945b45f797afe96306525759 P da89159b612c4f32ad4b826d61f0b6ef reported cstate change: term changed from 0 to 1, leader changed from <none> to da89159b612c4f32ad4b826d61f0b6ef (127.18.68.131). New cstate: current_term: 1 leader_uuid: "da89159b612c4f32ad4b826d61f0b6ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de300fca51d9412da200cd66cd386b77" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 42597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8634a1a1351c4aee98e49d7a28011068" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da89159b612c4f32ad4b826d61f0b6ef" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 44627 } health_report { overall_health: HEALTHY } } }
I20260810 15:25:58.333173 447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:58.330580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.131:44627 (local address 127.0.0.1:47640)
0810 15:25:58.330653 (+ 73us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:58.330665 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:58.330720 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:58.330969 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:58.330970 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:58.330971 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 15:25:58.331026 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:58.331028 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:58.331665 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:58.331666 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:58.332244 (+ 578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:58.332246 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:58.332627 (+ 381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:58.332629 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:58.332690 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:58.332705 (+ 15us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 15:25:58.332981 (+ 276us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 15:25:58.332991 (+ 10us) client_negotiation.cc:769] Sending connection context
0810 15:25:58.333037 (+ 46us) client_negotiation.cc:240] Negotiation successful
0810 15:25:58.333091 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260810 15:25:58.333187 373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:58.330667 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47640 (local address 127.18.68.131:44627)
0810 15:25:58.330722 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:58.330724 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:58.330733 (+ 9us) server_negotiation.cc:407] Connection header received
0810 15:25:58.330857 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:58.330858 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:58.330878 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:58.330965 (+ 87us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 15:25:58.331111 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:58.331581 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:58.332336 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:58.332544 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:58.332616 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:58.332804 (+ 188us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 15:25:58.332911 (+ 107us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 15:25:58.332996 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:58.333050 (+ 54us) server_negotiation.cc:299] Negotiation successful
0810 15:25:58.333069 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260810 15:25:58.334406 32462 raft_consensus.cc:1261] T 2d12137b945b45f797afe96306525759 P de300fca51d9412da200cd66cd386b77 [term 1 FOLLOWER]: Refusing update from remote peer da89159b612c4f32ad4b826d61f0b6ef: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 15:25:58.334523 32212 raft_consensus.cc:1261] T 2d12137b945b45f797afe96306525759 P 8634a1a1351c4aee98e49d7a28011068 [term 1 FOLLOWER]: Refusing update from remote peer da89159b612c4f32ad4b826d61f0b6ef: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 15:25:58.334682 393 consensus_queue.cc:1035] T 2d12137b945b45f797afe96306525759 P da89159b612c4f32ad4b826d61f0b6ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "de300fca51d9412da200cd66cd386b77" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 42597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 15:25:58.334802 458 consensus_queue.cc:1035] T 2d12137b945b45f797afe96306525759 P da89159b612c4f32ad4b826d61f0b6ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "8634a1a1351c4aee98e49d7a28011068" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 15:25:58.335906 391 tablet_replica.cc:439] T 2d12137b945b45f797afe96306525759 P de300fca51d9412da200cd66cd386b77: TxnStatusTablet state changed. Reason: New leader da89159b612c4f32ad4b826d61f0b6ef. Latest consensus state: current_term: 1 leader_uuid: "da89159b612c4f32ad4b826d61f0b6ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de300fca51d9412da200cd66cd386b77" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 42597 } } peers { permanent_uuid: "8634a1a1351c4aee98e49d7a28011068" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35769 } } peers { permanent_uuid: "da89159b612c4f32ad4b826d61f0b6ef" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 44627 } } }
I20260810 15:25:58.336001 391 tablet_replica.cc:442] T 2d12137b945b45f797afe96306525759 P de300fca51d9412da200cd66cd386b77: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 15:25:58.336422 393 tablet_replica.cc:439] T 2d12137b945b45f797afe96306525759 P da89159b612c4f32ad4b826d61f0b6ef: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "da89159b612c4f32ad4b826d61f0b6ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de300fca51d9412da200cd66cd386b77" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 42597 } } peers { permanent_uuid: "8634a1a1351c4aee98e49d7a28011068" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35769 } } peers { permanent_uuid: "da89159b612c4f32ad4b826d61f0b6ef" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 44627 } } }
I20260810 15:25:58.336527 393 tablet_replica.cc:442] T 2d12137b945b45f797afe96306525759 P da89159b612c4f32ad4b826d61f0b6ef: This TxnStatusTablet replica's current role is: LEADER
I20260810 15:25:58.337065 391 tablet_replica.cc:439] T 2d12137b945b45f797afe96306525759 P de300fca51d9412da200cd66cd386b77: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "da89159b612c4f32ad4b826d61f0b6ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de300fca51d9412da200cd66cd386b77" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 42597 } } peers { permanent_uuid: "8634a1a1351c4aee98e49d7a28011068" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35769 } } peers { permanent_uuid: "da89159b612c4f32ad4b826d61f0b6ef" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 44627 } } }
I20260810 15:25:58.337141 391 tablet_replica.cc:442] T 2d12137b945b45f797afe96306525759 P de300fca51d9412da200cd66cd386b77: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 15:25:58.338708 413 tablet_replica.cc:439] T 2d12137b945b45f797afe96306525759 P 8634a1a1351c4aee98e49d7a28011068: TxnStatusTablet state changed. Reason: New leader da89159b612c4f32ad4b826d61f0b6ef. Latest consensus state: current_term: 1 leader_uuid: "da89159b612c4f32ad4b826d61f0b6ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de300fca51d9412da200cd66cd386b77" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 42597 } } peers { permanent_uuid: "8634a1a1351c4aee98e49d7a28011068" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35769 } } peers { permanent_uuid: "da89159b612c4f32ad4b826d61f0b6ef" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 44627 } } }
I20260810 15:25:58.338801 413 tablet_replica.cc:442] T 2d12137b945b45f797afe96306525759 P 8634a1a1351c4aee98e49d7a28011068: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 15:25:58.339586 458 tablet_replica.cc:439] T 2d12137b945b45f797afe96306525759 P da89159b612c4f32ad4b826d61f0b6ef: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "da89159b612c4f32ad4b826d61f0b6ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de300fca51d9412da200cd66cd386b77" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 42597 } } peers { permanent_uuid: "8634a1a1351c4aee98e49d7a28011068" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35769 } } peers { permanent_uuid: "da89159b612c4f32ad4b826d61f0b6ef" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 44627 } } }
I20260810 15:25:58.339672 458 tablet_replica.cc:442] T 2d12137b945b45f797afe96306525759 P da89159b612c4f32ad4b826d61f0b6ef: This TxnStatusTablet replica's current role is: LEADER
I20260810 15:25:58.340318 413 tablet_replica.cc:439] T 2d12137b945b45f797afe96306525759 P 8634a1a1351c4aee98e49d7a28011068: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "da89159b612c4f32ad4b826d61f0b6ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de300fca51d9412da200cd66cd386b77" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 42597 } } peers { permanent_uuid: "8634a1a1351c4aee98e49d7a28011068" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35769 } } peers { permanent_uuid: "da89159b612c4f32ad4b826d61f0b6ef" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 44627 } } }
I20260810 15:25:58.340397 413 tablet_replica.cc:442] T 2d12137b945b45f797afe96306525759 P 8634a1a1351c4aee98e49d7a28011068: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 15:25:58.342492 369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:58.339925 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34394 (local address 127.18.68.130:42597)
0810 15:25:58.339964 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:58.339965 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:58.339972 (+ 7us) server_negotiation.cc:407] Connection header received
0810 15:25:58.340011 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:58.340011 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:58.340047 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:58.340112 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 15:25:58.340276 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:58.340868 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:58.341587 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:58.341796 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:58.341873 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:58.342016 (+ 143us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 15:25:58.342211 (+ 195us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 15:25:58.342282 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:58.342377 (+ 95us) server_negotiation.cc:299] Negotiation successful
0810 15:25:58.342397 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260810 15:25:58.347558 373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:58.345034 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.130:40671 (local address 127.18.68.131:44627)
0810 15:25:58.345079 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:58.345081 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:58.345202 (+ 121us) server_negotiation.cc:407] Connection header received
0810 15:25:58.345275 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:58.345276 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:58.345285 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:58.345325 (+ 40us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 15:25:58.345490 (+ 165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:58.345959 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:58.346838 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:58.347030 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:58.347105 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:58.347308 (+ 203us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 15:25:58.347346 (+ 38us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 15:25:58.347403 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:58.347474 (+ 71us) server_negotiation.cc:299] Negotiation successful
0810 15:25:58.347494 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260810 15:25:58.347605 480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:58.344966 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.131:44627 (local address 127.18.68.130:40671)
0810 15:25:58.345111 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:58.345121 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:58.345217 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:58.345337 (+ 120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:58.345338 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:58.345339 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 15:25:58.345418 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:58.345419 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:58.346044 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:58.346045 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:58.346739 (+ 694us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:58.346741 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:58.347127 (+ 386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:58.347128 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:58.347199 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:58.347212 (+ 13us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 15:25:58.347419 (+ 207us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 15:25:58.347421 (+ 2us) client_negotiation.cc:769] Sending connection context
0810 15:25:58.347469 (+ 48us) client_negotiation.cc:240] Negotiation successful
0810 15:25:58.347513 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":77,"threads_started":1}
I20260810 15:25:58.350184 32721 raft_consensus.cc:1261] T 9a7f56e59ba44589ae4a52dc61fec4ea P da89159b612c4f32ad4b826d61f0b6ef [term 1 FOLLOWER]: Refusing update from remote peer de300fca51d9412da200cd66cd386b77: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 15:25:58.350219 32212 raft_consensus.cc:1261] T 9a7f56e59ba44589ae4a52dc61fec4ea P 8634a1a1351c4aee98e49d7a28011068 [term 1 FOLLOWER]: Refusing update from remote peer de300fca51d9412da200cd66cd386b77: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 15:25:58.350456 391 consensus_queue.cc:1035] T 9a7f56e59ba44589ae4a52dc61fec4ea P de300fca51d9412da200cd66cd386b77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8634a1a1351c4aee98e49d7a28011068" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 15:25:58.350828 433 consensus_queue.cc:1035] T 9a7f56e59ba44589ae4a52dc61fec4ea P de300fca51d9412da200cd66cd386b77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da89159b612c4f32ad4b826d61f0b6ef" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 44627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 15:25:58.359510 369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:58.356466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.131:56893 (local address 127.18.68.130:42597)
0810 15:25:58.356531 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:58.356533 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:58.356679 (+ 146us) server_negotiation.cc:407] Connection header received
0810 15:25:58.356712 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:58.356713 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:58.356722 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:58.356791 (+ 69us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 15:25:58.356909 (+ 118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:58.357633 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:58.358743 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:58.359045 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:58.359119 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:58.359290 (+ 171us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 15:25:58.359324 (+ 34us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 15:25:58.359378 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:58.359424 (+ 46us) server_negotiation.cc:299] Negotiation successful
0810 15:25:58.359443 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260810 15:25:58.359537 488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:58.356408 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.130:42597 (local address 127.18.68.131:56893)
0810 15:25:58.356608 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:58.356618 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:58.356673 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:58.356792 (+ 119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:58.356792 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:58.356793 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 15:25:58.356845 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:58.356846 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:58.357736 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:58.357738 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:58.358663 (+ 925us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:58.358666 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:58.359143 (+ 477us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:58.359144 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:58.359192 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:58.359207 (+ 15us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 15:25:58.359385 (+ 178us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 15:25:58.359387 (+ 2us) client_negotiation.cc:769] Sending connection context
0810 15:25:58.359421 (+ 34us) client_negotiation.cc:240] Negotiation successful
0810 15:25:58.359456 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":92,"threads_started":1}
I20260810 15:25:58.368948 31939 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35882:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 15:25:58.369076 31939 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35882:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 15:25:58.369736 31939 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a9407d5b536b43818777ecc7b5d82e0b: Sending DeleteTablet for 3 replicas of tablet 9a7f56e59ba44589ae4a52dc61fec4ea
I20260810 15:25:58.370041 32178 tablet_service.cc:1514] Processing DeleteTablet for tablet 9a7f56e59ba44589ae4a52dc61fec4ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 15:25:58 UTC) from {username='oryx', principal='oryx/127.18.68.190@KRBTEST.COM'} at 127.0.0.1:56958
I20260810 15:25:58.370122 32688 tablet_service.cc:1514] Processing DeleteTablet for tablet 9a7f56e59ba44589ae4a52dc61fec4ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 15:25:58 UTC) from {username='oryx', principal='oryx/127.18.68.190@KRBTEST.COM'} at 127.0.0.1:47638
I20260810 15:25:58.370174 420 tablet_replica.cc:330] T 9a7f56e59ba44589ae4a52dc61fec4ea P 8634a1a1351c4aee98e49d7a28011068: stopping tablet replica
I20260810 15:25:58.370154 32423 tablet_service.cc:1514] Processing DeleteTablet for tablet 9a7f56e59ba44589ae4a52dc61fec4ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 15:25:58 UTC) from {username='oryx', principal='oryx/127.18.68.190@KRBTEST.COM'} at 127.0.0.1:34390
I20260810 15:25:58.370240 420 raft_consensus.cc:2229] T 9a7f56e59ba44589ae4a52dc61fec4ea P 8634a1a1351c4aee98e49d7a28011068 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 15:25:58.370280 420 raft_consensus.cc:2258] T 9a7f56e59ba44589ae4a52dc61fec4ea P 8634a1a1351c4aee98e49d7a28011068 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 15:25:58.370280 423 tablet_replica.cc:330] T 9a7f56e59ba44589ae4a52dc61fec4ea P de300fca51d9412da200cd66cd386b77: stopping tablet replica
I20260810 15:25:58.370350 421 tablet_replica.cc:330] T 9a7f56e59ba44589ae4a52dc61fec4ea P da89159b612c4f32ad4b826d61f0b6ef: stopping tablet replica
I20260810 15:25:58.370345 423 raft_consensus.cc:2229] T 9a7f56e59ba44589ae4a52dc61fec4ea P de300fca51d9412da200cd66cd386b77 [term 1 LEADER]: Raft consensus shutting down.
I20260810 15:25:58.370411 421 raft_consensus.cc:2229] T 9a7f56e59ba44589ae4a52dc61fec4ea P da89159b612c4f32ad4b826d61f0b6ef [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 15:25:58.370446 421 raft_consensus.cc:2258] T 9a7f56e59ba44589ae4a52dc61fec4ea P da89159b612c4f32ad4b826d61f0b6ef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 15:25:58.370443 423 raft_consensus.cc:2258] T 9a7f56e59ba44589ae4a52dc61fec4ea P de300fca51d9412da200cd66cd386b77 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 15:25:58.370787 420 ts_tablet_manager.cc:1905] T 9a7f56e59ba44589ae4a52dc61fec4ea P 8634a1a1351c4aee98e49d7a28011068: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 15:25:58.370929 421 ts_tablet_manager.cc:1905] T 9a7f56e59ba44589ae4a52dc61fec4ea P da89159b612c4f32ad4b826d61f0b6ef: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 15:25:58.372658 420 ts_tablet_manager.cc:1918] T 9a7f56e59ba44589ae4a52dc61fec4ea P 8634a1a1351c4aee98e49d7a28011068: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 15:25:58.372670 421 ts_tablet_manager.cc:1918] T 9a7f56e59ba44589ae4a52dc61fec4ea P da89159b612c4f32ad4b826d61f0b6ef: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 15:25:58.372714 420 log.cc:1196] T 9a7f56e59ba44589ae4a52dc61fec4ea P 8634a1a1351c4aee98e49d7a28011068: Deleting WAL directory at /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/minicluster-data/ts-0/wal/wals/9a7f56e59ba44589ae4a52dc61fec4ea
I20260810 15:25:58.372728 421 log.cc:1196] T 9a7f56e59ba44589ae4a52dc61fec4ea P da89159b612c4f32ad4b826d61f0b6ef: Deleting WAL directory at /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/minicluster-data/ts-2/wal/wals/9a7f56e59ba44589ae4a52dc61fec4ea
I20260810 15:25:58.372967 420 ts_tablet_manager.cc:1939] T 9a7f56e59ba44589ae4a52dc61fec4ea P 8634a1a1351c4aee98e49d7a28011068: Deleting consensus metadata
I20260810 15:25:58.372967 421 ts_tablet_manager.cc:1939] T 9a7f56e59ba44589ae4a52dc61fec4ea P da89159b612c4f32ad4b826d61f0b6ef: Deleting consensus metadata
I20260810 15:25:58.373354 31921 catalog_manager.cc:4841] TS da89159b612c4f32ad4b826d61f0b6ef (127.18.68.131:44627): tablet 9a7f56e59ba44589ae4a52dc61fec4ea (table test-table [id=685160f224ae4469b76987bd71a82293]) successfully deleted
I20260810 15:25:58.373530 423 ts_tablet_manager.cc:1905] T 9a7f56e59ba44589ae4a52dc61fec4ea P de300fca51d9412da200cd66cd386b77: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 15:25:58.375126 423 ts_tablet_manager.cc:1918] T 9a7f56e59ba44589ae4a52dc61fec4ea P de300fca51d9412da200cd66cd386b77: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 15:25:58.375191 423 log.cc:1196] T 9a7f56e59ba44589ae4a52dc61fec4ea P de300fca51d9412da200cd66cd386b77: Deleting WAL directory at /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/minicluster-data/ts-1/wal/wals/9a7f56e59ba44589ae4a52dc61fec4ea
I20260810 15:25:58.375275 31915 catalog_manager.cc:4841] TS 8634a1a1351c4aee98e49d7a28011068 (127.18.68.129:35769): tablet 9a7f56e59ba44589ae4a52dc61fec4ea (table test-table [id=685160f224ae4469b76987bd71a82293]) successfully deleted
I20260810 15:25:58.375399 423 ts_tablet_manager.cc:1939] T 9a7f56e59ba44589ae4a52dc61fec4ea P de300fca51d9412da200cd66cd386b77: Deleting consensus metadata
I20260810 15:25:58.376478 31921 catalog_manager.cc:4841] TS de300fca51d9412da200cd66cd386b77 (127.18.68.130:42597): tablet 9a7f56e59ba44589ae4a52dc61fec4ea (table test-table [id=685160f224ae4469b76987bd71a82293]) successfully deleted
Aug 10 15:25:58 dist-test-slave-2p8l krb5kdc[31864](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375558, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 10 15:25:58 dist-test-slave-2p8l krb5kdc[31864](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 15:25:58 dist-test-slave-2p8l krb5kdc[31864](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
W20260810 15:25:58.410266 32026 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 15:25:58.402103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35898 (local address 127.18.68.190:44713)
0810 15:25:58.402161 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:58.402163 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:58.402344 (+ 181us) server_negotiation.cc:407] Connection header received
0810 15:25:58.402431 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:58.402432 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:58.402447 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:58.402558 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:58.403334 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:58.404098 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:58.405066 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:58.405327 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:58.405417 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:58.410139 (+ 4722us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35898: BlockingRecv error: recv got EOF from 127.0.0.1:35898 (error 108)
Metrics: {"server-negotiator.queue_time_us":25}
Aug 10 15:25:58 dist-test-slave-2p8l krb5kdc[31864](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375558, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM
I20260810 15:25:58.421351 32026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:58.411089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35912 (local address 127.18.68.190:44713)
0810 15:25:58.411131 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:58.411133 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:58.411609 (+ 476us) server_negotiation.cc:407] Connection header received
0810 15:25:58.411706 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:58.411707 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:58.411729 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:58.411835 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:25:58.412661 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:58.413282 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:58.414520 (+ 1238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:58.414749 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:58.414860 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:58.417655 (+ 2795us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:25:58.417657 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:25:58.417657 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:25:58.417665 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:25:58.419807 (+ 2142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:58.420316 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:58.420317 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:58.420318 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:58.420417 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:25:58.420778 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:25:58.420780 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:25:58.420780 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:25:58.420925 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:25:58.421041 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:58.421162 (+ 121us) server_negotiation.cc:299] Negotiation successful
0810 15:25:58.421240 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260810 15:25:58.423470 31939 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35912:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 15:25:58.423703 31939 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 15:25:58.425382 32178 tablet_service.cc:1467] Processing CreateTablet for tablet 921e664bfc494746a2689f801d563798 (DEFAULT_TABLE table=test-table [id=da556f185650422385f2cc6cdb261527]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 15:25:58.425472 32423 tablet_service.cc:1467] Processing CreateTablet for tablet 921e664bfc494746a2689f801d563798 (DEFAULT_TABLE table=test-table [id=da556f185650422385f2cc6cdb261527]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 15:25:58.425545 32178 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 921e664bfc494746a2689f801d563798. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:25:58.425653 32423 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 921e664bfc494746a2689f801d563798. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:25:58.426997 378 tablet_bootstrap.cc:492] T 921e664bfc494746a2689f801d563798 P 8634a1a1351c4aee98e49d7a28011068: Bootstrap starting.
I20260810 15:25:58.427311 374 tablet_bootstrap.cc:492] T 921e664bfc494746a2689f801d563798 P de300fca51d9412da200cd66cd386b77: Bootstrap starting.
I20260810 15:25:58.427372 378 tablet_bootstrap.cc:654] T 921e664bfc494746a2689f801d563798 P 8634a1a1351c4aee98e49d7a28011068: Neither blocks nor log segments found. Creating new log.
I20260810 15:25:58.427778 32688 tablet_service.cc:1467] Processing CreateTablet for tablet 921e664bfc494746a2689f801d563798 (DEFAULT_TABLE table=test-table [id=da556f185650422385f2cc6cdb261527]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 15:25:58.427855 374 tablet_bootstrap.cc:654] T 921e664bfc494746a2689f801d563798 P de300fca51d9412da200cd66cd386b77: Neither blocks nor log segments found. Creating new log.
I20260810 15:25:58.427902 32688 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 921e664bfc494746a2689f801d563798. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:25:58.429107 374 tablet_bootstrap.cc:492] T 921e664bfc494746a2689f801d563798 P de300fca51d9412da200cd66cd386b77: No bootstrap required, opened a new log
I20260810 15:25:58.429177 374 ts_tablet_manager.cc:1397] T 921e664bfc494746a2689f801d563798 P de300fca51d9412da200cd66cd386b77: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260810 15:25:58.429392 383 tablet_bootstrap.cc:492] T 921e664bfc494746a2689f801d563798 P da89159b612c4f32ad4b826d61f0b6ef: Bootstrap starting.
I20260810 15:25:58.429392 374 raft_consensus.cc:348] T 921e664bfc494746a2689f801d563798 P de300fca51d9412da200cd66cd386b77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8634a1a1351c4aee98e49d7a28011068" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35769 } } peers { permanent_uuid: "de300fca51d9412da200cd66cd386b77" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 42597 } } peers { permanent_uuid: "da89159b612c4f32ad4b826d61f0b6ef" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 44627 } }
I20260810 15:25:58.429494 374 raft_consensus.cc:374] T 921e664bfc494746a2689f801d563798 P de300fca51d9412da200cd66cd386b77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:25:58.429543 374 raft_consensus.cc:729] T 921e664bfc494746a2689f801d563798 P de300fca51d9412da200cd66cd386b77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de300fca51d9412da200cd66cd386b77, State: Initialized, Role: FOLLOWER
I20260810 15:25:58.429615 374 consensus_queue.cc:260] T 921e664bfc494746a2689f801d563798 P de300fca51d9412da200cd66cd386b77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8634a1a1351c4aee98e49d7a28011068" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35769 } } peers { permanent_uuid: "de300fca51d9412da200cd66cd386b77" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 42597 } } peers { permanent_uuid: "da89159b612c4f32ad4b826d61f0b6ef" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 44627 } }
I20260810 15:25:58.429711 374 ts_tablet_manager.cc:1428] T 921e664bfc494746a2689f801d563798 P de300fca51d9412da200cd66cd386b77: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:58.429831 383 tablet_bootstrap.cc:654] T 921e664bfc494746a2689f801d563798 P da89159b612c4f32ad4b826d61f0b6ef: Neither blocks nor log segments found. Creating new log.
I20260810 15:25:58.431747 378 tablet_bootstrap.cc:492] T 921e664bfc494746a2689f801d563798 P 8634a1a1351c4aee98e49d7a28011068: No bootstrap required, opened a new log
I20260810 15:25:58.431806 378 ts_tablet_manager.cc:1397] T 921e664bfc494746a2689f801d563798 P 8634a1a1351c4aee98e49d7a28011068: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20260810 15:25:58.431799 383 tablet_bootstrap.cc:492] T 921e664bfc494746a2689f801d563798 P da89159b612c4f32ad4b826d61f0b6ef: No bootstrap required, opened a new log
I20260810 15:25:58.431864 383 ts_tablet_manager.cc:1397] T 921e664bfc494746a2689f801d563798 P da89159b612c4f32ad4b826d61f0b6ef: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260810 15:25:58.431931 378 raft_consensus.cc:348] T 921e664bfc494746a2689f801d563798 P 8634a1a1351c4aee98e49d7a28011068 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8634a1a1351c4aee98e49d7a28011068" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35769 } } peers { permanent_uuid: "de300fca51d9412da200cd66cd386b77" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 42597 } } peers { permanent_uuid: "da89159b612c4f32ad4b826d61f0b6ef" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 44627 } }
I20260810 15:25:58.432015 378 raft_consensus.cc:374] T 921e664bfc494746a2689f801d563798 P 8634a1a1351c4aee98e49d7a28011068 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:25:58.432039 378 raft_consensus.cc:729] T 921e664bfc494746a2689f801d563798 P 8634a1a1351c4aee98e49d7a28011068 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8634a1a1351c4aee98e49d7a28011068, State: Initialized, Role: FOLLOWER
I20260810 15:25:58.432005 383 raft_consensus.cc:348] T 921e664bfc494746a2689f801d563798 P da89159b612c4f32ad4b826d61f0b6ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8634a1a1351c4aee98e49d7a28011068" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35769 } } peers { permanent_uuid: "de300fca51d9412da200cd66cd386b77" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 42597 } } peers { permanent_uuid: "da89159b612c4f32ad4b826d61f0b6ef" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 44627 } }
I20260810 15:25:58.432075 383 raft_consensus.cc:374] T 921e664bfc494746a2689f801d563798 P da89159b612c4f32ad4b826d61f0b6ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:25:58.432097 383 raft_consensus.cc:729] T 921e664bfc494746a2689f801d563798 P da89159b612c4f32ad4b826d61f0b6ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da89159b612c4f32ad4b826d61f0b6ef, State: Initialized, Role: FOLLOWER
I20260810 15:25:58.432085 378 consensus_queue.cc:260] T 921e664bfc494746a2689f801d563798 P 8634a1a1351c4aee98e49d7a28011068 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8634a1a1351c4aee98e49d7a28011068" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35769 } } peers { permanent_uuid: "de300fca51d9412da200cd66cd386b77" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 42597 } } peers { permanent_uuid: "da89159b612c4f32ad4b826d61f0b6ef" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 44627 } }
I20260810 15:25:58.432147 383 consensus_queue.cc:260] T 921e664bfc494746a2689f801d563798 P da89159b612c4f32ad4b826d61f0b6ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8634a1a1351c4aee98e49d7a28011068" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35769 } } peers { permanent_uuid: "de300fca51d9412da200cd66cd386b77" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 42597 } } peers { permanent_uuid: "da89159b612c4f32ad4b826d61f0b6ef" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 44627 } }
I20260810 15:25:58.432186 378 ts_tablet_manager.cc:1428] T 921e664bfc494746a2689f801d563798 P 8634a1a1351c4aee98e49d7a28011068: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:58.432263 383 ts_tablet_manager.cc:1428] T 921e664bfc494746a2689f801d563798 P da89159b612c4f32ad4b826d61f0b6ef: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260810 15:25:58.478499 489 raft_consensus.cc:482] T 921e664bfc494746a2689f801d563798 P de300fca51d9412da200cd66cd386b77 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 15:25:58.478614 489 raft_consensus.cc:504] T 921e664bfc494746a2689f801d563798 P de300fca51d9412da200cd66cd386b77 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8634a1a1351c4aee98e49d7a28011068" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35769 } } peers { permanent_uuid: "de300fca51d9412da200cd66cd386b77" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 42597 } } peers { permanent_uuid: "da89159b612c4f32ad4b826d61f0b6ef" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 44627 } }
I20260810 15:25:58.478827 489 leader_election.cc:288] T 921e664bfc494746a2689f801d563798 P de300fca51d9412da200cd66cd386b77 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8634a1a1351c4aee98e49d7a28011068 (127.18.68.129:35769), da89159b612c4f32ad4b826d61f0b6ef (127.18.68.131:44627)
I20260810 15:25:58.479048 32212 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "921e664bfc494746a2689f801d563798" candidate_uuid: "de300fca51d9412da200cd66cd386b77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8634a1a1351c4aee98e49d7a28011068" is_pre_election: true
I20260810 15:25:58.479076 32721 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "921e664bfc494746a2689f801d563798" candidate_uuid: "de300fca51d9412da200cd66cd386b77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da89159b612c4f32ad4b826d61f0b6ef" is_pre_election: true
I20260810 15:25:58.479153 32721 raft_consensus.cc:2454] T 921e664bfc494746a2689f801d563798 P da89159b612c4f32ad4b826d61f0b6ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de300fca51d9412da200cd66cd386b77 in term 0.
I20260810 15:25:58.479148 32212 raft_consensus.cc:2454] T 921e664bfc494746a2689f801d563798 P 8634a1a1351c4aee98e49d7a28011068 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de300fca51d9412da200cd66cd386b77 in term 0.
I20260810 15:25:58.479377 32337 leader_election.cc:302] T 921e664bfc494746a2689f801d563798 P de300fca51d9412da200cd66cd386b77 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8634a1a1351c4aee98e49d7a28011068, de300fca51d9412da200cd66cd386b77; no voters:
I20260810 15:25:58.479473 489 raft_consensus.cc:2781] T 921e664bfc494746a2689f801d563798 P de300fca51d9412da200cd66cd386b77 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 15:25:58.479511 489 raft_consensus.cc:482] T 921e664bfc494746a2689f801d563798 P de300fca51d9412da200cd66cd386b77 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 15:25:58.479539 489 raft_consensus.cc:3037] T 921e664bfc494746a2689f801d563798 P de300fca51d9412da200cd66cd386b77 [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:25:58.480278 489 raft_consensus.cc:504] T 921e664bfc494746a2689f801d563798 P de300fca51d9412da200cd66cd386b77 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8634a1a1351c4aee98e49d7a28011068" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35769 } } peers { permanent_uuid: "de300fca51d9412da200cd66cd386b77" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 42597 } } peers { permanent_uuid: "da89159b612c4f32ad4b826d61f0b6ef" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 44627 } }
I20260810 15:25:58.480417 489 leader_election.cc:288] T 921e664bfc494746a2689f801d563798 P de300fca51d9412da200cd66cd386b77 [CANDIDATE]: Term 1 election: Requested vote from peers 8634a1a1351c4aee98e49d7a28011068 (127.18.68.129:35769), da89159b612c4f32ad4b826d61f0b6ef (127.18.68.131:44627)
I20260810 15:25:58.480600 32721 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "921e664bfc494746a2689f801d563798" candidate_uuid: "de300fca51d9412da200cd66cd386b77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da89159b612c4f32ad4b826d61f0b6ef"
I20260810 15:25:58.480674 32721 raft_consensus.cc:3037] T 921e664bfc494746a2689f801d563798 P da89159b612c4f32ad4b826d61f0b6ef [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:25:58.480670 32212 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "921e664bfc494746a2689f801d563798" candidate_uuid: "de300fca51d9412da200cd66cd386b77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8634a1a1351c4aee98e49d7a28011068"
I20260810 15:25:58.480731 32212 raft_consensus.cc:3037] T 921e664bfc494746a2689f801d563798 P 8634a1a1351c4aee98e49d7a28011068 [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:25:58.481442 32721 raft_consensus.cc:2454] T 921e664bfc494746a2689f801d563798 P da89159b612c4f32ad4b826d61f0b6ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de300fca51d9412da200cd66cd386b77 in term 1.
I20260810 15:25:58.481499 32212 raft_consensus.cc:2454] T 921e664bfc494746a2689f801d563798 P 8634a1a1351c4aee98e49d7a28011068 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de300fca51d9412da200cd66cd386b77 in term 1.
I20260810 15:25:58.481734 32337 leader_election.cc:302] T 921e664bfc494746a2689f801d563798 P de300fca51d9412da200cd66cd386b77 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8634a1a1351c4aee98e49d7a28011068, de300fca51d9412da200cd66cd386b77; no voters:
I20260810 15:25:58.481817 489 raft_consensus.cc:2781] T 921e664bfc494746a2689f801d563798 P de300fca51d9412da200cd66cd386b77 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 15:25:58.481866 489 raft_consensus.cc:686] T 921e664bfc494746a2689f801d563798 P de300fca51d9412da200cd66cd386b77 [term 1 LEADER]: Becoming Leader. State: Replica: de300fca51d9412da200cd66cd386b77, State: Running, Role: LEADER
I20260810 15:25:58.481966 489 consensus_queue.cc:237] T 921e664bfc494746a2689f801d563798 P de300fca51d9412da200cd66cd386b77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8634a1a1351c4aee98e49d7a28011068" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35769 } } peers { permanent_uuid: "de300fca51d9412da200cd66cd386b77" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 42597 } } peers { permanent_uuid: "da89159b612c4f32ad4b826d61f0b6ef" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 44627 } }
I20260810 15:25:58.482712 31939 catalog_manager.cc:5495] T 921e664bfc494746a2689f801d563798 P de300fca51d9412da200cd66cd386b77 reported cstate change: term changed from 0 to 1, leader changed from <none> to de300fca51d9412da200cd66cd386b77 (127.18.68.130). New cstate: current_term: 1 leader_uuid: "de300fca51d9412da200cd66cd386b77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8634a1a1351c4aee98e49d7a28011068" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de300fca51d9412da200cd66cd386b77" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 42597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da89159b612c4f32ad4b826d61f0b6ef" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 44627 } health_report { overall_health: UNKNOWN } } }
I20260810 15:25:58.494917 369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:58.492351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34410 (local address 127.18.68.130:42597)
0810 15:25:58.492400 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:58.492402 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:58.492412 (+ 10us) server_negotiation.cc:407] Connection header received
0810 15:25:58.492439 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:58.492441 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:58.492451 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:58.492537 (+ 86us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 15:25:58.492673 (+ 136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:58.493412 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:58.494204 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:58.494411 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:58.494487 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:58.494645 (+ 158us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 15:25:58.494685 (+ 40us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 15:25:58.494754 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:58.494817 (+ 63us) server_negotiation.cc:299] Negotiation successful
0810 15:25:58.494840 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260810 15:25:58.495759 32212 raft_consensus.cc:1261] T 921e664bfc494746a2689f801d563798 P 8634a1a1351c4aee98e49d7a28011068 [term 1 FOLLOWER]: Refusing update from remote peer de300fca51d9412da200cd66cd386b77: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 15:25:58.495843 32721 raft_consensus.cc:1261] T 921e664bfc494746a2689f801d563798 P da89159b612c4f32ad4b826d61f0b6ef [term 1 FOLLOWER]: Refusing update from remote peer de300fca51d9412da200cd66cd386b77: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 15:25:58.496050 489 consensus_queue.cc:1035] T 921e664bfc494746a2689f801d563798 P de300fca51d9412da200cd66cd386b77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8634a1a1351c4aee98e49d7a28011068" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 15:25:58.496213 391 consensus_queue.cc:1035] T 921e664bfc494746a2689f801d563798 P de300fca51d9412da200cd66cd386b77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da89159b612c4f32ad4b826d61f0b6ef" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 44627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 15:25:58.499712 31939 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35912:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 15:25:58.499815 31939 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35912:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 15:25:58.500437 31939 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a9407d5b536b43818777ecc7b5d82e0b: Sending DeleteTablet for 3 replicas of tablet 921e664bfc494746a2689f801d563798
I20260810 15:25:58.500742 32423 tablet_service.cc:1514] Processing DeleteTablet for tablet 921e664bfc494746a2689f801d563798 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 15:25:58 UTC) from {username='oryx', principal='oryx/127.18.68.190@KRBTEST.COM'} at 127.0.0.1:34390
I20260810 15:25:58.500741 32688 tablet_service.cc:1514] Processing DeleteTablet for tablet 921e664bfc494746a2689f801d563798 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 15:25:58 UTC) from {username='oryx', principal='oryx/127.18.68.190@KRBTEST.COM'} at 127.0.0.1:47638
I20260810 15:25:58.500869 423 tablet_replica.cc:330] T 921e664bfc494746a2689f801d563798 P de300fca51d9412da200cd66cd386b77: stopping tablet replica
I20260810 15:25:58.500870 32178 tablet_service.cc:1514] Processing DeleteTablet for tablet 921e664bfc494746a2689f801d563798 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 15:25:58 UTC) from {username='oryx', principal='oryx/127.18.68.190@KRBTEST.COM'} at 127.0.0.1:56958
I20260810 15:25:58.500936 423 raft_consensus.cc:2229] T 921e664bfc494746a2689f801d563798 P de300fca51d9412da200cd66cd386b77 [term 1 LEADER]: Raft consensus shutting down.
I20260810 15:25:58.500958 421 tablet_replica.cc:330] T 921e664bfc494746a2689f801d563798 P da89159b612c4f32ad4b826d61f0b6ef: stopping tablet replica
I20260810 15:25:58.500972 420 tablet_replica.cc:330] T 921e664bfc494746a2689f801d563798 P 8634a1a1351c4aee98e49d7a28011068: stopping tablet replica
I20260810 15:25:58.501006 423 raft_consensus.cc:2258] T 921e664bfc494746a2689f801d563798 P de300fca51d9412da200cd66cd386b77 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 15:25:58.501003 421 raft_consensus.cc:2229] T 921e664bfc494746a2689f801d563798 P da89159b612c4f32ad4b826d61f0b6ef [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 15:25:58.501045 420 raft_consensus.cc:2229] T 921e664bfc494746a2689f801d563798 P 8634a1a1351c4aee98e49d7a28011068 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 15:25:58.501065 421 raft_consensus.cc:2258] T 921e664bfc494746a2689f801d563798 P da89159b612c4f32ad4b826d61f0b6ef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 15:25:58.501091 420 raft_consensus.cc:2258] T 921e664bfc494746a2689f801d563798 P 8634a1a1351c4aee98e49d7a28011068 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 15:25:58.501104 31939 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35912:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 15:25:58.501257 31939 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 15:25:58.501523 420 ts_tablet_manager.cc:1905] T 921e664bfc494746a2689f801d563798 P 8634a1a1351c4aee98e49d7a28011068: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 15:25:58.502619 32178 tablet_service.cc:1467] Processing CreateTablet for tablet 2170b826c9ce4c9e8bc617f20780ae41 (DEFAULT_TABLE table=test-table [id=c9fbc9393a3844078c7237a2f0f8f08f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 15:25:58.502746 32178 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2170b826c9ce4c9e8bc617f20780ae41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:25:58.502776 32688 tablet_service.cc:1467] Processing CreateTablet for tablet 2170b826c9ce4c9e8bc617f20780ae41 (DEFAULT_TABLE table=test-table [id=c9fbc9393a3844078c7237a2f0f8f08f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 15:25:58.502883 32688 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2170b826c9ce4c9e8bc617f20780ae41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:25:58.503377 423 ts_tablet_manager.cc:1905] T 921e664bfc494746a2689f801d563798 P de300fca51d9412da200cd66cd386b77: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 15:25:58.504235 383 tablet_bootstrap.cc:492] T 2170b826c9ce4c9e8bc617f20780ae41 P da89159b612c4f32ad4b826d61f0b6ef: Bootstrap starting.
I20260810 15:25:58.504585 383 tablet_bootstrap.cc:654] T 2170b826c9ce4c9e8bc617f20780ae41 P da89159b612c4f32ad4b826d61f0b6ef: Neither blocks nor log segments found. Creating new log.
I20260810 15:25:58.504946 32423 tablet_service.cc:1467] Processing CreateTablet for tablet 2170b826c9ce4c9e8bc617f20780ae41 (DEFAULT_TABLE table=test-table [id=c9fbc9393a3844078c7237a2f0f8f08f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 15:25:58.505040 423 ts_tablet_manager.cc:1918] T 921e664bfc494746a2689f801d563798 P de300fca51d9412da200cd66cd386b77: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 15:25:58.505061 32423 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2170b826c9ce4c9e8bc617f20780ae41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:25:58.505092 423 log.cc:1196] T 921e664bfc494746a2689f801d563798 P de300fca51d9412da200cd66cd386b77: Deleting WAL directory at /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/minicluster-data/ts-1/wal/wals/921e664bfc494746a2689f801d563798
I20260810 15:25:58.505326 423 ts_tablet_manager.cc:1939] T 921e664bfc494746a2689f801d563798 P de300fca51d9412da200cd66cd386b77: Deleting consensus metadata
I20260810 15:25:58.505740 420 ts_tablet_manager.cc:1918] T 921e664bfc494746a2689f801d563798 P 8634a1a1351c4aee98e49d7a28011068: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 15:25:58.505805 420 log.cc:1196] T 921e664bfc494746a2689f801d563798 P 8634a1a1351c4aee98e49d7a28011068: Deleting WAL directory at /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/minicluster-data/ts-0/wal/wals/921e664bfc494746a2689f801d563798
I20260810 15:25:58.506021 420 ts_tablet_manager.cc:1939] T 921e664bfc494746a2689f801d563798 P 8634a1a1351c4aee98e49d7a28011068: Deleting consensus metadata
I20260810 15:25:58.506389 374 tablet_bootstrap.cc:492] T 2170b826c9ce4c9e8bc617f20780ae41 P de300fca51d9412da200cd66cd386b77: Bootstrap starting.
I20260810 15:25:58.506487 421 ts_tablet_manager.cc:1905] T 921e664bfc494746a2689f801d563798 P da89159b612c4f32ad4b826d61f0b6ef: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 15:25:58.506803 374 tablet_bootstrap.cc:654] T 2170b826c9ce4c9e8bc617f20780ae41 P de300fca51d9412da200cd66cd386b77: Neither blocks nor log segments found. Creating new log.
I20260810 15:25:58.507344 31915 catalog_manager.cc:4841] TS 8634a1a1351c4aee98e49d7a28011068 (127.18.68.129:35769): tablet 921e664bfc494746a2689f801d563798 (table test-table [id=da556f185650422385f2cc6cdb261527]) successfully deleted
I20260810 15:25:58.507570 31921 catalog_manager.cc:4841] TS de300fca51d9412da200cd66cd386b77 (127.18.68.130:42597): tablet 921e664bfc494746a2689f801d563798 (table test-table [id=da556f185650422385f2cc6cdb261527]) successfully deleted
I20260810 15:25:58.507941 374 tablet_bootstrap.cc:492] T 2170b826c9ce4c9e8bc617f20780ae41 P de300fca51d9412da200cd66cd386b77: No bootstrap required, opened a new log
I20260810 15:25:58.508003 374 ts_tablet_manager.cc:1397] T 2170b826c9ce4c9e8bc617f20780ae41 P de300fca51d9412da200cd66cd386b77: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260810 15:25:58.508062 421 ts_tablet_manager.cc:1918] T 921e664bfc494746a2689f801d563798 P da89159b612c4f32ad4b826d61f0b6ef: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 15:25:58.508124 421 log.cc:1196] T 921e664bfc494746a2689f801d563798 P da89159b612c4f32ad4b826d61f0b6ef: Deleting WAL directory at /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/minicluster-data/ts-2/wal/wals/921e664bfc494746a2689f801d563798
I20260810 15:25:58.508185 374 raft_consensus.cc:348] T 2170b826c9ce4c9e8bc617f20780ae41 P de300fca51d9412da200cd66cd386b77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8634a1a1351c4aee98e49d7a28011068" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35769 } } peers { permanent_uuid: "de300fca51d9412da200cd66cd386b77" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 42597 } } peers { permanent_uuid: "da89159b612c4f32ad4b826d61f0b6ef" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 44627 } }
I20260810 15:25:58.508278 374 raft_consensus.cc:374] T 2170b826c9ce4c9e8bc617f20780ae41 P de300fca51d9412da200cd66cd386b77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:25:58.508304 374 raft_consensus.cc:729] T 2170b826c9ce4c9e8bc617f20780ae41 P de300fca51d9412da200cd66cd386b77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de300fca51d9412da200cd66cd386b77, State: Initialized, Role: FOLLOWER
I20260810 15:25:58.508347 421 ts_tablet_manager.cc:1939] T 921e664bfc494746a2689f801d563798 P da89159b612c4f32ad4b826d61f0b6ef: Deleting consensus metadata
I20260810 15:25:58.508361 374 consensus_queue.cc:260] T 2170b826c9ce4c9e8bc617f20780ae41 P de300fca51d9412da200cd66cd386b77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8634a1a1351c4aee98e49d7a28011068" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35769 } } peers { permanent_uuid: "de300fca51d9412da200cd66cd386b77" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 42597 } } peers { permanent_uuid: "da89159b612c4f32ad4b826d61f0b6ef" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 44627 } }
I20260810 15:25:58.508487 374 ts_tablet_manager.cc:1428] T 2170b826c9ce4c9e8bc617f20780ae41 P de300fca51d9412da200cd66cd386b77: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260810 15:25:58.508646 378 tablet_bootstrap.cc:492] T 2170b826c9ce4c9e8bc617f20780ae41 P 8634a1a1351c4aee98e49d7a28011068: Bootstrap starting.
I20260810 15:25:58.508939 31921 catalog_manager.cc:4841] TS da89159b612c4f32ad4b826d61f0b6ef (127.18.68.131:44627): tablet 921e664bfc494746a2689f801d563798 (table test-table [id=da556f185650422385f2cc6cdb261527]) successfully deleted
I20260810 15:25:58.508986 378 tablet_bootstrap.cc:654] T 2170b826c9ce4c9e8bc617f20780ae41 P 8634a1a1351c4aee98e49d7a28011068: Neither blocks nor log segments found. Creating new log.
I20260810 15:25:58.509565 378 tablet_bootstrap.cc:492] T 2170b826c9ce4c9e8bc617f20780ae41 P 8634a1a1351c4aee98e49d7a28011068: No bootstrap required, opened a new log
I20260810 15:25:58.509616 378 ts_tablet_manager.cc:1397] T 2170b826c9ce4c9e8bc617f20780ae41 P 8634a1a1351c4aee98e49d7a28011068: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260810 15:25:58.509724 378 raft_consensus.cc:348] T 2170b826c9ce4c9e8bc617f20780ae41 P 8634a1a1351c4aee98e49d7a28011068 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8634a1a1351c4aee98e49d7a28011068" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35769 } } peers { permanent_uuid: "de300fca51d9412da200cd66cd386b77" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 42597 } } peers { permanent_uuid: "da89159b612c4f32ad4b826d61f0b6ef" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 44627 } }
I20260810 15:25:58.509799 378 raft_consensus.cc:374] T 2170b826c9ce4c9e8bc617f20780ae41 P 8634a1a1351c4aee98e49d7a28011068 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:25:58.509814 378 raft_consensus.cc:729] T 2170b826c9ce4c9e8bc617f20780ae41 P 8634a1a1351c4aee98e49d7a28011068 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8634a1a1351c4aee98e49d7a28011068, State: Initialized, Role: FOLLOWER
I20260810 15:25:58.509869 378 consensus_queue.cc:260] T 2170b826c9ce4c9e8bc617f20780ae41 P 8634a1a1351c4aee98e49d7a28011068 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8634a1a1351c4aee98e49d7a28011068" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35769 } } peers { permanent_uuid: "de300fca51d9412da200cd66cd386b77" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 42597 } } peers { permanent_uuid: "da89159b612c4f32ad4b826d61f0b6ef" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 44627 } }
I20260810 15:25:58.509966 378 ts_tablet_manager.cc:1428] T 2170b826c9ce4c9e8bc617f20780ae41 P 8634a1a1351c4aee98e49d7a28011068: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:58.510355 383 tablet_bootstrap.cc:492] T 2170b826c9ce4c9e8bc617f20780ae41 P da89159b612c4f32ad4b826d61f0b6ef: No bootstrap required, opened a new log
I20260810 15:25:58.510411 383 ts_tablet_manager.cc:1397] T 2170b826c9ce4c9e8bc617f20780ae41 P da89159b612c4f32ad4b826d61f0b6ef: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.001s
I20260810 15:25:58.510550 383 raft_consensus.cc:348] T 2170b826c9ce4c9e8bc617f20780ae41 P da89159b612c4f32ad4b826d61f0b6ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8634a1a1351c4aee98e49d7a28011068" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35769 } } peers { permanent_uuid: "de300fca51d9412da200cd66cd386b77" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 42597 } } peers { permanent_uuid: "da89159b612c4f32ad4b826d61f0b6ef" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 44627 } }
I20260810 15:25:58.510614 383 raft_consensus.cc:374] T 2170b826c9ce4c9e8bc617f20780ae41 P da89159b612c4f32ad4b826d61f0b6ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:25:58.510627 383 raft_consensus.cc:729] T 2170b826c9ce4c9e8bc617f20780ae41 P da89159b612c4f32ad4b826d61f0b6ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da89159b612c4f32ad4b826d61f0b6ef, State: Initialized, Role: FOLLOWER
I20260810 15:25:58.510681 383 consensus_queue.cc:260] T 2170b826c9ce4c9e8bc617f20780ae41 P da89159b612c4f32ad4b826d61f0b6ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8634a1a1351c4aee98e49d7a28011068" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35769 } } peers { permanent_uuid: "de300fca51d9412da200cd66cd386b77" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 42597 } } peers { permanent_uuid: "da89159b612c4f32ad4b826d61f0b6ef" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 44627 } }
I20260810 15:25:58.510778 383 ts_tablet_manager.cc:1428] T 2170b826c9ce4c9e8bc617f20780ae41 P da89159b612c4f32ad4b826d61f0b6ef: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260810 15:25:58.685559 481 raft_consensus.cc:482] T 2170b826c9ce4c9e8bc617f20780ae41 P da89159b612c4f32ad4b826d61f0b6ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 15:25:58.685684 481 raft_consensus.cc:504] T 2170b826c9ce4c9e8bc617f20780ae41 P da89159b612c4f32ad4b826d61f0b6ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8634a1a1351c4aee98e49d7a28011068" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35769 } } peers { permanent_uuid: "de300fca51d9412da200cd66cd386b77" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 42597 } } peers { permanent_uuid: "da89159b612c4f32ad4b826d61f0b6ef" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 44627 } }
I20260810 15:25:58.686064 481 leader_election.cc:288] T 2170b826c9ce4c9e8bc617f20780ae41 P da89159b612c4f32ad4b826d61f0b6ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8634a1a1351c4aee98e49d7a28011068 (127.18.68.129:35769), de300fca51d9412da200cd66cd386b77 (127.18.68.130:42597)
I20260810 15:25:58.686316 32212 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2170b826c9ce4c9e8bc617f20780ae41" candidate_uuid: "da89159b612c4f32ad4b826d61f0b6ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8634a1a1351c4aee98e49d7a28011068" is_pre_election: true
I20260810 15:25:58.686400 32462 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2170b826c9ce4c9e8bc617f20780ae41" candidate_uuid: "da89159b612c4f32ad4b826d61f0b6ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de300fca51d9412da200cd66cd386b77" is_pre_election: true
I20260810 15:25:58.686460 32212 raft_consensus.cc:2454] T 2170b826c9ce4c9e8bc617f20780ae41 P 8634a1a1351c4aee98e49d7a28011068 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da89159b612c4f32ad4b826d61f0b6ef in term 0.
I20260810 15:25:58.686496 32462 raft_consensus.cc:2454] T 2170b826c9ce4c9e8bc617f20780ae41 P de300fca51d9412da200cd66cd386b77 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da89159b612c4f32ad4b826d61f0b6ef in term 0.
I20260810 15:25:58.686679 32611 leader_election.cc:302] T 2170b826c9ce4c9e8bc617f20780ae41 P da89159b612c4f32ad4b826d61f0b6ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: da89159b612c4f32ad4b826d61f0b6ef, de300fca51d9412da200cd66cd386b77; no voters:
I20260810 15:25:58.686779 481 raft_consensus.cc:2781] T 2170b826c9ce4c9e8bc617f20780ae41 P da89159b612c4f32ad4b826d61f0b6ef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 15:25:58.686822 481 raft_consensus.cc:482] T 2170b826c9ce4c9e8bc617f20780ae41 P da89159b612c4f32ad4b826d61f0b6ef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 15:25:58.686842 481 raft_consensus.cc:3037] T 2170b826c9ce4c9e8bc617f20780ae41 P da89159b612c4f32ad4b826d61f0b6ef [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:25:58.687633 481 raft_consensus.cc:504] T 2170b826c9ce4c9e8bc617f20780ae41 P da89159b612c4f32ad4b826d61f0b6ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8634a1a1351c4aee98e49d7a28011068" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35769 } } peers { permanent_uuid: "de300fca51d9412da200cd66cd386b77" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 42597 } } peers { permanent_uuid: "da89159b612c4f32ad4b826d61f0b6ef" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 44627 } }
I20260810 15:25:58.687794 481 leader_election.cc:288] T 2170b826c9ce4c9e8bc617f20780ae41 P da89159b612c4f32ad4b826d61f0b6ef [CANDIDATE]: Term 1 election: Requested vote from peers 8634a1a1351c4aee98e49d7a28011068 (127.18.68.129:35769), de300fca51d9412da200cd66cd386b77 (127.18.68.130:42597)
I20260810 15:25:58.687992 32212 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2170b826c9ce4c9e8bc617f20780ae41" candidate_uuid: "da89159b612c4f32ad4b826d61f0b6ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8634a1a1351c4aee98e49d7a28011068"
I20260810 15:25:58.688103 32212 raft_consensus.cc:3037] T 2170b826c9ce4c9e8bc617f20780ae41 P 8634a1a1351c4aee98e49d7a28011068 [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:25:58.688241 32462 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2170b826c9ce4c9e8bc617f20780ae41" candidate_uuid: "da89159b612c4f32ad4b826d61f0b6ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de300fca51d9412da200cd66cd386b77"
I20260810 15:25:58.688369 32462 raft_consensus.cc:3037] T 2170b826c9ce4c9e8bc617f20780ae41 P de300fca51d9412da200cd66cd386b77 [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:25:58.689167 32212 raft_consensus.cc:2454] T 2170b826c9ce4c9e8bc617f20780ae41 P 8634a1a1351c4aee98e49d7a28011068 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da89159b612c4f32ad4b826d61f0b6ef in term 1.
I20260810 15:25:58.689261 32462 raft_consensus.cc:2454] T 2170b826c9ce4c9e8bc617f20780ae41 P de300fca51d9412da200cd66cd386b77 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da89159b612c4f32ad4b826d61f0b6ef in term 1.
I20260810 15:25:58.689405 32606 leader_election.cc:302] T 2170b826c9ce4c9e8bc617f20780ae41 P da89159b612c4f32ad4b826d61f0b6ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8634a1a1351c4aee98e49d7a28011068, da89159b612c4f32ad4b826d61f0b6ef; no voters:
I20260810 15:25:58.689560 481 raft_consensus.cc:2781] T 2170b826c9ce4c9e8bc617f20780ae41 P da89159b612c4f32ad4b826d61f0b6ef [term 1 FOLLOWER]: Leader election won for term 1
I20260810 15:25:58.689623 481 raft_consensus.cc:686] T 2170b826c9ce4c9e8bc617f20780ae41 P da89159b612c4f32ad4b826d61f0b6ef [term 1 LEADER]: Becoming Leader. State: Replica: da89159b612c4f32ad4b826d61f0b6ef, State: Running, Role: LEADER
I20260810 15:25:58.689687 481 consensus_queue.cc:237] T 2170b826c9ce4c9e8bc617f20780ae41 P da89159b612c4f32ad4b826d61f0b6ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8634a1a1351c4aee98e49d7a28011068" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35769 } } peers { permanent_uuid: "de300fca51d9412da200cd66cd386b77" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 42597 } } peers { permanent_uuid: "da89159b612c4f32ad4b826d61f0b6ef" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 44627 } }
I20260810 15:25:58.690426 31945 catalog_manager.cc:5495] T 2170b826c9ce4c9e8bc617f20780ae41 P da89159b612c4f32ad4b826d61f0b6ef reported cstate change: term changed from 0 to 1, leader changed from <none> to da89159b612c4f32ad4b826d61f0b6ef (127.18.68.131). New cstate: current_term: 1 leader_uuid: "da89159b612c4f32ad4b826d61f0b6ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8634a1a1351c4aee98e49d7a28011068" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de300fca51d9412da200cd66cd386b77" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 42597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da89159b612c4f32ad4b826d61f0b6ef" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 44627 } health_report { overall_health: HEALTHY } } }
I20260810 15:25:58.742434 373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:58.740213 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47654 (local address 127.18.68.131:44627)
0810 15:25:58.740267 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:58.740269 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:58.740279 (+ 10us) server_negotiation.cc:407] Connection header received
0810 15:25:58.740306 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:58.740307 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:58.740316 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:58.740363 (+ 47us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 15:25:58.740509 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:58.740988 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:58.741723 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:58.741928 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:58.741999 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:58.742175 (+ 176us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 15:25:58.742211 (+ 36us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 15:25:58.742261 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:58.742328 (+ 67us) server_negotiation.cc:299] Negotiation successful
0810 15:25:58.742352 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260810 15:25:58.746580 373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:58.744681 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.131:52447 (local address 127.18.68.131:44627)
0810 15:25:58.744721 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0810 15:25:58.744723 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:25:58.744732 (+ 9us) server_negotiation.cc:407] Connection header received
0810 15:25:58.744801 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:25:58.744802 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:25:58.744809 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:25:58.744847 (+ 38us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 15:25:58.744937 (+ 90us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:58.745367 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:58.746025 (+ 658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:25:58.746216 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:25:58.746265 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:58.746384 (+ 119us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 15:25:58.746405 (+ 21us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 15:25:58.746442 (+ 37us) server_negotiation.cc:1035] Waiting for connection context
0810 15:25:58.746494 (+ 52us) server_negotiation.cc:299] Negotiation successful
0810 15:25:58.746508 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260810 15:25:58.746635 488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:58.744585 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.131:44627 (local address 127.18.68.131:52447)
0810 15:25:58.744687 (+ 102us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:58.744697 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 15:25:58.744741 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:25:58.744863 (+ 122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:25:58.744864 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:25:58.744864 (+ 0us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 15:25:58.744898 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:58.744900 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:58.745428 (+ 528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:58.745429 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:58.745953 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:25:58.745954 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:25:58.746282 (+ 328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:25:58.746283 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:25:58.746321 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:25:58.746326 (+ 5us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 15:25:58.746457 (+ 131us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 15:25:58.746458 (+ 1us) client_negotiation.cc:769] Sending connection context
0810 15:25:58.746492 (+ 34us) client_negotiation.cc:240] Negotiation successful
0810 15:25:58.746526 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":78}
I20260810 15:25:58.748555 32462 raft_consensus.cc:1261] T 2170b826c9ce4c9e8bc617f20780ae41 P de300fca51d9412da200cd66cd386b77 [term 1 FOLLOWER]: Refusing update from remote peer da89159b612c4f32ad4b826d61f0b6ef: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 15:25:58.748605 32212 raft_consensus.cc:1261] T 2170b826c9ce4c9e8bc617f20780ae41 P 8634a1a1351c4aee98e49d7a28011068 [term 1 FOLLOWER]: Refusing update from remote peer da89159b612c4f32ad4b826d61f0b6ef: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 15:25:58.748801 458 consensus_queue.cc:1035] T 2170b826c9ce4c9e8bc617f20780ae41 P da89159b612c4f32ad4b826d61f0b6ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "de300fca51d9412da200cd66cd386b77" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 42597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 15:25:58.748906 481 consensus_queue.cc:1035] T 2170b826c9ce4c9e8bc617f20780ae41 P da89159b612c4f32ad4b826d61f0b6ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "8634a1a1351c4aee98e49d7a28011068" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 15:25:58.759999 31939 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35912:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 15:25:58.760109 31939 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35912:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 15:25:58.760707 31939 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a9407d5b536b43818777ecc7b5d82e0b: Sending DeleteTablet for 3 replicas of tablet 2170b826c9ce4c9e8bc617f20780ae41
I20260810 15:25:58.760970 32178 tablet_service.cc:1514] Processing DeleteTablet for tablet 2170b826c9ce4c9e8bc617f20780ae41 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 15:25:58 UTC) from {username='oryx', principal='oryx/127.18.68.190@KRBTEST.COM'} at 127.0.0.1:56958
I20260810 15:25:58.760993 32423 tablet_service.cc:1514] Processing DeleteTablet for tablet 2170b826c9ce4c9e8bc617f20780ae41 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 15:25:58 UTC) from {username='oryx', principal='oryx/127.18.68.190@KRBTEST.COM'} at 127.0.0.1:34390
I20260810 15:25:58.760985 32688 tablet_service.cc:1514] Processing DeleteTablet for tablet 2170b826c9ce4c9e8bc617f20780ae41 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 15:25:58 UTC) from {username='oryx', principal='oryx/127.18.68.190@KRBTEST.COM'} at 127.0.0.1:47638
I20260810 15:25:58.761070 420 tablet_replica.cc:330] T 2170b826c9ce4c9e8bc617f20780ae41 P 8634a1a1351c4aee98e49d7a28011068: stopping tablet replica
I20260810 15:25:58.761078 423 tablet_replica.cc:330] T 2170b826c9ce4c9e8bc617f20780ae41 P de300fca51d9412da200cd66cd386b77: stopping tablet replica
I20260810 15:25:58.761078 421 tablet_replica.cc:330] T 2170b826c9ce4c9e8bc617f20780ae41 P da89159b612c4f32ad4b826d61f0b6ef: stopping tablet replica
I20260810 15:25:58.761124 420 raft_consensus.cc:2229] T 2170b826c9ce4c9e8bc617f20780ae41 P 8634a1a1351c4aee98e49d7a28011068 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 15:25:58.761124 423 raft_consensus.cc:2229] T 2170b826c9ce4c9e8bc617f20780ae41 P de300fca51d9412da200cd66cd386b77 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 15:25:58.761126 421 raft_consensus.cc:2229] T 2170b826c9ce4c9e8bc617f20780ae41 P da89159b612c4f32ad4b826d61f0b6ef [term 1 LEADER]: Raft consensus shutting down.
I20260810 15:25:58.761160 423 raft_consensus.cc:2258] T 2170b826c9ce4c9e8bc617f20780ae41 P de300fca51d9412da200cd66cd386b77 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 15:25:58.761169 420 raft_consensus.cc:2258] T 2170b826c9ce4c9e8bc617f20780ae41 P 8634a1a1351c4aee98e49d7a28011068 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 15:25:58.761209 421 raft_consensus.cc:2258] T 2170b826c9ce4c9e8bc617f20780ae41 P da89159b612c4f32ad4b826d61f0b6ef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 15:25:58.761555 423 ts_tablet_manager.cc:1905] T 2170b826c9ce4c9e8bc617f20780ae41 P de300fca51d9412da200cd66cd386b77: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 15:25:58.761672 420 ts_tablet_manager.cc:1905] T 2170b826c9ce4c9e8bc617f20780ae41 P 8634a1a1351c4aee98e49d7a28011068: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 15:25:58.761747 421 ts_tablet_manager.cc:1905] T 2170b826c9ce4c9e8bc617f20780ae41 P da89159b612c4f32ad4b826d61f0b6ef: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 15:25:58.763275 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 32066
I20260810 15:25:58.763406 421 ts_tablet_manager.cc:1918] T 2170b826c9ce4c9e8bc617f20780ae41 P da89159b612c4f32ad4b826d61f0b6ef: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 15:25:58.763461 421 log.cc:1196] T 2170b826c9ce4c9e8bc617f20780ae41 P da89159b612c4f32ad4b826d61f0b6ef: Deleting WAL directory at /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/minicluster-data/ts-2/wal/wals/2170b826c9ce4c9e8bc617f20780ae41
I20260810 15:25:58.763697 421 ts_tablet_manager.cc:1939] T 2170b826c9ce4c9e8bc617f20780ae41 P da89159b612c4f32ad4b826d61f0b6ef: Deleting consensus metadata
I20260810 15:25:58.775022 423 ts_tablet_manager.cc:1918] T 2170b826c9ce4c9e8bc617f20780ae41 P de300fca51d9412da200cd66cd386b77: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 15:25:58.775121 423 log.cc:1196] T 2170b826c9ce4c9e8bc617f20780ae41 P de300fca51d9412da200cd66cd386b77: Deleting WAL directory at /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786375520124696-18706-0/minicluster-data/ts-1/wal/wals/2170b826c9ce4c9e8bc617f20780ae41
I20260810 15:25:58.775379 423 ts_tablet_manager.cc:1939] T 2170b826c9ce4c9e8bc617f20780ae41 P de300fca51d9412da200cd66cd386b77: Deleting consensus metadata
I20260810 15:25:58.776017 31921 catalog_manager.cc:4841] TS de300fca51d9412da200cd66cd386b77 (127.18.68.130:42597): tablet 2170b826c9ce4c9e8bc617f20780ae41 (table test-table [id=c9fbc9393a3844078c7237a2f0f8f08f]) successfully deleted
I20260810 15:25:58.779639 31921 catalog_manager.cc:4841] TS da89159b612c4f32ad4b826d61f0b6ef (127.18.68.131:44627): tablet 2170b826c9ce4c9e8bc617f20780ae41 (table test-table [id=c9fbc9393a3844078c7237a2f0f8f08f]) successfully deleted
W20260810 15:25:58.788825 31915 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.18.68.129:35769 (error 108)
I20260810 15:25:58.789011 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 32310
I20260810 15:25:58.799918 535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:25:58.798847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.129:35769 (local address 127.0.0.1:56968)
0810 15:25:58.799796 (+ 949us) negotiation.cc:107] Waiting for socket to connect
0810 15:25:58.799860 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.129:35769: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":928,"thread_start_us":868,"threads_started":1}
W20260810 15:25:58.800057 31915 catalog_manager.cc:4584] TS 8634a1a1351c4aee98e49d7a28011068 (127.18.68.129:35769): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 2170b826c9ce4c9e8bc617f20780ae41: Network error: Client connection negotiation failed: client connection to 127.18.68.129:35769: connect: Connection refused (error 111)
I20260810 15:25:58.805725 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 32579
I20260810 15:25:58.822676 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 31888
2026-08-10T15:25:58Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (3267 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786375520124696-18706-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 15:25:58 dist-test-slave-2p8l krb5kdc[538](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 15:25:58 dist-test-slave-2p8l krb5kdc[538](info): set up 2 sockets
Aug 10 15:25:58 dist-test-slave-2p8l krb5kdc[538](info): commencing operation
krb5kdc: starting...
W20260810 15:26:00.117506 18706 mini_kdc.cc:121] Time spent starting KDC: real 1.263s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786375520124696-18706-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786375520124696-18706-0/krb5kdc/test-user.keytab.
Aug 10 15:26:00 dist-test-slave-2p8l krb5kdc[538](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375560, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T15:26:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T15:26:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.68.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.68.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.68.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab.
Entry for principal kudu/127.18.68.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab.
I20260810 15:26:00.246752 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786375520124696-18706-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786375520124696-18706-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786375520124696-18706-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.190:36823
--webserver_interface=127.18.68.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab
--principal=kudu/127.18.68.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:37611
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.68.190:36823
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:26:00.333433 562 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:26:00.333658 562 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:26:00.333684 562 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:26:00.334795 562 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 15:26:00.334832 562 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:26:00.334846 562 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:26:00.334859 562 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 15:26:00.334872 562 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 15:26:00.336299 562 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:37611
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786375520124696-18706-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786375520124696-18706-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.68.190:36823
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.190:36823
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.68.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.562
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786375520124696-18706-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:26:00.336496 562 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:26:00.336685 562 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:26:00.341678 572 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:26:00.341666 575 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:26:00.341666 573 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:26:00.341990 562 server_base.cc:1034] running on GCE node
I20260810 15:26:00.342281 562 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:26:00.342581 562 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:26:00.343791 562 hybrid_clock.cc:648] HybridClock initialized: now 1786375560343768 us; error 45 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-10T15:26:00Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1521 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 15:26:00 dist-test-slave-2p8l krb5kdc[587](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 15:26:00 dist-test-slave-2p8l krb5kdc[587](info): set up 2 sockets
Aug 10 15:26:00 dist-test-slave-2p8l krb5kdc[587](info): commencing operation
krb5kdc: starting...
W20260810 15:26:01.651695 18706 mini_kdc.cc:121] Time spent starting KDC: real 1.276s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/krb5kdc/test-user.keytab.
Aug 10 15:26:01 dist-test-slave-2p8l krb5kdc[587](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375561, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T15:26:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T15:26:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.68.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.68.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.68.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab.
Entry for principal kudu/127.18.68.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab.
I20260810 15:26:01.781086 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.190:46345
--webserver_interface=127.18.68.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab
--principal=kudu/127.18.68.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:33457
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.68.190:46345
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:26:01.867663 616 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:26:01.867875 616 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:26:01.867897 616 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:26:01.869038 616 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 15:26:01.869082 616 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:26:01.869097 616 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:26:01.869110 616 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 15:26:01.869122 616 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 15:26:01.870731 616 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:33457
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.68.190:46345
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab
--principal=kudu/127.18.68.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.190:46345
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.68.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.616
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:26:01.871006 616 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:26:01.871255 616 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:26:01.876365 622 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:26:01.876360 621 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:26:01.876365 624 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:26:01.876662 616 server_base.cc:1034] running on GCE node
I20260810 15:26:01.876914 616 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:26:01.877249 616 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:26:01.878422 616 hybrid_clock.cc:648] HybridClock initialized: now 1786375561878400 us; error 39 us; skew 500 ppm
Aug 10 15:26:01 dist-test-slave-2p8l krb5kdc[587](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375561, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:26:01.880971 616 init.cc:377] Logged in from keytab as kudu/127.18.68.190@KRBTEST.COM (short username kudu)
I20260810 15:26:01.881578 616 webserver.cc:460] Webserver started at http://127.18.68.190:43243/ using document root <none> and password file <none>
I20260810 15:26:01.881841 616 fs_manager.cc:359] Metadata directory not provided
I20260810 15:26:01.881912 616 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:26:01.882053 616 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:26:01.883172 616 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/master-0/data/instance:
uuid: "c034cd0f3f7e48e08eee9175a39baa97"
format_stamp: "Formatted at 2026-08-10 15:26:01 on dist-test-slave-2p8l"
server_key: "c196ac422bac01d8732b6d181c3b7642"
server_key_iv: "0e738fc75c94b01a67c16a800bc9827c"
server_key_version: "encryptionkey@0"
I20260810 15:26:01.883558 616 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/master-0/wal/instance:
uuid: "c034cd0f3f7e48e08eee9175a39baa97"
format_stamp: "Formatted at 2026-08-10 15:26:01 on dist-test-slave-2p8l"
server_key: "c196ac422bac01d8732b6d181c3b7642"
server_key_iv: "0e738fc75c94b01a67c16a800bc9827c"
server_key_version: "encryptionkey@0"
I20260810 15:26:01.884995 616 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 15:26:01.885799 639 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:26:01.886040 616 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:26:01.886202 616 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/master-0/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/master-0/wal
uuid: "c034cd0f3f7e48e08eee9175a39baa97"
format_stamp: "Formatted at 2026-08-10 15:26:01 on dist-test-slave-2p8l"
server_key: "c196ac422bac01d8732b6d181c3b7642"
server_key_iv: "0e738fc75c94b01a67c16a800bc9827c"
server_key_version: "encryptionkey@0"
I20260810 15:26:01.886291 616 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:26:01.902601 616 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:26:01.904994 616 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:26:01.905182 616 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:26:01.909529 616 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.190:46345
I20260810 15:26:01.909576 725 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.190:46345 every 8 connection(s)
I20260810 15:26:01.909981 616 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
I20260810 15:26:01.911038 727 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:26:01.913452 727 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c034cd0f3f7e48e08eee9175a39baa97: Bootstrap starting.
I20260810 15:26:01.914178 727 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c034cd0f3f7e48e08eee9175a39baa97: Neither blocks nor log segments found. Creating new log.
I20260810 15:26:01.914515 727 log.cc:824] T 00000000000000000000000000000000 P c034cd0f3f7e48e08eee9175a39baa97: Log is configured to *not* fsync() on all Append() calls
I20260810 15:26:01.915325 727 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c034cd0f3f7e48e08eee9175a39baa97: No bootstrap required, opened a new log
I20260810 15:26:01.917033 727 raft_consensus.cc:348] T 00000000000000000000000000000000 P c034cd0f3f7e48e08eee9175a39baa97 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c034cd0f3f7e48e08eee9175a39baa97" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46345 } }
I20260810 15:26:01.917179 727 raft_consensus.cc:374] T 00000000000000000000000000000000 P c034cd0f3f7e48e08eee9175a39baa97 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:26:01.917203 727 raft_consensus.cc:729] T 00000000000000000000000000000000 P c034cd0f3f7e48e08eee9175a39baa97 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c034cd0f3f7e48e08eee9175a39baa97, State: Initialized, Role: FOLLOWER
I20260810 15:26:01.917378 727 consensus_queue.cc:260] T 00000000000000000000000000000000 P c034cd0f3f7e48e08eee9175a39baa97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c034cd0f3f7e48e08eee9175a39baa97" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46345 } }
I20260810 15:26:01.917456 727 raft_consensus.cc:388] T 00000000000000000000000000000000 P c034cd0f3f7e48e08eee9175a39baa97 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 15:26:01.917501 727 raft_consensus.cc:482] T 00000000000000000000000000000000 P c034cd0f3f7e48e08eee9175a39baa97 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 15:26:01.917562 727 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c034cd0f3f7e48e08eee9175a39baa97 [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:26:01.917593 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 616
I20260810 15:26:01.917712 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/master-0/wal/instance
I20260810 15:26:01.917939 18706 external_mini_cluster.cc:1428] Setting key ebbc866801862bf25901473236115c68
I20260810 15:26:01.918330 727 raft_consensus.cc:504] T 00000000000000000000000000000000 P c034cd0f3f7e48e08eee9175a39baa97 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c034cd0f3f7e48e08eee9175a39baa97" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46345 } }
I20260810 15:26:01.918459 727 leader_election.cc:302] T 00000000000000000000000000000000 P c034cd0f3f7e48e08eee9175a39baa97 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c034cd0f3f7e48e08eee9175a39baa97; no voters:
I20260810 15:26:01.918928 727 leader_election.cc:288] T 00000000000000000000000000000000 P c034cd0f3f7e48e08eee9175a39baa97 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 15:26:01.919160 739 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c034cd0f3f7e48e08eee9175a39baa97 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 15:26:01.919230 727 sys_catalog.cc:564] T 00000000000000000000000000000000 P c034cd0f3f7e48e08eee9175a39baa97 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 15:26:01.919277 739 raft_consensus.cc:686] T 00000000000000000000000000000000 P c034cd0f3f7e48e08eee9175a39baa97 [term 1 LEADER]: Becoming Leader. State: Replica: c034cd0f3f7e48e08eee9175a39baa97, State: Running, Role: LEADER
I20260810 15:26:01.919364 739 consensus_queue.cc:237] T 00000000000000000000000000000000 P c034cd0f3f7e48e08eee9175a39baa97 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c034cd0f3f7e48e08eee9175a39baa97" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46345 } }
I20260810 15:26:01.919716 739 sys_catalog.cc:455] T 00000000000000000000000000000000 P c034cd0f3f7e48e08eee9175a39baa97 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c034cd0f3f7e48e08eee9175a39baa97. Latest consensus state: current_term: 1 leader_uuid: "c034cd0f3f7e48e08eee9175a39baa97" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c034cd0f3f7e48e08eee9175a39baa97" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46345 } } }
I20260810 15:26:01.919811 739 sys_catalog.cc:458] T 00000000000000000000000000000000 P c034cd0f3f7e48e08eee9175a39baa97 [sys.catalog]: This master's current role is: LEADER
I20260810 15:26:01.919965 742 sys_catalog.cc:455] T 00000000000000000000000000000000 P c034cd0f3f7e48e08eee9175a39baa97 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c034cd0f3f7e48e08eee9175a39baa97" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c034cd0f3f7e48e08eee9175a39baa97" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46345 } } }
I20260810 15:26:01.920039 742 sys_catalog.cc:458] T 00000000000000000000000000000000 P c034cd0f3f7e48e08eee9175a39baa97 [sys.catalog]: This master's current role is: LEADER
I20260810 15:26:01.920173 750 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 15:26:01.920759 750 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 15:26:01.922514 750 catalog_manager.cc:1347] Generated new cluster ID: 8ba3797aae0e4aa2951a107bdeef9747
I20260810 15:26:01.922582 750 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 10 15:26:01 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375561, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
I20260810 15:26:01.930276 737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:26:01.918574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53070 (local address 127.18.68.190:46345)
0810 15:26:01.918796 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0810 15:26:01.918805 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 15:26:01.918862 (+ 57us) server_negotiation.cc:407] Connection header received
0810 15:26:01.918995 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:26:01.919002 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:26:01.919065 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:26:01.920087 (+ 1022us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:26:01.920245 (+ 158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:01.921532 (+ 1287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:01.922642 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:01.923251 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:01.923368 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:01.926371 (+ 3003us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:26:01.926376 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:26:01.926376 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:26:01.926390 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:26:01.928463 (+ 2073us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:26:01.928923 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:26:01.928927 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:26:01.928927 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:26:01.929047 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:26:01.929287 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:26:01.929287 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:26:01.929288 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:26:01.929592 (+ 304us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:26:01.929748 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0810 15:26:01.929880 (+ 132us) server_negotiation.cc:299] Negotiation successful
0810 15:26:01.930020 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":169,"thread_start_us":122,"threads_started":1}
I20260810 15:26:01.937296 750 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 15:26:01.938081 750 catalog_manager.cc:1504] Loading token signing keys...
I20260810 15:26:01.947566 750 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c034cd0f3f7e48e08eee9175a39baa97: Generated new TSK 0
I20260810 15:26:01.947916 750 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.18.68.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.68.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.68.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.129.keytab.
Entry for principal kudu/127.18.68.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.129.keytab.
I20260810 15:26:01.985657 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.68.129:0
--local_ip_for_outbound_sockets=127.18.68.129
--webserver_interface=127.18.68.129
--webserver_port=0
--tserver_master_addrs=127.18.68.190:46345
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.129.keytab
--principal=kudu/127.18.68.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:33457
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:26:02.073423 770 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:26:02.073664 770 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:26:02.073693 770 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:26:02.075017 770 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:26:02.075073 770 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:26:02.075106 770 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.68.129
I20260810 15:26:02.076725 770 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:33457
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.129.keytab
--principal=kudu/127.18.68.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.68.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.68.129
--webserver_port=0
--tserver_master_addrs=127.18.68.190:46345
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.770
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.68.129
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:26:02.076941 770 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:26:02.077131 770 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:26:02.082590 784 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:26:02.082602 781 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:26:02.082659 780 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:26:02.082933 770 server_base.cc:1034] running on GCE node
I20260810 15:26:02.083209 770 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:26:02.083492 770 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:26:02.084661 770 hybrid_clock.cc:648] HybridClock initialized: now 1786375562084649 us; error 33 us; skew 500 ppm
Aug 10 15:26:02 dist-test-slave-2p8l krb5kdc[587](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375562, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:26:02.087657 770 init.cc:377] Logged in from keytab as kudu/127.18.68.129@KRBTEST.COM (short username kudu)
I20260810 15:26:02.088178 770 webserver.cc:460] Webserver started at http://127.18.68.129:36321/ using document root <none> and password file <none>
I20260810 15:26:02.088438 770 fs_manager.cc:359] Metadata directory not provided
I20260810 15:26:02.088517 770 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:26:02.088691 770 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:26:02.090163 770 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/ts-0/data/instance:
uuid: "748a8dd3f19b4be7b976ea0da79b10e0"
format_stamp: "Formatted at 2026-08-10 15:26:02 on dist-test-slave-2p8l"
server_key: "50eeba9ddffebb020fb250baaeaf6068"
server_key_iv: "d9f63e0825332898f8f1618989701daf"
server_key_version: "encryptionkey@0"
I20260810 15:26:02.090534 770 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/ts-0/wal/instance:
uuid: "748a8dd3f19b4be7b976ea0da79b10e0"
format_stamp: "Formatted at 2026-08-10 15:26:02 on dist-test-slave-2p8l"
server_key: "50eeba9ddffebb020fb250baaeaf6068"
server_key_iv: "d9f63e0825332898f8f1618989701daf"
server_key_version: "encryptionkey@0"
I20260810 15:26:02.092171 770 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260810 15:26:02.092978 797 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:26:02.093187 770 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:26:02.093303 770 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/ts-0/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/ts-0/wal
uuid: "748a8dd3f19b4be7b976ea0da79b10e0"
format_stamp: "Formatted at 2026-08-10 15:26:02 on dist-test-slave-2p8l"
server_key: "50eeba9ddffebb020fb250baaeaf6068"
server_key_iv: "d9f63e0825332898f8f1618989701daf"
server_key_version: "encryptionkey@0"
I20260810 15:26:02.093391 770 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:26:02.109711 770 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:26:02.112141 770 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:26:02.112295 770 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:26:02.112598 770 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 15:26:02.112952 770 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 15:26:02.113011 770 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 15:26:02.113052 770 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 15:26:02.113082 770 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 15:26:02.119575 770 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.129:46467
I20260810 15:26:02.119606 1015 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.129:46467 every 8 connection(s)
I20260810 15:26:02.119989 770 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/ts-0/data/info.pb
I20260810 15:26:02.122159 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 770
I20260810 15:26:02.122306 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/ts-0/wal/instance
I20260810 15:26:02.122522 18706 external_mini_cluster.cc:1428] Setting key 7ac490b7f5d4912825987a9084854a42
Aug 10 15:26:02 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375562, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.129@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
I20260810 15:26:02.131110 737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:26:02.120770 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.129:55559 (local address 127.18.68.190:46345)
0810 15:26:02.120842 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0810 15:26:02.120844 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:26:02.121098 (+ 254us) server_negotiation.cc:407] Connection header received
0810 15:26:02.121647 (+ 549us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:26:02.121648 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:26:02.121667 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:26:02.121719 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:26:02.123096 (+ 1377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:02.123812 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:02.124869 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:02.125188 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:02.125249 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:02.127987 (+ 2738us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:26:02.127989 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:26:02.127989 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:26:02.128004 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:26:02.129540 (+ 1536us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:26:02.130037 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:26:02.130038 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:26:02.130039 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:26:02.130121 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:26:02.130456 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:26:02.130457 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:26:02.130457 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:26:02.130560 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:26:02.130610 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0810 15:26:02.130968 (+ 358us) server_negotiation.cc:299] Negotiation successful
0810 15:26:02.131038 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260810 15:26:02.131397 1020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:26:02.120768 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46345 (local address 127.18.68.129:55559)
0810 15:26:02.120952 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0810 15:26:02.120990 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0810 15:26:02.121512 (+ 522us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:26:02.121791 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:26:02.121794 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:26:02.122696 (+ 902us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:26:02.122983 (+ 287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:02.122989 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:02.123921 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:02.123922 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:02.124773 (+ 851us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:02.124776 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:02.125278 (+ 502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:02.125279 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:02.125387 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:02.126017 (+ 630us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:26:02.126026 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:26:02.127860 (+ 1834us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:26:02.129648 (+ 1788us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:26:02.129663 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:26:02.129665 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:26:02.129956 (+ 291us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:26:02.130219 (+ 263us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:26:02.130221 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:26:02.130222 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:26:02.130380 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:26:02.130630 (+ 250us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:26:02.130638 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:26:02.130816 (+ 178us) client_negotiation.cc:769] Sending connection context
0810 15:26:02.130947 (+ 131us) client_negotiation.cc:240] Negotiation successful
0810 15:26:02.131132 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":99,"threads_started":1}
I20260810 15:26:02.132058 1017 heartbeater.cc:347] Connected to a master server at 127.18.68.190:46345
I20260810 15:26:02.132198 1017 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.18.68.130@KRBTEST.COM; defaulting to no policy
I20260810 15:26:02.132396 1017 heartbeater.cc:511] Master 127.18.68.190:46345 requested a full tablet report, sending...
I20260810 15:26:02.132964 672 ts_manager.cc:194] Registered new tserver with Master: 748a8dd3f19b4be7b976ea0da79b10e0 (127.18.68.129:46467)
I20260810 15:26:02.133678 672 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.68.129@KRBTEST.COM'} at 127.18.68.129:55559
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.68.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.68.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.130.keytab.
Entry for principal kudu/127.18.68.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.130.keytab.
I20260810 15:26:02.152712 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.68.130:0
--local_ip_for_outbound_sockets=127.18.68.130
--webserver_interface=127.18.68.130
--webserver_port=0
--tserver_master_addrs=127.18.68.190:46345
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.130.keytab
--principal=kudu/127.18.68.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:33457
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:26:02.238109 1026 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:26:02.238345 1026 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:26:02.238371 1026 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:26:02.239502 1026 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:26:02.239540 1026 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:26:02.239565 1026 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.68.130
I20260810 15:26:02.240969 1026 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:33457
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.130.keytab
--principal=kudu/127.18.68.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.68.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.68.130
--webserver_port=0
--tserver_master_addrs=127.18.68.190:46345
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1026
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.68.130
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:26:02.241180 1026 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:26:02.241374 1026 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:26:02.247002 1037 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:26:02.246907 1035 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:26:02.246907 1042 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:26:02.247388 1026 server_base.cc:1034] running on GCE node
I20260810 15:26:02.247646 1026 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:26:02.247896 1026 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:26:02.249095 1026 hybrid_clock.cc:648] HybridClock initialized: now 1786375562249077 us; error 47 us; skew 500 ppm
Aug 10 15:26:02 dist-test-slave-2p8l krb5kdc[587](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375562, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:26:02.251991 1026 init.cc:377] Logged in from keytab as kudu/127.18.68.130@KRBTEST.COM (short username kudu)
I20260810 15:26:02.252511 1026 webserver.cc:460] Webserver started at http://127.18.68.130:44513/ using document root <none> and password file <none>
I20260810 15:26:02.252811 1026 fs_manager.cc:359] Metadata directory not provided
I20260810 15:26:02.252887 1026 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:26:02.253039 1026 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:26:02.254211 1026 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/ts-1/data/instance:
uuid: "867fc519b84848b1971fe587e4c6676b"
format_stamp: "Formatted at 2026-08-10 15:26:02 on dist-test-slave-2p8l"
server_key: "bfe1be8529bb4a5efeca03a7cd8f26bc"
server_key_iv: "070160ee234efa9f77ee1f58c30c37dd"
server_key_version: "encryptionkey@0"
I20260810 15:26:02.254590 1026 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/ts-1/wal/instance:
uuid: "867fc519b84848b1971fe587e4c6676b"
format_stamp: "Formatted at 2026-08-10 15:26:02 on dist-test-slave-2p8l"
server_key: "bfe1be8529bb4a5efeca03a7cd8f26bc"
server_key_iv: "070160ee234efa9f77ee1f58c30c37dd"
server_key_version: "encryptionkey@0"
I20260810 15:26:02.256007 1026 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 15:26:02.256784 1051 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:26:02.256989 1026 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:26:02.257098 1026 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/ts-1/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/ts-1/wal
uuid: "867fc519b84848b1971fe587e4c6676b"
format_stamp: "Formatted at 2026-08-10 15:26:02 on dist-test-slave-2p8l"
server_key: "bfe1be8529bb4a5efeca03a7cd8f26bc"
server_key_iv: "070160ee234efa9f77ee1f58c30c37dd"
server_key_version: "encryptionkey@0"
I20260810 15:26:02.257190 1026 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:26:02.288196 1026 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:26:02.291139 1026 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:26:02.291277 1026 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:26:02.291497 1026 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 15:26:02.291806 1026 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 15:26:02.291839 1026 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 15:26:02.291862 1026 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 15:26:02.291874 1026 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 15:26:02.298225 1026 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.130:33079
I20260810 15:26:02.298277 1258 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.130:33079 every 8 connection(s)
I20260810 15:26:02.298688 1026 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/ts-1/data/info.pb
I20260810 15:26:02.299187 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 1026
I20260810 15:26:02.299319 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/ts-1/wal/instance
I20260810 15:26:02.299530 18706 external_mini_cluster.cc:1428] Setting key 95cb94af03916074d4e0298de7a50c96
Aug 10 15:26:02 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375562, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.130@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.18.68.131@KRBTEST.COM; defaulting to no policy
I20260810 15:26:02.309484 737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:26:02.299618 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.130:46081 (local address 127.18.68.190:46345)
0810 15:26:02.299677 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0810 15:26:02.299679 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:26:02.299876 (+ 197us) server_negotiation.cc:407] Connection header received
0810 15:26:02.300416 (+ 540us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:26:02.300418 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:26:02.300430 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:26:02.300486 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:26:02.301476 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:02.301987 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:02.303027 (+ 1040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:02.303259 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:02.303340 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:02.306276 (+ 2936us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:26:02.306278 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:26:02.306278 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:26:02.306295 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:26:02.307906 (+ 1611us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:26:02.308389 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:26:02.308391 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:26:02.308393 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:26:02.308455 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:26:02.308754 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:26:02.308755 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:26:02.308756 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:26:02.308886 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:26:02.308967 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0810 15:26:02.309280 (+ 313us) server_negotiation.cc:299] Negotiation successful
0810 15:26:02.309385 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260810 15:26:02.309691 1268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:26:02.299586 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46345 (local address 127.18.68.130:46081)
0810 15:26:02.299744 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0810 15:26:02.299788 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0810 15:26:02.300304 (+ 516us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:26:02.300563 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:26:02.300567 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:26:02.301171 (+ 604us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:26:02.301371 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:02.301376 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:02.302112 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:02.302113 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:02.302927 (+ 814us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:02.302930 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:02.303363 (+ 433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:02.303364 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:02.303500 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:02.304241 (+ 741us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:26:02.304250 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:26:02.306155 (+ 1905us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:26:02.308006 (+ 1851us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:26:02.308017 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:26:02.308020 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:26:02.308292 (+ 272us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:26:02.308527 (+ 235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:26:02.308528 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:26:02.308528 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:26:02.308653 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:26:02.308959 (+ 306us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:26:02.308967 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:26:02.309124 (+ 157us) client_negotiation.cc:769] Sending connection context
0810 15:26:02.309258 (+ 134us) client_negotiation.cc:240] Negotiation successful
0810 15:26:02.309438 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":82,"threads_started":1}
I20260810 15:26:02.310439 1259 heartbeater.cc:347] Connected to a master server at 127.18.68.190:46345
I20260810 15:26:02.310562 1259 heartbeater.cc:464] Registering TS with master...
I20260810 15:26:02.310750 1259 heartbeater.cc:511] Master 127.18.68.190:46345 requested a full tablet report, sending...
I20260810 15:26:02.311275 672 ts_manager.cc:194] Registered new tserver with Master: 867fc519b84848b1971fe587e4c6676b (127.18.68.130:33079)
I20260810 15:26:02.311748 672 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.68.130@KRBTEST.COM'} at 127.18.68.130:46081
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.68.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.68.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.131.keytab.
Entry for principal kudu/127.18.68.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.131.keytab.
I20260810 15:26:02.329538 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.68.131:0
--local_ip_for_outbound_sockets=127.18.68.131
--webserver_interface=127.18.68.131
--webserver_port=0
--tserver_master_addrs=127.18.68.190:46345
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.131.keytab
--principal=kudu/127.18.68.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:33457
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:26:02.418319 1272 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:26:02.418540 1272 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:26:02.418565 1272 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:26:02.419793 1272 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:26:02.419845 1272 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:26:02.419872 1272 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.68.131
I20260810 15:26:02.421422 1272 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:33457
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.131.keytab
--principal=kudu/127.18.68.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.68.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.68.131
--webserver_port=0
--tserver_master_addrs=127.18.68.190:46345
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1272
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.68.131
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:26:02.421690 1272 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:26:02.421908 1272 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:26:02.427307 1285 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:26:02.427309 1286 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:26:02.427309 1289 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:26:02.427759 1272 server_base.cc:1034] running on GCE node
I20260810 15:26:02.428015 1272 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:26:02.428287 1272 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:26:02.429435 1272 hybrid_clock.cc:648] HybridClock initialized: now 1786375562429421 us; error 33 us; skew 500 ppm
Aug 10 15:26:02 dist-test-slave-2p8l krb5kdc[587](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375562, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:26:02.432287 1272 init.cc:377] Logged in from keytab as kudu/127.18.68.131@KRBTEST.COM (short username kudu)
I20260810 15:26:02.432801 1272 webserver.cc:460] Webserver started at http://127.18.68.131:35127/ using document root <none> and password file <none>
I20260810 15:26:02.433065 1272 fs_manager.cc:359] Metadata directory not provided
I20260810 15:26:02.433140 1272 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:26:02.433300 1272 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:26:02.434499 1272 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/ts-2/data/instance:
uuid: "a422701f71144b21b900b182526a9ee6"
format_stamp: "Formatted at 2026-08-10 15:26:02 on dist-test-slave-2p8l"
server_key: "3033252bb3c33e7b28215a1f07d2eb4c"
server_key_iv: "f5ac75edf33d46c0ca3c01b2c4f5c2b2"
server_key_version: "encryptionkey@0"
I20260810 15:26:02.434888 1272 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/ts-2/wal/instance:
uuid: "a422701f71144b21b900b182526a9ee6"
format_stamp: "Formatted at 2026-08-10 15:26:02 on dist-test-slave-2p8l"
server_key: "3033252bb3c33e7b28215a1f07d2eb4c"
server_key_iv: "f5ac75edf33d46c0ca3c01b2c4f5c2b2"
server_key_version: "encryptionkey@0"
I20260810 15:26:02.436264 1272 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 15:26:02.437078 1303 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:26:02.437261 1272 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 15:26:02.437376 1272 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/ts-2/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/ts-2/wal
uuid: "a422701f71144b21b900b182526a9ee6"
format_stamp: "Formatted at 2026-08-10 15:26:02 on dist-test-slave-2p8l"
server_key: "3033252bb3c33e7b28215a1f07d2eb4c"
server_key_iv: "f5ac75edf33d46c0ca3c01b2c4f5c2b2"
server_key_version: "encryptionkey@0"
I20260810 15:26:02.437456 1272 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:26:02.456084 1272 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:26:02.458455 1272 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:26:02.458635 1272 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:26:02.458897 1272 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 15:26:02.459240 1272 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 15:26:02.459302 1272 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 15:26:02.459347 1272 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 15:26:02.459373 1272 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 15:26:02.466284 1272 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.131:43117
I20260810 15:26:02.466349 1512 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.131:43117 every 8 connection(s)
I20260810 15:26:02.466713 1272 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/ts-2/data/info.pb
Aug 10 15:26:02 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375562, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.131@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
I20260810 15:26:02.476176 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 1272
I20260810 15:26:02.476296 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/ts-2/wal/instance
I20260810 15:26:02.476478 18706 external_mini_cluster.cc:1428] Setting key 1a190f0199e91451020b70352df8c166
I20260810 15:26:02.477003 737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:26:02.467567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.131:45143 (local address 127.18.68.190:46345)
0810 15:26:02.467614 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0810 15:26:02.467616 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:26:02.467872 (+ 256us) server_negotiation.cc:407] Connection header received
0810 15:26:02.468341 (+ 469us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:26:02.468343 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:26:02.468355 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:26:02.468412 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:26:02.469371 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:02.469952 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:02.471200 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:02.471393 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:02.471452 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:02.473676 (+ 2224us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:26:02.473678 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:26:02.473678 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:26:02.473686 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:26:02.475416 (+ 1730us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:26:02.475874 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:26:02.475875 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:26:02.475875 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:26:02.475940 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:26:02.476232 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:26:02.476233 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:26:02.476234 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:26:02.476408 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:26:02.476488 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0810 15:26:02.476824 (+ 336us) server_negotiation.cc:299] Negotiation successful
0810 15:26:02.476910 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260810 15:26:02.477226 1521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:26:02.467523 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46345 (local address 127.18.68.131:45143)
0810 15:26:02.467732 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0810 15:26:02.467771 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0810 15:26:02.468252 (+ 481us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:26:02.468464 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:26:02.468467 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:26:02.469053 (+ 586us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:26:02.469260 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:02.469264 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:02.470160 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:02.470161 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:02.471104 (+ 943us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:02.471106 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:02.471478 (+ 372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:02.471479 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:02.471603 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:02.472145 (+ 542us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:26:02.472154 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:26:02.473557 (+ 1403us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:26:02.475499 (+ 1942us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:26:02.475506 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:26:02.475508 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:26:02.475766 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:26:02.476012 (+ 246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:26:02.476013 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:26:02.476013 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:26:02.476153 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:26:02.476479 (+ 326us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:26:02.476487 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:26:02.476674 (+ 187us) client_negotiation.cc:769] Sending connection context
0810 15:26:02.476784 (+ 110us) client_negotiation.cc:240] Negotiation successful
0810 15:26:02.476960 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":111,"threads_started":1}
I20260810 15:26:02.477721 1514 heartbeater.cc:347] Connected to a master server at 127.18.68.190:46345
I20260810 15:26:02.477839 1514 heartbeater.cc:464] Registering TS with master...
I20260810 15:26:02.478044 1514 heartbeater.cc:511] Master 127.18.68.190:46345 requested a full tablet report, sending...
I20260810 15:26:02.478510 672 ts_manager.cc:194] Registered new tserver with Master: a422701f71144b21b900b182526a9ee6 (127.18.68.131:43117)
I20260810 15:26:02.478890 672 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.68.131@KRBTEST.COM'} at 127.18.68.131:45143
I20260810 15:26:02.488579 18706 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.18.68.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.18.68.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.18.68.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/krb5kdc/oryx_127.18.68.129.keytab.
Entry for principal oryx/127.18.68.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/krb5kdc/oryx_127.18.68.129.keytab.
WARNING: no policy specified for oryx/127.18.68.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.18.68.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.18.68.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/krb5kdc/oryx_127.18.68.130.keytab.
Entry for principal oryx/127.18.68.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/krb5kdc/oryx_127.18.68.130.keytab.
WARNING: no policy specified for oryx/127.18.68.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.18.68.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.18.68.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/krb5kdc/oryx_127.18.68.131.keytab.
Entry for principal oryx/127.18.68.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/krb5kdc/oryx_127.18.68.131.keytab.
I20260810 15:26:02.574237 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 770
I20260810 15:26:02.595559 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 1026
I20260810 15:26:02.608520 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 1272
I20260810 15:26:02.648051 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 616
I20260810 15:26:02.665935 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.190:46345
--webserver_interface=127.18.68.190
--webserver_port=43243
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab
--principal=kudu/127.18.68.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:33457
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.68.190:46345
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:26:02.752493 1531 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:26:02.752782 1531 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:26:02.752827 1531 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:26:02.754025 1531 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 15:26:02.754127 1531 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:26:02.754153 1531 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:26:02.754174 1531 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 15:26:02.754202 1531 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 15:26:02.755774 1531 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:33457
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.68.190:46345
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab
--principal=kudu/127.18.68.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.190:46345
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.68.190
--webserver_port=43243
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1531
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:26:02.756094 1531 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:26:02.756346 1531 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:26:02.761788 1541 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:26:02.761781 1543 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:26:02.761781 1549 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:26:02.762034 1531 server_base.cc:1034] running on GCE node
I20260810 15:26:02.762403 1531 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:26:02.762773 1531 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:26:02.763981 1531 hybrid_clock.cc:648] HybridClock initialized: now 1786375562763937 us; error 78 us; skew 500 ppm
Aug 10 15:26:02 dist-test-slave-2p8l krb5kdc[587](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375562, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:26:02.766863 1531 init.cc:377] Logged in from keytab as kudu/127.18.68.190@KRBTEST.COM (short username kudu)
I20260810 15:26:02.767416 1531 webserver.cc:460] Webserver started at http://127.18.68.190:43243/ using document root <none> and password file <none>
I20260810 15:26:02.767810 1531 fs_manager.cc:359] Metadata directory not provided
I20260810 15:26:02.767925 1531 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:26:02.769517 1531 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260810 15:26:02.770489 1569 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:26:02.770748 1531 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 15:26:02.770879 1531 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/master-0/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/master-0/wal
uuid: "c034cd0f3f7e48e08eee9175a39baa97"
format_stamp: "Formatted at 2026-08-10 15:26:01 on dist-test-slave-2p8l"
server_key: "c196ac422bac01d8732b6d181c3b7642"
server_key_iv: "0e738fc75c94b01a67c16a800bc9827c"
server_key_version: "encryptionkey@0"
I20260810 15:26:02.771312 1531 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:26:02.812887 1531 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:26:02.815853 1531 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:26:02.816116 1531 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:26:02.821190 1531 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.190:46345
I20260810 15:26:02.821295 1654 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.190:46345 every 8 connection(s)
I20260810 15:26:02.821736 1531 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
I20260810 15:26:02.822515 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 1531
I20260810 15:26:02.822872 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.68.129:46467
--local_ip_for_outbound_sockets=127.18.68.129
--tserver_master_addrs=127.18.68.190:46345
--webserver_port=36321
--webserver_interface=127.18.68.129
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.129.keytab
--principal=kudu/127.18.68.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:33457
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.18.68.129
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/krb5kdc/oryx_127.18.68.129.keytab with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 15:26:02.824224 1656 sys_catalog.cc:263] Verifying existing consensus state
I20260810 15:26:02.825177 1656 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c034cd0f3f7e48e08eee9175a39baa97: Bootstrap starting.
I20260810 15:26:02.833977 1656 log.cc:824] T 00000000000000000000000000000000 P c034cd0f3f7e48e08eee9175a39baa97: Log is configured to *not* fsync() on all Append() calls
I20260810 15:26:02.836187 1656 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c034cd0f3f7e48e08eee9175a39baa97: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 15:26:02.836519 1656 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c034cd0f3f7e48e08eee9175a39baa97: Bootstrap complete.
I20260810 15:26:02.839100 1656 raft_consensus.cc:348] T 00000000000000000000000000000000 P c034cd0f3f7e48e08eee9175a39baa97 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c034cd0f3f7e48e08eee9175a39baa97" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46345 } }
I20260810 15:26:02.839370 1656 raft_consensus.cc:729] T 00000000000000000000000000000000 P c034cd0f3f7e48e08eee9175a39baa97 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c034cd0f3f7e48e08eee9175a39baa97, State: Initialized, Role: FOLLOWER
I20260810 15:26:02.839592 1656 consensus_queue.cc:260] T 00000000000000000000000000000000 P c034cd0f3f7e48e08eee9175a39baa97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c034cd0f3f7e48e08eee9175a39baa97" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46345 } }
I20260810 15:26:02.839694 1656 raft_consensus.cc:388] T 00000000000000000000000000000000 P c034cd0f3f7e48e08eee9175a39baa97 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 15:26:02.839758 1656 raft_consensus.cc:482] T 00000000000000000000000000000000 P c034cd0f3f7e48e08eee9175a39baa97 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 15:26:02.839808 1656 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c034cd0f3f7e48e08eee9175a39baa97 [term 1 FOLLOWER]: Advancing to term 2
I20260810 15:26:02.840889 1656 raft_consensus.cc:504] T 00000000000000000000000000000000 P c034cd0f3f7e48e08eee9175a39baa97 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c034cd0f3f7e48e08eee9175a39baa97" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46345 } }
I20260810 15:26:02.841017 1656 leader_election.cc:302] T 00000000000000000000000000000000 P c034cd0f3f7e48e08eee9175a39baa97 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c034cd0f3f7e48e08eee9175a39baa97; no voters:
I20260810 15:26:02.841243 1656 leader_election.cc:288] T 00000000000000000000000000000000 P c034cd0f3f7e48e08eee9175a39baa97 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260810 15:26:02.841290 1672 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c034cd0f3f7e48e08eee9175a39baa97 [term 2 FOLLOWER]: Leader election won for term 2
I20260810 15:26:02.841428 1672 raft_consensus.cc:686] T 00000000000000000000000000000000 P c034cd0f3f7e48e08eee9175a39baa97 [term 2 LEADER]: Becoming Leader. State: Replica: c034cd0f3f7e48e08eee9175a39baa97, State: Running, Role: LEADER
I20260810 15:26:02.841536 1672 consensus_queue.cc:237] T 00000000000000000000000000000000 P c034cd0f3f7e48e08eee9175a39baa97 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c034cd0f3f7e48e08eee9175a39baa97" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46345 } }
I20260810 15:26:02.841579 1656 sys_catalog.cc:564] T 00000000000000000000000000000000 P c034cd0f3f7e48e08eee9175a39baa97 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 15:26:02.841924 1675 sys_catalog.cc:455] T 00000000000000000000000000000000 P c034cd0f3f7e48e08eee9175a39baa97 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "c034cd0f3f7e48e08eee9175a39baa97" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c034cd0f3f7e48e08eee9175a39baa97" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46345 } } }
I20260810 15:26:02.842022 1675 sys_catalog.cc:458] T 00000000000000000000000000000000 P c034cd0f3f7e48e08eee9175a39baa97 [sys.catalog]: This master's current role is: LEADER
I20260810 15:26:02.842298 1676 sys_catalog.cc:455] T 00000000000000000000000000000000 P c034cd0f3f7e48e08eee9175a39baa97 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c034cd0f3f7e48e08eee9175a39baa97. Latest consensus state: current_term: 2 leader_uuid: "c034cd0f3f7e48e08eee9175a39baa97" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c034cd0f3f7e48e08eee9175a39baa97" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46345 } } }
I20260810 15:26:02.842406 1676 sys_catalog.cc:458] T 00000000000000000000000000000000 P c034cd0f3f7e48e08eee9175a39baa97 [sys.catalog]: This master's current role is: LEADER
I20260810 15:26:02.842559 1682 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 15:26:02.843093 1682 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 15:26:02.843371 1682 catalog_manager.cc:1259] Loaded cluster ID: 8ba3797aae0e4aa2951a107bdeef9747
I20260810 15:26:02.843446 1682 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 15:26:02.844650 1682 catalog_manager.cc:1504] Loading token signing keys...
I20260810 15:26:02.844833 1682 catalog_manager.cc:5879] T 00000000000000000000000000000000 P c034cd0f3f7e48e08eee9175a39baa97: Loaded TSK: 0
I20260810 15:26:02.845037 1682 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260810 15:26:02.918304 1662 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:26:02.918530 1662 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:26:02.918556 1662 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:26:02.919821 1662 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:26:02.919872 1662 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:26:02.919901 1662 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.68.129
I20260810 15:26:02.921468 1662 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:33457
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/krb5kdc/oryx_127.18.68.129.keytab
--principal=oryx/127.18.68.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.68.129:46467
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.68.129
--webserver_port=36321
--tserver_master_addrs=127.18.68.190:46345
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1662
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.68.129
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:26:02.921759 1662 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:26:02.922034 1662 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:26:02.927759 1712 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:26:02.927762 1714 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:26:02.927762 1709 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:26:02.928371 1662 server_base.cc:1034] running on GCE node
I20260810 15:26:02.928623 1662 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:26:02.928925 1662 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:26:02.930160 1662 hybrid_clock.cc:648] HybridClock initialized: now 1786375562930130 us; error 44 us; skew 500 ppm
Aug 10 15:26:02 dist-test-slave-2p8l krb5kdc[587](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375562, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.68.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:26:02.932955 1662 init.cc:377] Logged in from keytab as oryx/127.18.68.129@KRBTEST.COM (short username oryx)
I20260810 15:26:02.933548 1662 webserver.cc:460] Webserver started at http://127.18.68.129:36321/ using document root <none> and password file <none>
I20260810 15:26:02.933835 1662 fs_manager.cc:359] Metadata directory not provided
I20260810 15:26:02.933900 1662 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:26:02.935777 1662 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:26:02.936681 1728 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:26:02.936918 1662 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:26:02.937052 1662 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/ts-0/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/ts-0/wal
uuid: "748a8dd3f19b4be7b976ea0da79b10e0"
format_stamp: "Formatted at 2026-08-10 15:26:02 on dist-test-slave-2p8l"
server_key: "50eeba9ddffebb020fb250baaeaf6068"
server_key_iv: "d9f63e0825332898f8f1618989701daf"
server_key_version: "encryptionkey@0"
I20260810 15:26:02.937492 1662 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:26:02.978654 1662 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:26:02.981033 1662 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:26:02.981215 1662 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:26:02.981499 1662 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 15:26:02.981858 1662 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 15:26:02.981895 1662 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 15:26:02.981920 1662 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 15:26:02.981961 1662 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 15:26:02.988297 1662 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.129:46467
I20260810 15:26:02.988341 1945 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.129:46467 every 8 connection(s)
I20260810 15:26:02.988736 1662 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/ts-0/data/info.pb
Aug 10 15:26:02 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.129@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 15:26:02 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.129@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 15:26:02.997509 1948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:26:02.989491 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46345 (local address 127.18.68.129:34877)
0810 15:26:02.989714 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0810 15:26:02.989767 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0810 15:26:02.990319 (+ 552us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:26:02.990811 (+ 492us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:26:02.990815 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:26:02.991439 (+ 624us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:26:02.991628 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:02.991632 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:02.992755 (+ 1123us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:02.992756 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:02.993557 (+ 801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:02.993559 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:02.994216 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:02.994217 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:02.994362 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:02.994940 (+ 578us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:26:02.994948 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:26:02.997348 (+ 2400us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.68.190:46345: Server oryx/127.18.68.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":109,"threads_started":1}
W20260810 15:26:02.997671 1952 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 15:26:02.989576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.129:34877 (local address 127.18.68.190:46345)
0810 15:26:02.989772 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0810 15:26:02.989780 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 15:26:02.989872 (+ 92us) server_negotiation.cc:407] Connection header received
0810 15:26:02.990537 (+ 665us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:26:02.990541 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:26:02.990584 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:26:02.990770 (+ 186us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:26:02.991762 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:02.992631 (+ 869us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:02.993661 (+ 1030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:02.994116 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:02.994244 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:02.997501 (+ 3257us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.68.129:34877: BlockingRecv error: recv got EOF from 127.18.68.129:34877 (error 108)
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":86,"threads_started":1}
W20260810 15:26:02.997815 1946 heartbeater.cc:644] Failed to heartbeat to 127.18.68.190:46345 (0 consecutive failures): Not authorized: Failed to ping master at 127.18.68.190:46345: Client connection negotiation failed: client connection to 127.18.68.190:46345: Server oryx/127.18.68.190@KRBTEST.COM not found in Kerberos database
I20260810 15:26:02.998293 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 1662
I20260810 15:26:02.998607 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.68.130:33079
--local_ip_for_outbound_sockets=127.18.68.130
--tserver_master_addrs=127.18.68.190:46345
--webserver_port=44513
--webserver_interface=127.18.68.130
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.130.keytab
--principal=kudu/127.18.68.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:33457
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.18.68.130
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/krb5kdc/oryx_127.18.68.130.keytab with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 15:26:02 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.129@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 15:26:02 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.129@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 15:26:03.003374 1948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:26:02.998148 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46345 (local address 127.18.68.129:32795)
0810 15:26:02.998188 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0810 15:26:02.998199 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 15:26:02.998274 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:26:02.998482 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:26:02.998483 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:26:02.998631 (+ 148us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:26:02.998681 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:02.998682 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:02.999425 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:02.999427 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:02.999999 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:03.000000 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:03.000433 (+ 433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:03.000434 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:03.000519 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:03.001081 (+ 562us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:26:03.001093 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:26:03.003266 (+ 2173us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.68.190:46345: Server oryx/127.18.68.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":19}
W20260810 15:26:03.003554 1952 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 15:26:02.998219 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.129:32795 (local address 127.18.68.190:46345)
0810 15:26:02.998291 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0810 15:26:02.998293 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:26:02.998303 (+ 10us) server_negotiation.cc:407] Connection header received
0810 15:26:02.998331 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:26:02.998332 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:26:02.998345 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:26:02.998433 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:26:02.998793 (+ 360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:02.999333 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:03.000096 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:03.000347 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:03.000435 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:03.003383 (+ 2948us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.68.129:32795: BlockingRecv error: recv got EOF from 127.18.68.129:32795 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
Aug 10 15:26:03 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.129@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 15:26:03 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.129@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 15:26:03.008850 1948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:26:03.003757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46345 (local address 127.18.68.129:50493)
0810 15:26:03.003809 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0810 15:26:03.003819 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 15:26:03.003856 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:26:03.004045 (+ 189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:26:03.004047 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:26:03.004206 (+ 159us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:26:03.004251 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:03.004253 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:03.004963 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:03.004965 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:03.005864 (+ 899us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:03.005868 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:03.006295 (+ 427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:03.006296 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:03.006364 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:03.006785 (+ 421us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:26:03.006791 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:26:03.008762 (+ 1971us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.68.190:46345: Server oryx/127.18.68.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":34}
W20260810 15:26:03.008905 1952 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 15:26:03.003850 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.129:50493 (local address 127.18.68.190:46345)
0810 15:26:03.003908 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0810 15:26:03.003910 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:26:03.003927 (+ 17us) server_negotiation.cc:407] Connection header received
0810 15:26:03.003949 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:26:03.003950 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:26:03.003959 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:26:03.004016 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:26:03.004358 (+ 342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:03.004877 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:03.005973 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:03.006221 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:03.006276 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:03.008840 (+ 2564us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.68.129:50493: BlockingRecv error: recv got EOF from 127.18.68.129:50493 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
W20260810 15:26:03.009002 1946 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260810 15:26:03.088826 1954 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:26:03.089104 1954 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:26:03.089151 1954 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:26:03.090485 1954 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:26:03.090549 1954 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:26:03.090596 1954 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.68.130
I20260810 15:26:03.092131 1954 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:33457
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/krb5kdc/oryx_127.18.68.130.keytab
--principal=oryx/127.18.68.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.68.130:33079
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.68.130
--webserver_port=44513
--tserver_master_addrs=127.18.68.190:46345
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1954
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.68.130
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:26:03.092427 1954 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:26:03.092676 1954 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:26:03.098091 1962 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:26:03.098121 1969 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:26:03.098241 1963 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:26:03.098249 1954 server_base.cc:1034] running on GCE node
I20260810 15:26:03.098656 1954 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:26:03.098946 1954 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:26:03.100137 1954 hybrid_clock.cc:648] HybridClock initialized: now 1786375563100120 us; error 28 us; skew 500 ppm
Aug 10 15:26:03 dist-test-slave-2p8l krb5kdc[587](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375563, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.68.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:26:03.103053 1954 init.cc:377] Logged in from keytab as oryx/127.18.68.130@KRBTEST.COM (short username oryx)
I20260810 15:26:03.103557 1954 webserver.cc:460] Webserver started at http://127.18.68.130:44513/ using document root <none> and password file <none>
I20260810 15:26:03.103827 1954 fs_manager.cc:359] Metadata directory not provided
I20260810 15:26:03.103909 1954 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:26:03.105445 1954 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:26:03.106345 1982 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:26:03.106556 1954 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:26:03.106657 1954 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/ts-1/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/ts-1/wal
uuid: "867fc519b84848b1971fe587e4c6676b"
format_stamp: "Formatted at 2026-08-10 15:26:02 on dist-test-slave-2p8l"
server_key: "bfe1be8529bb4a5efeca03a7cd8f26bc"
server_key_iv: "070160ee234efa9f77ee1f58c30c37dd"
server_key_version: "encryptionkey@0"
I20260810 15:26:03.107005 1954 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:26:03.127271 1954 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:26:03.129431 1954 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:26:03.129556 1954 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:26:03.129771 1954 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 15:26:03.130173 1954 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 15:26:03.130216 1954 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 15:26:03.130241 1954 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 15:26:03.130291 1954 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 15:26:03.136518 1954 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.130:33079
I20260810 15:26:03.136665 2193 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.130:33079 every 8 connection(s)
I20260810 15:26:03.136976 1954 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/ts-1/data/info.pb
Aug 10 15:26:03 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.130@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 15:26:03 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.130@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 15:26:03.145200 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 1954
I20260810 15:26:03.145359 2196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:26:03.137847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46345 (local address 127.18.68.130:55657)
0810 15:26:03.138026 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0810 15:26:03.138100 (+ 74us) client_negotiation.cc:174] Beginning negotiation
0810 15:26:03.138583 (+ 483us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:26:03.138800 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:26:03.138803 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:26:03.139393 (+ 590us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:26:03.139594 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:03.139598 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:03.140298 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:03.140299 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:03.141321 (+ 1022us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:03.141324 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:03.142179 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:03.142180 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:03.142296 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:03.142886 (+ 590us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:26:03.142895 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:26:03.145155 (+ 2260us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.68.190:46345: Server oryx/127.18.68.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":108,"threads_started":1}
W20260810 15:26:03.145381 1952 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 15:26:03.137862 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.130:55657 (local address 127.18.68.190:46345)
0810 15:26:03.137912 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0810 15:26:03.137914 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:26:03.138205 (+ 291us) server_negotiation.cc:407] Connection header received
0810 15:26:03.138677 (+ 472us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:26:03.138678 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:26:03.138692 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:26:03.138747 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:26:03.139694 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:03.140208 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:03.141426 (+ 1218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:03.141989 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:03.142157 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:03.145307 (+ 3150us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.68.130:55657: BlockingRecv error: recv got EOF from 127.18.68.130:55657 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
I20260810 15:26:03.145560 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.68.131:43117
--local_ip_for_outbound_sockets=127.18.68.131
--tserver_master_addrs=127.18.68.190:46345
--webserver_port=35127
--webserver_interface=127.18.68.131
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.131.keytab
--principal=kudu/127.18.68.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:33457
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.18.68.131
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/krb5kdc/oryx_127.18.68.131.keytab with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:26:03.146126 2194 heartbeater.cc:644] Failed to heartbeat to 127.18.68.190:46345 (0 consecutive failures): Not authorized: Failed to ping master at 127.18.68.190:46345: Client connection negotiation failed: client connection to 127.18.68.190:46345: Server oryx/127.18.68.190@KRBTEST.COM not found in Kerberos database
Aug 10 15:26:03 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.130@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 15:26:03 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.130@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 15:26:03.151036 2196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:26:03.146408 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46345 (local address 127.18.68.130:36799)
0810 15:26:03.146443 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0810 15:26:03.146453 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 15:26:03.146495 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:26:03.146625 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:26:03.146626 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:26:03.146774 (+ 148us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:26:03.146822 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:03.146824 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:03.147488 (+ 664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:03.147489 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:03.147996 (+ 507us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:03.147997 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:03.148384 (+ 387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:03.148384 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:03.148458 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:03.148922 (+ 464us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:26:03.148927 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:26:03.150943 (+ 2016us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.68.190:46345: Server oryx/127.18.68.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":16}
W20260810 15:26:03.151094 1952 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 15:26:03.146463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.130:36799 (local address 127.18.68.190:46345)
0810 15:26:03.146512 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0810 15:26:03.146514 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:26:03.146522 (+ 8us) server_negotiation.cc:407] Connection header received
0810 15:26:03.146553 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:26:03.146554 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:26:03.146563 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:26:03.146620 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:26:03.146904 (+ 284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:03.147399 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:03.148082 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:03.148293 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:03.148383 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:03.151031 (+ 2648us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.68.130:36799: BlockingRecv error: recv got EOF from 127.18.68.130:36799 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
Aug 10 15:26:03 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.130@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 15:26:03 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.130@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 15:26:03.156483 2196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:26:03.151313 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46345 (local address 127.18.68.130:44619)
0810 15:26:03.151528 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0810 15:26:03.151542 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 15:26:03.151606 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:26:03.151739 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:26:03.151740 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:26:03.151907 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:26:03.151951 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:03.151953 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:03.152627 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:03.152628 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:03.153530 (+ 902us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:03.153533 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:03.153932 (+ 399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:03.153933 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:03.153998 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:03.154514 (+ 516us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:26:03.154520 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:26:03.156430 (+ 1910us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.68.190:46345: Server oryx/127.18.68.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":192}
W20260810 15:26:03.156641 1952 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 15:26:03.151374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.130:44619 (local address 127.18.68.190:46345)
0810 15:26:03.151447 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0810 15:26:03.151449 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:26:03.151608 (+ 159us) server_negotiation.cc:407] Connection header received
0810 15:26:03.151673 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:26:03.151674 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:26:03.151682 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:26:03.151729 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:26:03.152061 (+ 332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:03.152538 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:03.153634 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:03.153849 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:03.153911 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:03.156561 (+ 2650us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.68.130:44619: BlockingRecv error: recv got EOF from 127.18.68.130:44619 (error 108)
Metrics: {"server-negotiator.queue_time_us":51,"thread_start_us":102,"threads_started":1}
W20260810 15:26:03.156651 2194 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260810 15:26:03.232714 2197 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:26:03.232929 2197 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:26:03.232954 2197 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:26:03.234190 2197 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:26:03.234236 2197 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:26:03.234262 2197 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.68.131
I20260810 15:26:03.235754 2197 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:33457
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/krb5kdc/oryx_127.18.68.131.keytab
--principal=oryx/127.18.68.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.68.131:43117
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.68.131
--webserver_port=35127
--tserver_master_addrs=127.18.68.190:46345
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2197
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.68.131
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:26:03.235961 2197 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:26:03.236152 2197 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:26:03.241621 2210 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:26:03.241628 2208 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:26:03.241636 2215 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:26:03.242113 2197 server_base.cc:1034] running on GCE node
I20260810 15:26:03.242403 2197 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:26:03.242785 2197 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:26:03.243959 2197 hybrid_clock.cc:648] HybridClock initialized: now 1786375563243946 us; error 28 us; skew 500 ppm
Aug 10 15:26:03 dist-test-slave-2p8l krb5kdc[587](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375563, etypes {rep=17 tkt=17 ses=17}, oryx/127.18.68.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:26:03.246837 2197 init.cc:377] Logged in from keytab as oryx/127.18.68.131@KRBTEST.COM (short username oryx)
I20260810 15:26:03.247375 2197 webserver.cc:460] Webserver started at http://127.18.68.131:35127/ using document root <none> and password file <none>
I20260810 15:26:03.247644 2197 fs_manager.cc:359] Metadata directory not provided
I20260810 15:26:03.247704 2197 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:26:03.249164 2197 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:26:03.249812 2226 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:26:03.249997 2197 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260810 15:26:03.250139 2197 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/ts-2/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/ts-2/wal
uuid: "a422701f71144b21b900b182526a9ee6"
format_stamp: "Formatted at 2026-08-10 15:26:02 on dist-test-slave-2p8l"
server_key: "3033252bb3c33e7b28215a1f07d2eb4c"
server_key_iv: "f5ac75edf33d46c0ca3c01b2c4f5c2b2"
server_key_version: "encryptionkey@0"
I20260810 15:26:03.250494 2197 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:26:03.272104 2197 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:26:03.274550 2197 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:26:03.274762 2197 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:26:03.275029 2197 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 15:26:03.275389 2197 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 15:26:03.275447 2197 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 15:26:03.275489 2197 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 15:26:03.275539 2197 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 15:26:03.281936 2197 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.131:43117
I20260810 15:26:03.281986 2443 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.131:43117 every 8 connection(s)
I20260810 15:26:03.282375 2197 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786375520124696-18706-0/minicluster-data/ts-2/data/info.pb
Aug 10 15:26:03 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.131@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 15:26:03 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.131@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 15:26:03.290745 2448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:26:03.283309 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46345 (local address 127.18.68.131:38217)
0810 15:26:03.283522 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0810 15:26:03.283571 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0810 15:26:03.284107 (+ 536us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:26:03.284401 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:26:03.284404 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:26:03.285141 (+ 737us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:26:03.285361 (+ 220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:03.285367 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:03.286206 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:03.286207 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:03.287058 (+ 851us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:03.287062 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:03.287446 (+ 384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:03.287448 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:03.287586 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:03.288177 (+ 591us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:26:03.288186 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:26:03.290583 (+ 2397us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.68.190:46345: Server oryx/127.18.68.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":122,"threads_started":1}
W20260810 15:26:03.290755 1952 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 15:26:03.283325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.131:38217 (local address 127.18.68.190:46345)
0810 15:26:03.283409 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0810 15:26:03.283411 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:26:03.283673 (+ 262us) server_negotiation.cc:407] Connection header received
0810 15:26:03.284228 (+ 555us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:26:03.284230 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:26:03.284241 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:26:03.284307 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:26:03.285495 (+ 1188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:03.286011 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:03.287154 (+ 1143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:03.287345 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:03.287405 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:03.290704 (+ 3299us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.68.131:38217: BlockingRecv error: recv got EOF from 127.18.68.131:38217 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
W20260810 15:26:03.290989 2444 heartbeater.cc:644] Failed to heartbeat to 127.18.68.190:46345 (0 consecutive failures): Not authorized: Failed to ping master at 127.18.68.190:46345: Client connection negotiation failed: client connection to 127.18.68.190:46345: Server oryx/127.18.68.190@KRBTEST.COM not found in Kerberos database
I20260810 15:26:03.292439 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 2197
Aug 10 15:26:03 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.131@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 15:26:03 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.131@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 15:26:03.296186 2448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:26:03.291227 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46345 (local address 127.18.68.131:52265)
0810 15:26:03.291280 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0810 15:26:03.291290 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 15:26:03.291335 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:26:03.291599 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:26:03.291600 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:26:03.291732 (+ 132us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:26:03.291783 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:03.291784 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:03.292410 (+ 626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:03.292411 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:03.293309 (+ 898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:03.293312 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:03.293645 (+ 333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:03.293646 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:03.293749 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:03.294310 (+ 561us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:26:03.294315 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:26:03.296092 (+ 1777us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.68.190:46345: Server oryx/127.18.68.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":34}
W20260810 15:26:03.296234 1952 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 15:26:03.291407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.131:52265 (local address 127.18.68.190:46345)
0810 15:26:03.291462 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0810 15:26:03.291464 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:26:03.291471 (+ 7us) server_negotiation.cc:407] Connection header received
0810 15:26:03.291492 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:26:03.291492 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:26:03.291500 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:26:03.291551 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:26:03.291858 (+ 307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:03.292317 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:03.293392 (+ 1075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:03.293568 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:03.293623 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:03.296169 (+ 2546us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.68.131:52265: BlockingRecv error: recv got EOF from 127.18.68.131:52265 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
Aug 10 15:26:03 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.131@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 15:26:03 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.131@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 15:26:03.300482 2448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:26:03.296456 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46345 (local address 127.18.68.131:40057)
0810 15:26:03.296506 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0810 15:26:03.296516 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 15:26:03.296575 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:26:03.296700 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:26:03.296701 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:26:03.296825 (+ 124us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:26:03.296849 (+ 24us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:03.296850 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:03.297466 (+ 616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:03.297467 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:03.297946 (+ 479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:03.297947 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:03.298353 (+ 406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:03.298354 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:03.298410 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:03.298766 (+ 356us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:26:03.298771 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:26:03.300394 (+ 1623us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.68.190:46345: Server oryx/127.18.68.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":34}
W20260810 15:26:03.300529 1952 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 15:26:03.296529 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.131:40057 (local address 127.18.68.190:46345)
0810 15:26:03.296590 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0810 15:26:03.296592 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:26:03.296600 (+ 8us) server_negotiation.cc:407] Connection header received
0810 15:26:03.296623 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:26:03.296624 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:26:03.296632 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:26:03.296695 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:26:03.296923 (+ 228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:03.297363 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:03.298040 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:03.298279 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:03.298353 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:03.300466 (+ 2113us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.68.131:40057: BlockingRecv error: recv got EOF from 127.18.68.131:40057 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
I20260810 15:26:03.300765 2203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:26:03.292879 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53080 (local address 127.18.68.190:46345)
0810 15:26:03.292945 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0810 15:26:03.292947 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:26:03.293132 (+ 185us) server_negotiation.cc:407] Connection header received
0810 15:26:03.293186 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:26:03.293187 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:26:03.293195 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:26:03.293249 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:26:03.294041 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:03.294733 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:03.295566 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:03.295792 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:03.295875 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:03.297287 (+ 1412us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:26:03.297292 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:26:03.297293 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:26:03.297306 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:26:03.299256 (+ 1950us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:26:03.299718 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:26:03.299722 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:26:03.299723 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:26:03.299832 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:26:03.300052 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:26:03.300053 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:26:03.300053 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:26:03.300310 (+ 257us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:26:03.300483 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0810 15:26:03.300562 (+ 79us) server_negotiation.cc:299] Negotiation successful
0810 15:26:03.300677 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
W20260810 15:26:03.300779 2444 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 10 15:26:04 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.129@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 15:26:04 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.129@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 15:26:04.015002 2452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:26:04.009486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46345 (local address 127.18.68.129:45175)
0810 15:26:04.009633 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0810 15:26:04.009643 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 15:26:04.009695 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:26:04.010005 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:26:04.010007 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:26:04.010337 (+ 330us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:26:04.010392 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:04.010394 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:04.011105 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:04.011106 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:04.011880 (+ 774us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:04.011883 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:04.012316 (+ 433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:04.012317 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:04.012359 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:04.012864 (+ 505us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:26:04.012869 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:26:04.014911 (+ 2042us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.68.190:46345: Server oryx/127.18.68.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":60,"threads_started":1}
W20260810 15:26:04.015231 2453 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 15:26:04.009655 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.129:45175 (local address 127.18.68.190:46345)
0810 15:26:04.009814 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0810 15:26:04.009815 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 15:26:04.009824 (+ 9us) server_negotiation.cc:407] Connection header received
0810 15:26:04.009850 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:26:04.009851 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:26:04.009861 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:26:04.009935 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:26:04.010478 (+ 543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:04.010999 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:04.012000 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:04.012235 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:04.012309 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:04.015140 (+ 2831us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.68.129:45175: BlockingRecv error: recv got EOF from 127.18.68.129:45175 (error 108)
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":100,"threads_started":1}
Aug 10 15:26:04 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.130@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 15:26:04 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.130@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 15:26:04.162828 2456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:26:04.157088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46345 (local address 127.18.68.130:56287)
0810 15:26:04.157330 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0810 15:26:04.157347 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 15:26:04.157459 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:26:04.157700 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:26:04.157701 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:26:04.157909 (+ 208us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:26:04.157972 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:04.157974 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:04.158761 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:04.158763 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:04.159409 (+ 646us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:04.159411 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:04.159822 (+ 411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:04.159823 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:04.159887 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:04.160476 (+ 589us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:26:04.160484 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:26:04.162761 (+ 2277us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.68.190:46345: Server oryx/127.18.68.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":95,"threads_started":1}
W20260810 15:26:04.163012 2453 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 15:26:04.157236 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.130:56287 (local address 127.18.68.190:46345)
0810 15:26:04.157335 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0810 15:26:04.157338 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 15:26:04.157433 (+ 95us) server_negotiation.cc:407] Connection header received
0810 15:26:04.157585 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:26:04.157587 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:26:04.157601 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:26:04.157691 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:26:04.158108 (+ 417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:04.158661 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:04.159520 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:04.159735 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:04.159824 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:04.162910 (+ 3086us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.68.130:56287: BlockingRecv error: recv got EOF from 127.18.68.130:56287 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Aug 10 15:26:04 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.131@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 15:26:04 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.131@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 15:26:04.306396 2457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:26:04.301310 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46345 (local address 127.18.68.131:37917)
0810 15:26:04.301465 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0810 15:26:04.301479 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 15:26:04.301547 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:26:04.301676 (+ 129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:26:04.301677 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:26:04.301859 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:26:04.301913 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:04.301915 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:04.302677 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:04.302677 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:04.303268 (+ 591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:04.303270 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:04.303657 (+ 387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:04.303658 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:04.303705 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:04.304323 (+ 618us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:26:04.304328 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:26:04.306331 (+ 2003us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.68.190:46345: Server oryx/127.18.68.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":94,"threads_started":1}
W20260810 15:26:04.306530 2453 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 15:26:04.301446 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.131:37917 (local address 127.18.68.190:46345)
0810 15:26:04.301540 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0810 15:26:04.301542 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:26:04.301554 (+ 12us) server_negotiation.cc:407] Connection header received
0810 15:26:04.301600 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:26:04.301601 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:26:04.301612 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:26:04.301669 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:26:04.302049 (+ 380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:04.302572 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:04.303356 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:04.303544 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:04.303612 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:04.306443 (+ 2831us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.68.131:37917: BlockingRecv error: recv got EOF from 127.18.68.131:37917 (error 108)
Metrics: {"server-negotiator.queue_time_us":31}
Aug 10 15:26:05 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.129@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 15:26:05 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.129@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 15:26:05.020450 2458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:26:05.015521 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46345 (local address 127.18.68.129:40585)
0810 15:26:05.015688 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0810 15:26:05.015699 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 15:26:05.015756 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:26:05.015916 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:26:05.015917 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:26:05.016091 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:26:05.016142 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:05.016143 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:05.016856 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:05.016857 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:05.017380 (+ 523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:05.017381 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:05.017730 (+ 349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:05.017731 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:05.017784 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:05.018440 (+ 656us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:26:05.018444 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:26:05.020388 (+ 1944us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.68.190:46345: Server oryx/127.18.68.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":94,"threads_started":1}
W20260810 15:26:05.020733 2462 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 15:26:05.015636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.129:40585 (local address 127.18.68.190:46345)
0810 15:26:05.015789 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0810 15:26:05.015791 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:26:05.015800 (+ 9us) server_negotiation.cc:407] Connection header received
0810 15:26:05.015825 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:26:05.015825 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:26:05.015835 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:26:05.015900 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:26:05.016228 (+ 328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:05.016777 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:05.017454 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:05.017643 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:05.017711 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:05.020526 (+ 2815us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.68.129:40585: BlockingRecv error: recv got EOF from 127.18.68.129:40585 (error 108)
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":62,"threads_started":1}
Aug 10 15:26:05 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.130@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 15:26:05 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.130@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 15:26:05.168511 2463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:26:05.163380 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46345 (local address 127.18.68.130:57807)
0810 15:26:05.163573 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0810 15:26:05.163588 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 15:26:05.163677 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:26:05.163840 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:26:05.163841 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:26:05.164025 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:26:05.164088 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:05.164090 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:05.164830 (+ 740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:05.164830 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:05.165359 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:05.165360 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:05.165731 (+ 371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:05.165732 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:05.165793 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:05.166375 (+ 582us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:26:05.166379 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:26:05.168451 (+ 2072us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.68.190:46345: Server oryx/127.18.68.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":93,"threads_started":1}
W20260810 15:26:05.168777 2462 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 15:26:05.163482 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.130:57807 (local address 127.18.68.190:46345)
0810 15:26:05.163596 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0810 15:26:05.163598 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:26:05.163671 (+ 73us) server_negotiation.cc:407] Connection header received
0810 15:26:05.163749 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:26:05.163750 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:26:05.163770 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:26:05.163833 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:26:05.164181 (+ 348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:05.164734 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:05.165448 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:05.165654 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:05.165733 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:05.168708 (+ 2975us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.68.130:57807: BlockingRecv error: recv got EOF from 127.18.68.130:57807 (error 108)
Metrics: {"server-negotiator.queue_time_us":86}
Aug 10 15:26:05 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.131@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 15:26:05 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.131@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 15:26:05.312194 2464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:26:05.306967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46345 (local address 127.18.68.131:59887)
0810 15:26:05.307130 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0810 15:26:05.307142 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 15:26:05.307213 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:26:05.307386 (+ 173us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:26:05.307387 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:26:05.307622 (+ 235us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:26:05.307673 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:05.307676 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:05.308375 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:05.308376 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:05.308905 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:05.308907 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:05.309290 (+ 383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:05.309292 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:05.309360 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:05.309838 (+ 478us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:26:05.309843 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:26:05.312120 (+ 2277us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.68.190:46345: Server oryx/127.18.68.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":109,"threads_started":1}
W20260810 15:26:05.312251 2462 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 15:26:05.307114 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.131:59887 (local address 127.18.68.190:46345)
0810 15:26:05.307177 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0810 15:26:05.307180 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 15:26:05.307193 (+ 13us) server_negotiation.cc:407] Connection header received
0810 15:26:05.307292 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:26:05.307297 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:26:05.307309 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:26:05.307379 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:26:05.307770 (+ 391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:05.308272 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:05.308998 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:05.309206 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:05.309288 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:05.312204 (+ 2916us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.68.131:59887: BlockingRecv error: recv got EOF from 127.18.68.131:59887 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
Aug 10 15:26:06 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.129@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 15:26:06 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.129@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 15:26:06.033785 2466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:26:06.021093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46345 (local address 127.18.68.129:42973)
0810 15:26:06.021316 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0810 15:26:06.021331 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 15:26:06.021408 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:26:06.021619 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:26:06.021621 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:26:06.021821 (+ 200us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:26:06.021874 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:06.021876 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:06.022707 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:06.022708 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:06.023258 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:06.023260 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:06.023651 (+ 391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:06.023651 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:06.023703 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:06.031731 (+ 8028us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:26:06.031737 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:26:06.033712 (+ 1975us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.68.190:46345: Server oryx/127.18.68.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":114,"threads_started":1}
W20260810 15:26:06.033918 2467 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 15:26:06.021194 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.129:42973 (local address 127.18.68.190:46345)
0810 15:26:06.021397 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0810 15:26:06.021399 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:26:06.021411 (+ 12us) server_negotiation.cc:407] Connection header received
0810 15:26:06.021459 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:26:06.021460 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:26:06.021470 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:26:06.021538 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:26:06.021985 (+ 447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:06.022627 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:06.023349 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:06.023555 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:06.023617 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:06.033827 (+ 10210us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.68.129:42973: BlockingRecv error: recv got EOF from 127.18.68.129:42973 (error 108)
Metrics: {"server-negotiator.queue_time_us":177,"thread_start_us":112,"threads_started":1}
Aug 10 15:26:06 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.130@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 15:26:06 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.130@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 15:26:06.173955 2472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:26:06.169032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46345 (local address 127.18.68.130:45461)
0810 15:26:06.169213 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0810 15:26:06.169225 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 15:26:06.169289 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:26:06.169432 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:26:06.169433 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:26:06.169606 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:26:06.169660 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:06.169662 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:06.170504 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:06.170506 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:06.171088 (+ 582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:06.171090 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:06.171430 (+ 340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:06.171431 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:06.171472 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:06.172034 (+ 562us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:26:06.172046 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:26:06.173886 (+ 1840us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.68.190:46345: Server oryx/127.18.68.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":115,"threads_started":1}
W20260810 15:26:06.174114 2467 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 15:26:06.169123 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.130:45461 (local address 127.18.68.190:46345)
0810 15:26:06.169228 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0810 15:26:06.169229 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 15:26:06.169289 (+ 60us) server_negotiation.cc:407] Connection header received
0810 15:26:06.169337 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:26:06.169338 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:26:06.169348 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:26:06.169414 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:26:06.169735 (+ 321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:06.170399 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:06.171168 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:06.171360 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:06.171418 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:06.173985 (+ 2567us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.68.130:45461: BlockingRecv error: recv got EOF from 127.18.68.130:45461 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Aug 10 15:26:06 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.131@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 15:26:06 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.131@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 15:26:06.318024 2473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:26:06.312792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46345 (local address 127.18.68.131:33043)
0810 15:26:06.312961 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0810 15:26:06.312974 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 15:26:06.313036 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:26:06.313267 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:26:06.313268 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:26:06.313526 (+ 258us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:26:06.313593 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:06.313596 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:06.314372 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:06.314374 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:06.314912 (+ 538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:06.314914 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:06.315304 (+ 390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:06.315305 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:06.315346 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:06.315849 (+ 503us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:26:06.315854 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:26:06.317926 (+ 2072us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.68.190:46345: Server oryx/127.18.68.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":114,"threads_started":1}
W20260810 15:26:06.318147 2467 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 15:26:06.312884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.131:33043 (local address 127.18.68.190:46345)
0810 15:26:06.313010 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0810 15:26:06.313012 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:26:06.313027 (+ 15us) server_negotiation.cc:407] Connection header received
0810 15:26:06.313118 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:26:06.313119 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:26:06.313132 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:26:06.313229 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:26:06.313690 (+ 461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:06.314301 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:06.315014 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:06.315227 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:06.315299 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:06.318037 (+ 2738us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.68.131:33043: BlockingRecv error: recv got EOF from 127.18.68.131:33043 (error 108)
Metrics: {"server-negotiator.queue_time_us":98}
Aug 10 15:26:07 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.129@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 15:26:07 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.129@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 15:26:07.043673 2474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:26:07.034361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46345 (local address 127.18.68.129:35283)
0810 15:26:07.034551 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0810 15:26:07.034563 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 15:26:07.034634 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:26:07.034789 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:26:07.034790 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:26:07.034961 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:26:07.035011 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:07.035012 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:07.035786 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:07.035787 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:07.036322 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:07.036323 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:07.036681 (+ 358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:07.036682 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:07.036722 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:07.041407 (+ 4685us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:26:07.041413 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:26:07.043572 (+ 2159us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.68.190:46345: Server oryx/127.18.68.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":109,"threads_started":1}
W20260810 15:26:07.043776 2476 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 15:26:07.034464 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.129:35283 (local address 127.18.68.190:46345)
0810 15:26:07.034581 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0810 15:26:07.034583 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:26:07.034619 (+ 36us) server_negotiation.cc:407] Connection header received
0810 15:26:07.034695 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:26:07.034695 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:26:07.034706 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:26:07.034767 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:26:07.035115 (+ 348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:07.035707 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:07.036403 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:07.036613 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:07.036669 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:07.043702 (+ 7033us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.68.129:35283: BlockingRecv error: recv got EOF from 127.18.68.129:35283 (error 108)
Metrics: {"server-negotiator.queue_time_us":92,"thread_start_us":55,"threads_started":1}
Aug 10 15:26:07 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.130@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 15:26:07 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.130@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 15:26:07.179519 2478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:26:07.174483 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46345 (local address 127.18.68.130:51833)
0810 15:26:07.174606 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0810 15:26:07.174619 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 15:26:07.174693 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:26:07.174837 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:26:07.174838 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:26:07.175007 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:26:07.175079 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:07.175081 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:07.175869 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:07.175870 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:07.176425 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:07.176427 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:07.176840 (+ 413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:07.176840 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:07.176887 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:07.177429 (+ 542us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:26:07.177434 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:26:07.179457 (+ 2023us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.68.190:46345: Server oryx/127.18.68.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":62,"threads_started":1}
W20260810 15:26:07.179764 2476 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 15:26:07.174544 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.130:51833 (local address 127.18.68.190:46345)
0810 15:26:07.174681 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0810 15:26:07.174683 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:26:07.174693 (+ 10us) server_negotiation.cc:407] Connection header received
0810 15:26:07.174752 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:26:07.174753 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:26:07.174764 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:26:07.174820 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:26:07.175158 (+ 338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:07.175786 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:07.176523 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:07.176763 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:07.176828 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:07.179575 (+ 2747us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.68.130:51833: BlockingRecv error: recv got EOF from 127.18.68.130:51833 (error 108)
Metrics: {"server-negotiator.queue_time_us":107}
Aug 10 15:26:07 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.131@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 15:26:07 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.131@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 15:26:07.323593 2479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:26:07.318640 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46345 (local address 127.18.68.131:42813)
0810 15:26:07.318790 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0810 15:26:07.318802 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 15:26:07.318885 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:26:07.319100 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:26:07.319102 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:26:07.319293 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:26:07.319375 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:07.319378 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:07.320189 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:07.320190 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:07.320757 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:07.320759 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:07.321105 (+ 346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:07.321106 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:07.321146 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:07.321713 (+ 567us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:26:07.321718 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:26:07.323532 (+ 1814us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.68.190:46345: Server oryx/127.18.68.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":94,"threads_started":1}
W20260810 15:26:07.323779 2476 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 15:26:07.318728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.131:42813 (local address 127.18.68.190:46345)
0810 15:26:07.318799 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0810 15:26:07.318801 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:26:07.318878 (+ 77us) server_negotiation.cc:407] Connection header received
0810 15:26:07.318932 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:26:07.318933 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:26:07.318946 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:26:07.319007 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:26:07.319526 (+ 519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:07.320077 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:07.320836 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:07.321033 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:07.321091 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:07.323710 (+ 2619us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.68.131:42813: BlockingRecv error: recv got EOF from 127.18.68.131:42813 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
Aug 10 15:26:08 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.129@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 15:26:08 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.129@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 15:26:08.049410 2480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:26:08.044186 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46345 (local address 127.18.68.129:59039)
0810 15:26:08.044368 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0810 15:26:08.044383 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 15:26:08.044473 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:26:08.044642 (+ 169us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:26:08.044643 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:26:08.044831 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:26:08.044883 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:08.044885 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:08.045568 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:08.045569 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:08.046213 (+ 644us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:08.046215 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:08.046630 (+ 415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:08.046631 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:08.046698 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:08.047509 (+ 811us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:26:08.047516 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:26:08.049347 (+ 1831us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.68.190:46345: Server oryx/127.18.68.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":77,"threads_started":1}
W20260810 15:26:08.049567 2481 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 15:26:08.044319 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.129:59039 (local address 127.18.68.190:46345)
0810 15:26:08.044489 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0810 15:26:08.044491 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:26:08.044513 (+ 22us) server_negotiation.cc:407] Connection header received
0810 15:26:08.044543 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:26:08.044544 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:26:08.044556 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:26:08.044623 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:26:08.044963 (+ 340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:08.045476 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:08.046317 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:08.046525 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:08.046590 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:08.049473 (+ 2883us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.68.129:59039: BlockingRecv error: recv got EOF from 127.18.68.129:59039 (error 108)
Metrics: {"server-negotiator.queue_time_us":144,"thread_start_us":88,"threads_started":1}
Aug 10 15:26:08 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.130@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 15:26:08 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.130@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 15:26:08.185052 2483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:26:08.180178 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46345 (local address 127.18.68.130:53911)
0810 15:26:08.180337 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0810 15:26:08.180353 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 15:26:08.180404 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:26:08.180572 (+ 168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:26:08.180573 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:26:08.180750 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:26:08.180803 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:08.180805 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:08.181497 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:08.181498 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:08.182176 (+ 678us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:08.182178 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:08.182563 (+ 385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:08.182565 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:08.182616 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:08.183121 (+ 505us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:26:08.183126 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:26:08.184986 (+ 1860us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.68.190:46345: Server oryx/127.18.68.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":98,"threads_started":1}
W20260810 15:26:08.185209 2481 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 15:26:08.180324 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.130:53911 (local address 127.18.68.190:46345)
0810 15:26:08.180398 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0810 15:26:08.180400 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:26:08.180410 (+ 10us) server_negotiation.cc:407] Connection header received
0810 15:26:08.180451 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:26:08.180451 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:26:08.180462 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:26:08.180517 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:26:08.180877 (+ 360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:08.181398 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:08.182262 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:08.182455 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:08.182512 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:08.185108 (+ 2596us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.68.130:53911: BlockingRecv error: recv got EOF from 127.18.68.130:53911 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Aug 10 15:26:08 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.131@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 15:26:08 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.131@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 15:26:08.329213 2484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:26:08.324164 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46345 (local address 127.18.68.131:53473)
0810 15:26:08.324330 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0810 15:26:08.324341 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 15:26:08.324396 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:26:08.324608 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:26:08.324609 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:26:08.324783 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:26:08.324834 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:08.324836 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:08.325535 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:08.325536 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:08.326165 (+ 629us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:08.326168 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:08.326564 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:08.326565 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:08.326621 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:08.327126 (+ 505us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:26:08.327130 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:26:08.329108 (+ 1978us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.68.190:46345: Server oryx/127.18.68.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":99,"threads_started":1}
W20260810 15:26:08.329329 2481 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 15:26:08.324326 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.131:53473 (local address 127.18.68.190:46345)
0810 15:26:08.324397 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0810 15:26:08.324398 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 15:26:08.324434 (+ 36us) server_negotiation.cc:407] Connection header received
0810 15:26:08.324457 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:26:08.324458 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:26:08.324470 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:26:08.324526 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:26:08.324932 (+ 406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:08.325436 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:08.326268 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:08.326482 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:08.326551 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:08.329229 (+ 2678us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.68.131:53473: BlockingRecv error: recv got EOF from 127.18.68.131:53473 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
Aug 10 15:26:09 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.129@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 15:26:09 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.129@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 15:26:09.056110 2486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:26:09.049976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46345 (local address 127.18.68.129:42555)
0810 15:26:09.050134 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0810 15:26:09.050146 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 15:26:09.050203 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:26:09.050382 (+ 179us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:26:09.050383 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:26:09.050598 (+ 215us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:26:09.050685 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:09.050688 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:09.051626 (+ 938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:09.051627 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:09.052511 (+ 884us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:09.052515 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:09.053082 (+ 567us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:09.053084 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:09.053205 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:09.053918 (+ 713us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:26:09.053923 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:26:09.056007 (+ 2084us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.68.190:46345: Server oryx/127.18.68.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":101,"threads_started":1}
W20260810 15:26:09.056185 2488 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 15:26:09.050047 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.129:42555 (local address 127.18.68.190:46345)
0810 15:26:09.050234 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0810 15:26:09.050236 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:26:09.050245 (+ 9us) server_negotiation.cc:407] Connection header received
0810 15:26:09.050267 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:26:09.050268 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:26:09.050278 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:26:09.050347 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:26:09.050789 (+ 442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:09.051533 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:09.052609 (+ 1076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:09.052922 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:09.053004 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:09.056101 (+ 3097us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.68.129:42555: BlockingRecv error: recv got EOF from 127.18.68.129:42555 (error 108)
Metrics: {"server-negotiator.queue_time_us":167,"thread_start_us":112,"threads_started":1}
Aug 10 15:26:09 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.130@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 15:26:09 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.130@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 15:26:09.190658 2489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:26:09.185574 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46345 (local address 127.18.68.130:41497)
0810 15:26:09.185772 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0810 15:26:09.185785 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 15:26:09.185884 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:26:09.186105 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:26:09.186106 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:26:09.186294 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:26:09.186344 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:09.186345 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:09.187025 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:09.187026 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:09.187593 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:09.187595 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:09.187992 (+ 397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:09.187993 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:09.188060 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:09.188523 (+ 463us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:26:09.188528 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:26:09.190592 (+ 2064us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.68.190:46345: Server oryx/127.18.68.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":112,"threads_started":1}
W20260810 15:26:09.190829 2488 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 15:26:09.185689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.130:41497 (local address 127.18.68.190:46345)
0810 15:26:09.185770 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0810 15:26:09.185772 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:26:09.185863 (+ 91us) server_negotiation.cc:407] Connection header received
0810 15:26:09.185966 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:26:09.185968 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:26:09.185981 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:26:09.186050 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:26:09.186427 (+ 377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:09.186936 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:09.187703 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:09.187905 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:09.187992 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:09.190744 (+ 2752us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.68.130:41497: BlockingRecv error: recv got EOF from 127.18.68.130:41497 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Aug 10 15:26:09 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.131@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 15:26:09 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.131@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 15:26:09.334957 2490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:26:09.329793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46345 (local address 127.18.68.131:36103)
0810 15:26:09.329968 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0810 15:26:09.329981 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 15:26:09.330075 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:26:09.330258 (+ 183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:26:09.330258 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:26:09.330430 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:26:09.330479 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:09.330481 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:09.331185 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:09.331186 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:09.331735 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:09.331736 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:09.332099 (+ 363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:09.332100 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:09.332157 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:09.332640 (+ 483us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:26:09.332646 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:26:09.334898 (+ 2252us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.68.190:46345: Server oryx/127.18.68.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":113,"threads_started":1}
W20260810 15:26:09.335108 2488 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 15:26:09.329917 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.131:36103 (local address 127.18.68.190:46345)
0810 15:26:09.329990 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0810 15:26:09.329992 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:26:09.330101 (+ 109us) server_negotiation.cc:407] Connection header received
0810 15:26:09.330136 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:26:09.330137 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:26:09.330156 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:26:09.330235 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:26:09.330593 (+ 358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:09.331105 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:09.331829 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:09.332021 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:09.332083 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:09.335007 (+ 2924us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.68.131:36103: BlockingRecv error: recv got EOF from 127.18.68.131:36103 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
Aug 10 15:26:10 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.129@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 15:26:10 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.129@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 15:26:10.064693 2493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:26:10.056828 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46345 (local address 127.18.68.129:39297)
0810 15:26:10.058759 (+ 1931us) negotiation.cc:107] Waiting for socket to connect
0810 15:26:10.058777 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 15:26:10.058856 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:26:10.059146 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:26:10.059147 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:26:10.059321 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:26:10.059374 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:10.059376 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:10.060449 (+ 1073us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:10.060450 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:10.061255 (+ 805us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:10.061259 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:10.061762 (+ 503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:10.061764 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:10.061837 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:10.062404 (+ 567us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:26:10.062410 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:26:10.064592 (+ 2182us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.68.190:46345: Server oryx/127.18.68.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":1907,"thread_start_us":1869,"threads_started":1}
W20260810 15:26:10.064734 2495 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 15:26:10.058854 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.129:39297 (local address 127.18.68.190:46345)
0810 15:26:10.058997 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0810 15:26:10.058999 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:26:10.059009 (+ 10us) server_negotiation.cc:407] Connection header received
0810 15:26:10.059035 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:26:10.059036 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:26:10.059049 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:26:10.059129 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:26:10.059469 (+ 340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:10.060350 (+ 881us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:10.061352 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:10.061657 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:10.061730 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:10.064668 (+ 2938us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.68.129:39297: BlockingRecv error: recv got EOF from 127.18.68.129:39297 (error 108)
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":68,"threads_started":1}
Aug 10 15:26:10 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.130@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 15:26:10 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.130@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 15:26:10.195978 2496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:26:10.191130 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46345 (local address 127.18.68.130:54699)
0810 15:26:10.191281 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0810 15:26:10.191293 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 15:26:10.191359 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:26:10.191489 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:26:10.191490 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:26:10.191665 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:26:10.191716 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:10.191717 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:10.192395 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:10.192396 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:10.193109 (+ 713us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:10.193113 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:10.193619 (+ 506us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:10.193619 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:10.193669 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:10.194136 (+ 467us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:26:10.194141 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:26:10.195918 (+ 1777us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.68.190:46345: Server oryx/127.18.68.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":92,"threads_started":1}
W20260810 15:26:10.196102 2495 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 15:26:10.191224 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.130:54699 (local address 127.18.68.190:46345)
0810 15:26:10.191295 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0810 15:26:10.191296 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 15:26:10.191359 (+ 63us) server_negotiation.cc:407] Connection header received
0810 15:26:10.191405 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:26:10.191406 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:26:10.191415 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:26:10.191470 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:26:10.191813 (+ 343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:10.192324 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:10.193206 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:10.193547 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:10.193607 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:10.196018 (+ 2411us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.68.130:54699: BlockingRecv error: recv got EOF from 127.18.68.130:54699 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
Aug 10 15:26:10 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.131@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 15:26:10 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.131@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 15:26:10.340467 2497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:26:10.335510 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46345 (local address 127.18.68.131:36975)
0810 15:26:10.335692 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0810 15:26:10.335701 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 15:26:10.335794 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:26:10.335932 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:26:10.335933 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:26:10.336131 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:26:10.336180 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:10.336182 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:10.336872 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:10.336874 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:10.337414 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:10.337416 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:10.337800 (+ 384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:10.337801 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:10.337862 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:10.338396 (+ 534us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:26:10.338401 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:26:10.340369 (+ 1968us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.68.190:46345: Server oryx/127.18.68.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":92,"threads_started":1}
W20260810 15:26:10.340516 2495 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 15:26:10.335569 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.131:36975 (local address 127.18.68.190:46345)
0810 15:26:10.335643 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0810 15:26:10.335645 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:26:10.335774 (+ 129us) server_negotiation.cc:407] Connection header received
0810 15:26:10.335862 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:26:10.335863 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:26:10.335876 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:26:10.335928 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:26:10.336266 (+ 338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:10.336779 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:10.337510 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:10.337719 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:10.337799 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:10.340450 (+ 2651us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.68.131:36975: BlockingRecv error: recv got EOF from 127.18.68.131:36975 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
Aug 10 15:26:11 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.129@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 15:26:11 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.129@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 15:26:11.075157 2499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:26:11.065320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46345 (local address 127.18.68.129:43147)
0810 15:26:11.065459 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0810 15:26:11.065471 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 15:26:11.065546 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:26:11.065731 (+ 185us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:26:11.065732 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:26:11.065899 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:26:11.065951 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:11.065952 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:11.066709 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:11.066710 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:11.067271 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:11.067274 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:11.067890 (+ 616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:11.067891 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:11.067952 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:11.072725 (+ 4773us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:26:11.072731 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:26:11.075049 (+ 2318us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.68.190:46345: Server oryx/127.18.68.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":88,"threads_started":1}
W20260810 15:26:11.075309 2504 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 15:26:11.065459 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.129:43147 (local address 127.18.68.190:46345)
0810 15:26:11.065594 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0810 15:26:11.065597 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 15:26:11.065612 (+ 15us) server_negotiation.cc:407] Connection header received
0810 15:26:11.065635 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:26:11.065636 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:26:11.065645 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:26:11.065714 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:26:11.066053 (+ 339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:11.066632 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:11.067442 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:11.067784 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:11.067872 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:11.075224 (+ 7352us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.68.129:43147: BlockingRecv error: recv got EOF from 127.18.68.129:43147 (error 108)
Metrics: {"server-negotiator.queue_time_us":113,"thread_start_us":90,"threads_started":1}
Aug 10 15:26:11 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.130@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 15:26:11 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.130@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 15:26:11.201550 2505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:26:11.196531 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46345 (local address 127.18.68.130:35323)
0810 15:26:11.196742 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0810 15:26:11.196753 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 15:26:11.196819 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:26:11.196950 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:26:11.196951 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:26:11.197122 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:26:11.197175 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:11.197176 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:11.198033 (+ 857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:11.198034 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:11.198655 (+ 621us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:11.198658 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:11.199038 (+ 380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:11.199039 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:11.199100 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:11.199645 (+ 545us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:26:11.199651 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:26:11.201450 (+ 1799us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.68.190:46345: Server oryx/127.18.68.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":136,"threads_started":1}
W20260810 15:26:11.201601 2504 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 15:26:11.196589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.130:35323 (local address 127.18.68.190:46345)
0810 15:26:11.196660 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0810 15:26:11.196663 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 15:26:11.196822 (+ 159us) server_negotiation.cc:407] Connection header received
0810 15:26:11.196873 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:26:11.196874 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:26:11.196887 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:26:11.196929 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:26:11.197240 (+ 311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:11.197945 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:11.198752 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:11.198953 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:11.199035 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:11.201536 (+ 2501us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.68.130:35323: BlockingRecv error: recv got EOF from 127.18.68.130:35323 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Aug 10 15:26:11 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.131@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 15:26:11 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.131@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 15:26:11.346377 2506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:26:11.341009 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46345 (local address 127.18.68.131:34001)
0810 15:26:11.341155 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0810 15:26:11.341168 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 15:26:11.341276 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:26:11.341480 (+ 204us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:26:11.341481 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:26:11.341713 (+ 232us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:26:11.341763 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:11.341765 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:11.342553 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:11.342555 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:11.343455 (+ 900us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:11.343458 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:11.343819 (+ 361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:11.343820 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:11.343874 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:11.344404 (+ 530us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:26:11.344410 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:26:11.346277 (+ 1867us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.68.190:46345: Server oryx/127.18.68.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":88,"threads_started":1}
W20260810 15:26:11.346422 2504 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 15:26:11.341087 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.131:34001 (local address 127.18.68.190:46345)
0810 15:26:11.341159 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0810 15:26:11.341161 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:26:11.341252 (+ 91us) server_negotiation.cc:407] Connection header received
0810 15:26:11.341354 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:26:11.341355 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:26:11.341377 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:26:11.341444 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:26:11.341854 (+ 410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:11.342455 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:11.343543 (+ 1088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:11.343741 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:11.343820 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:11.346358 (+ 2538us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.68.131:34001: BlockingRecv error: recv got EOF from 127.18.68.131:34001 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
Aug 10 15:26:12 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.129@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 15:26:12 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.129@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 15:26:12.081333 2507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:26:12.075873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46345 (local address 127.18.68.129:60329)
0810 15:26:12.076026 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0810 15:26:12.076043 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 15:26:12.076103 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:26:12.076339 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:26:12.076340 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:26:12.076577 (+ 237us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:26:12.076645 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:12.076647 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:12.077364 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:12.077366 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:12.077909 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:12.077912 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:12.078407 (+ 495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:12.078408 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:12.078466 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:12.078979 (+ 513us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:26:12.078985 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:26:12.081267 (+ 2282us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.68.190:46345: Server oryx/127.18.68.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":80,"threads_started":1}
W20260810 15:26:12.081537 2508 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 15:26:12.075943 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.129:60329 (local address 127.18.68.190:46345)
0810 15:26:12.076080 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0810 15:26:12.076083 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 15:26:12.076098 (+ 15us) server_negotiation.cc:407] Connection header received
0810 15:26:12.076214 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:26:12.076215 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:26:12.076226 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:26:12.076311 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:26:12.076732 (+ 421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:12.077267 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:12.078043 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:12.078295 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:12.078384 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:12.081449 (+ 3065us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.68.129:60329: BlockingRecv error: recv got EOF from 127.18.68.129:60329 (error 108)
Metrics: {"server-negotiator.queue_time_us":113,"thread_start_us":77,"threads_started":1}
Aug 10 15:26:12 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.130@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 15:26:12 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.130@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 15:26:12.206732 2513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:26:12.202105 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46345 (local address 127.18.68.130:42119)
0810 15:26:12.202283 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0810 15:26:12.202301 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 15:26:12.202363 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:26:12.202498 (+ 135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:26:12.202498 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:26:12.202680 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:26:12.202733 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:12.202734 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:12.203365 (+ 631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:12.203366 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:12.203892 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:12.203894 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:12.204228 (+ 334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:12.204229 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:12.204278 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:12.204764 (+ 486us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:26:12.204768 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:26:12.206667 (+ 1899us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.68.190:46345: Server oryx/127.18.68.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":117,"threads_started":1}
W20260810 15:26:12.206869 2508 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 15:26:12.202193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.130:42119 (local address 127.18.68.190:46345)
0810 15:26:12.202247 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0810 15:26:12.202249 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:26:12.202368 (+ 119us) server_negotiation.cc:407] Connection header received
0810 15:26:12.202408 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:26:12.202409 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:26:12.202419 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:26:12.202477 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:26:12.202804 (+ 327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:12.203290 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:12.203967 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:12.204148 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:12.204198 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:12.206789 (+ 2591us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.68.130:42119: BlockingRecv error: recv got EOF from 127.18.68.130:42119 (error 108)
Metrics: {"server-negotiator.queue_time_us":27}
Aug 10 15:26:12 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.131@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 15:26:12 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.131@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 15:26:12.352442 2514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:26:12.346932 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46345 (local address 127.18.68.131:35605)
0810 15:26:12.347072 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0810 15:26:12.347091 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0810 15:26:12.347162 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:26:12.347330 (+ 168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:26:12.347331 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:26:12.347505 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:26:12.347556 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:12.347558 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:12.348286 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:12.348288 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:12.349327 (+ 1039us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:12.349331 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:12.349717 (+ 386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:12.349718 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:12.349779 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:12.350380 (+ 601us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:26:12.350386 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:26:12.352326 (+ 1940us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.68.190:46345: Server oryx/127.18.68.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":61,"threads_started":1}
W20260810 15:26:12.352485 2508 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 15:26:12.347023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.131:35605 (local address 127.18.68.190:46345)
0810 15:26:12.347125 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0810 15:26:12.347134 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 15:26:12.347147 (+ 13us) server_negotiation.cc:407] Connection header received
0810 15:26:12.347237 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:26:12.347238 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:26:12.347250 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:26:12.347307 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:26:12.347631 (+ 324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:12.348205 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:12.349437 (+ 1232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:12.349636 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:12.349716 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:12.352418 (+ 2702us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.68.131:35605: BlockingRecv error: recv got EOF from 127.18.68.131:35605 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
Aug 10 15:26:13 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.129@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 15:26:13 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.129@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 15:26:13.087045 2516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:26:13.081915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46345 (local address 127.18.68.129:32893)
0810 15:26:13.082154 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0810 15:26:13.082167 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 15:26:13.082229 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:26:13.082399 (+ 170us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:26:13.082400 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:26:13.082575 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:26:13.082627 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:13.082629 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:13.083313 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:13.083314 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:13.083922 (+ 608us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:13.083923 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:13.084300 (+ 377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:13.084301 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:13.084345 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:13.084865 (+ 520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:26:13.084869 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:26:13.086985 (+ 2116us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.68.190:46345: Server oryx/127.18.68.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":89,"threads_started":1}
W20260810 15:26:13.087191 2517 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 15:26:13.082026 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.129:32893 (local address 127.18.68.190:46345)
0810 15:26:13.082202 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0810 15:26:13.082205 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 15:26:13.082214 (+ 9us) server_negotiation.cc:407] Connection header received
0810 15:26:13.082290 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:26:13.082290 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:26:13.082300 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:26:13.082351 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:26:13.082714 (+ 363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:13.083233 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:13.084011 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:13.084216 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:13.084281 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:13.087092 (+ 2811us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.68.129:32893: BlockingRecv error: recv got EOF from 127.18.68.129:32893 (error 108)
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":115,"threads_started":1}
Aug 10 15:26:13 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.130@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 15:26:13 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.130@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 15:26:13.212528 2518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:26:13.207241 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46345 (local address 127.18.68.130:44571)
0810 15:26:13.207435 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0810 15:26:13.207447 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 15:26:13.207540 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:26:13.207731 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:26:13.207731 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:26:13.207992 (+ 261us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:26:13.208053 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:13.208056 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:13.208781 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:13.208783 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:13.209314 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:13.209315 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:13.209724 (+ 409us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:13.209725 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:13.209787 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:13.210287 (+ 500us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:26:13.210292 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:26:13.212417 (+ 2125us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.68.190:46345: Server oryx/127.18.68.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":89,"threads_started":1}
W20260810 15:26:13.212567 2517 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 15:26:13.207341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.130:44571 (local address 127.18.68.190:46345)
0810 15:26:13.207424 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0810 15:26:13.207427 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 15:26:13.207518 (+ 91us) server_negotiation.cc:407] Connection header received
0810 15:26:13.207612 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:26:13.207613 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:26:13.207626 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:26:13.207679 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:26:13.208169 (+ 490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:13.208689 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:13.209405 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:13.209641 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:13.209726 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:13.212498 (+ 2772us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.68.130:44571: BlockingRecv error: recv got EOF from 127.18.68.130:44571 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Aug 10 15:26:13 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.131@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 15:26:13 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.131@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 15:26:13.357771 2519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:26:13.352942 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46345 (local address 127.18.68.131:49663)
0810 15:26:13.353142 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0810 15:26:13.353155 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 15:26:13.353233 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:26:13.353385 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:26:13.353386 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:26:13.353622 (+ 236us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:26:13.353689 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:13.353692 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:13.354491 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:13.354492 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:13.355017 (+ 525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:13.355019 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:13.355360 (+ 341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:13.355361 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:13.355404 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:13.355851 (+ 447us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:26:13.355856 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:26:13.357708 (+ 1852us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.68.190:46345: Server oryx/127.18.68.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":126,"threads_started":1}
W20260810 15:26:13.357869 2517 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 15:26:13.353067 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.131:49663 (local address 127.18.68.190:46345)
0810 15:26:13.353133 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0810 15:26:13.353135 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:26:13.353233 (+ 98us) server_negotiation.cc:407] Connection header received
0810 15:26:13.353282 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:26:13.353283 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:26:13.353297 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:26:13.353375 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:26:13.353778 (+ 403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:13.354422 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:13.355100 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:13.355290 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:13.355347 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:13.357800 (+ 2453us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.68.131:49663: BlockingRecv error: recv got EOF from 127.18.68.131:49663 (error 108)
Metrics: {"server-negotiator.queue_time_us":33}
Aug 10 15:26:14 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.129@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 15:26:14 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.129@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 15:26:14.092549 2520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:26:14.087621 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46345 (local address 127.18.68.129:51797)
0810 15:26:14.087789 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0810 15:26:14.087804 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 15:26:14.087879 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:26:14.088113 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:26:14.088114 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:26:14.088299 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:26:14.088349 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:14.088350 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:14.089049 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:14.089050 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:14.089594 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:14.089595 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:14.089933 (+ 338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:14.089934 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:14.089981 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:14.090560 (+ 579us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:26:14.090565 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:26:14.092418 (+ 1853us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.68.190:46345: Server oryx/127.18.68.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":62,"threads_started":1}
W20260810 15:26:14.092564 2522 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 15:26:14.087762 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.129:51797 (local address 127.18.68.190:46345)
0810 15:26:14.087923 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0810 15:26:14.087925 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:26:14.087935 (+ 10us) server_negotiation.cc:407] Connection header received
0810 15:26:14.087962 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:26:14.087963 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:26:14.087973 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:26:14.088044 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:26:14.088440 (+ 396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:14.088976 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:14.089670 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:14.089861 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:14.089911 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:14.092511 (+ 2600us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.68.129:51797: BlockingRecv error: recv got EOF from 127.18.68.129:51797 (error 108)
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":74,"threads_started":1}
Aug 10 15:26:14 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.130@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 15:26:14 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.130@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 15:26:14.218036 2523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:26:14.213091 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46345 (local address 127.18.68.130:35719)
0810 15:26:14.213277 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0810 15:26:14.213288 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 15:26:14.213382 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:26:14.213537 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:26:14.213538 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:26:14.213738 (+ 200us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:26:14.213787 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:14.213788 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:14.214537 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:14.214538 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:14.215075 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:14.215076 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:14.215466 (+ 390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:14.215467 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:14.215533 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:14.216053 (+ 520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:26:14.216061 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:26:14.217929 (+ 1868us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.68.190:46345: Server oryx/127.18.68.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":114,"threads_started":1}
W20260810 15:26:14.218106 2522 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 15:26:14.213128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.130:35719 (local address 127.18.68.190:46345)
0810 15:26:14.213221 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0810 15:26:14.213223 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:26:14.213368 (+ 145us) server_negotiation.cc:407] Connection header received
0810 15:26:14.213444 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:26:14.213445 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:26:14.213457 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:26:14.213529 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:26:14.213874 (+ 345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:14.214450 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:14.215166 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:14.215374 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:14.215463 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:14.218013 (+ 2550us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.68.130:35719: BlockingRecv error: recv got EOF from 127.18.68.130:35719 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 10 15:26:14 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.131@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 15:26:14 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.131@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 15:26:14.363246 2524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:26:14.358462 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46345 (local address 127.18.68.131:49101)
0810 15:26:14.358649 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0810 15:26:14.358671 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0810 15:26:14.358733 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:26:14.358877 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:26:14.358877 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:26:14.359055 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:26:14.359106 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:14.359108 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:14.359810 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:14.359811 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:14.360337 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:14.360339 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:14.360741 (+ 402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:14.360742 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:14.360785 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:14.361321 (+ 536us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:26:14.361326 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:26:14.363175 (+ 1849us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.68.190:46345: Server oryx/127.18.68.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":122,"threads_started":1}
W20260810 15:26:14.363420 2522 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 15:26:14.358541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.131:49101 (local address 127.18.68.190:46345)
0810 15:26:14.358633 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0810 15:26:14.358635 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:26:14.358736 (+ 101us) server_negotiation.cc:407] Connection header received
0810 15:26:14.358797 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:26:14.358798 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:26:14.358811 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:26:14.358855 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:26:14.359208 (+ 353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:14.359731 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:14.360422 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:14.360669 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:14.360728 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:14.363323 (+ 2595us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.68.131:49101: BlockingRecv error: recv got EOF from 127.18.68.131:49101 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
Aug 10 15:26:15 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.129@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 15:26:15 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.129@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 15:26:15.097718 2525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:26:15.093064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46345 (local address 127.18.68.129:54899)
0810 15:26:15.093228 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0810 15:26:15.093237 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 15:26:15.093280 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:26:15.093463 (+ 183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:26:15.093465 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:26:15.093681 (+ 216us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:26:15.093731 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:15.093734 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:15.094410 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:15.094411 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:15.094966 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:15.094968 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:15.095315 (+ 347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:15.095316 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:15.095358 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:15.095837 (+ 479us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:26:15.095842 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:26:15.097657 (+ 1815us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.68.190:46345: Server oryx/127.18.68.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":99,"threads_started":1}
W20260810 15:26:15.097846 2526 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 15:26:15.093148 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.129:54899 (local address 127.18.68.190:46345)
0810 15:26:15.093295 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0810 15:26:15.093297 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:26:15.093306 (+ 9us) server_negotiation.cc:407] Connection header received
0810 15:26:15.093330 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:26:15.093330 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:26:15.093348 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:26:15.093412 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:26:15.093809 (+ 397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:15.094336 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:15.095045 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:15.095247 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:15.095297 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:15.097760 (+ 2463us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.68.129:54899: BlockingRecv error: recv got EOF from 127.18.68.129:54899 (error 108)
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":94,"threads_started":1}
Aug 10 15:26:15 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.130@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 15:26:15 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.130@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 15:26:15.223716 2527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:26:15.218568 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46345 (local address 127.18.68.130:55141)
0810 15:26:15.218777 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0810 15:26:15.218787 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 15:26:15.218882 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:26:15.219061 (+ 179us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:26:15.219062 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:26:15.219257 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:26:15.219307 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:15.219308 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:15.219997 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:15.219998 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:15.220639 (+ 641us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:15.220642 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:15.221070 (+ 428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:15.221071 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:15.221131 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:15.221568 (+ 437us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:26:15.221573 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:26:15.223615 (+ 2042us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.68.190:46345: Server oryx/127.18.68.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":131,"threads_started":1}
W20260810 15:26:15.223790 2526 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 15:26:15.218671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.130:55141 (local address 127.18.68.190:46345)
0810 15:26:15.218741 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0810 15:26:15.218744 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 15:26:15.218860 (+ 116us) server_negotiation.cc:407] Connection header received
0810 15:26:15.218952 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:26:15.218953 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:26:15.218966 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:26:15.219039 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:26:15.219388 (+ 349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:15.219907 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:15.220734 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:15.220984 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:15.221058 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:15.223725 (+ 2667us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.68.130:55141: BlockingRecv error: recv got EOF from 127.18.68.130:55141 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
Aug 10 15:26:15 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.131@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 15:26:15 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.131@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 15:26:15.368346 2530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:26:15.363724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46345 (local address 127.18.68.131:59125)
0810 15:26:15.363899 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0810 15:26:15.363910 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 15:26:15.363977 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:26:15.364097 (+ 120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:26:15.364097 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:26:15.364279 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:26:15.364337 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:15.364340 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:15.365031 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:15.365032 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:15.365584 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:15.365586 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:15.365940 (+ 354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:15.365941 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:15.365982 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:15.366510 (+ 528us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:26:15.366515 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:26:15.368277 (+ 1762us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.68.190:46345: Server oryx/127.18.68.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":85,"threads_started":1}
W20260810 15:26:15.368420 2526 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 15:26:15.363833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.131:59125 (local address 127.18.68.190:46345)
0810 15:26:15.363883 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0810 15:26:15.363885 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:26:15.363979 (+ 94us) server_negotiation.cc:407] Connection header received
0810 15:26:15.364036 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:26:15.364037 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:26:15.364049 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:26:15.364090 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:26:15.364402 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:15.364942 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:15.365687 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:15.365870 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:15.365925 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:15.368372 (+ 2447us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.68.131:59125: BlockingRecv error: recv got EOF from 127.18.68.131:59125 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
Aug 10 15:26:16 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.129@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 15:26:16 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.129@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 15:26:16.106598 2532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:26:16.098285 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46345 (local address 127.18.68.129:40319)
0810 15:26:16.098440 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0810 15:26:16.098450 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 15:26:16.098504 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:26:16.098654 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:26:16.098654 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:26:16.098830 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:26:16.098883 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:16.098884 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:16.099553 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:16.099554 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:16.100122 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:16.100125 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:16.100466 (+ 341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:16.100467 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:16.100510 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:16.104441 (+ 3931us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:26:16.104446 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:26:16.106539 (+ 2093us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.68.190:46345: Server oryx/127.18.68.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":74,"threads_started":1}
W20260810 15:26:16.106735 2533 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 15:26:16.098340 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.129:40319 (local address 127.18.68.190:46345)
0810 15:26:16.098489 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0810 15:26:16.098491 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:26:16.098500 (+ 9us) server_negotiation.cc:407] Connection header received
0810 15:26:16.098570 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:26:16.098571 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:26:16.098582 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:26:16.098642 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:26:16.098951 (+ 309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:16.099467 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:16.100212 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:16.100400 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:16.100452 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:16.106636 (+ 6184us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.68.129:40319: BlockingRecv error: recv got EOF from 127.18.68.129:40319 (error 108)
Metrics: {"server-negotiator.queue_time_us":120,"thread_start_us":85,"threads_started":1}
Aug 10 15:26:16 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.130@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 15:26:16 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.130@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 15:26:16.229490 2534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:26:16.224288 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46345 (local address 127.18.68.130:50139)
0810 15:26:16.224471 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0810 15:26:16.224487 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 15:26:16.224584 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:26:16.224730 (+ 146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:26:16.224731 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:26:16.224917 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:26:16.224969 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:16.224971 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:16.225684 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:16.225685 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:16.226363 (+ 678us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:16.226366 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:16.226853 (+ 487us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:16.226854 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:16.226927 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:16.227431 (+ 504us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:26:16.227436 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:26:16.229426 (+ 1990us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.68.190:46345: Server oryx/127.18.68.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":80,"threads_started":1}
W20260810 15:26:16.229606 2533 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 15:26:16.224456 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.130:50139 (local address 127.18.68.190:46345)
0810 15:26:16.224538 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0810 15:26:16.224540 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:26:16.224570 (+ 30us) server_negotiation.cc:407] Connection header received
0810 15:26:16.224642 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:26:16.224643 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:26:16.224653 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:26:16.224706 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:26:16.225040 (+ 334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:16.225587 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:16.226456 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:16.226764 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:16.226841 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:16.229535 (+ 2694us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.68.130:50139: BlockingRecv error: recv got EOF from 127.18.68.130:50139 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 10 15:26:16 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.131@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 15:26:16 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.131@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 15:26:16.374693 2535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:26:16.368895 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46345 (local address 127.18.68.131:50923)
0810 15:26:16.369116 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0810 15:26:16.369129 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 15:26:16.369233 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:26:16.369446 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:26:16.369447 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:26:16.369653 (+ 206us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:26:16.369712 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:16.369715 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:16.370481 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:16.370483 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:16.371172 (+ 689us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:16.371196 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:16.371731 (+ 535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:16.371732 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:16.371803 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:16.372464 (+ 661us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:26:16.372470 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:26:16.374588 (+ 2118us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.68.190:46345: Server oryx/127.18.68.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":110,"threads_started":1}
W20260810 15:26:16.374750 2533 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 15:26:16.369015 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.131:50923 (local address 127.18.68.190:46345)
0810 15:26:16.369109 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0810 15:26:16.369112 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 15:26:16.369210 (+ 98us) server_negotiation.cc:407] Connection header received
0810 15:26:16.369339 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:26:16.369340 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:26:16.369355 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:26:16.369439 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:26:16.369801 (+ 362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:16.370391 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:16.371305 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:16.371585 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:16.371635 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:16.374683 (+ 3048us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.68.131:50923: BlockingRecv error: recv got EOF from 127.18.68.131:50923 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
Aug 10 15:26:17 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.129@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 15:26:17 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.129@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 15:26:17.112097 2538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:26:17.107101 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46345 (local address 127.18.68.129:43559)
0810 15:26:17.107266 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0810 15:26:17.107277 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 15:26:17.107331 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:26:17.107484 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:26:17.107485 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:26:17.107669 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:26:17.107719 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:17.107721 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:17.108403 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:17.108404 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:17.108922 (+ 518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:17.108923 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:17.109395 (+ 472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:17.109396 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:17.109462 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:17.109974 (+ 512us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:26:17.109979 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:26:17.111995 (+ 2016us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.68.190:46345: Server oryx/127.18.68.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":99,"threads_started":1}
W20260810 15:26:17.112156 2540 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 15:26:17.107219 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.129:43559 (local address 127.18.68.190:46345)
0810 15:26:17.107356 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0810 15:26:17.107357 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 15:26:17.107381 (+ 24us) server_negotiation.cc:407] Connection header received
0810 15:26:17.107403 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:26:17.107404 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:26:17.107413 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:26:17.107465 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:26:17.107813 (+ 348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:17.108323 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:17.109045 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:17.109259 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:17.109394 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:17.112083 (+ 2689us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.68.129:43559: BlockingRecv error: recv got EOF from 127.18.68.129:43559 (error 108)
Metrics: {"server-negotiator.queue_time_us":116,"thread_start_us":64,"threads_started":1}
Aug 10 15:26:17 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.130@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 15:26:17 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.130@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 15:26:17.235034 2541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:26:17.230190 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46345 (local address 127.18.68.130:45413)
0810 15:26:17.230376 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0810 15:26:17.230389 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 15:26:17.230482 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:26:17.230665 (+ 183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:26:17.230666 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:26:17.230864 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:26:17.230919 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:17.230920 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:17.231658 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:17.231658 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:17.232188 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:17.232189 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:17.232557 (+ 368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:17.232558 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:17.232626 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:17.233110 (+ 484us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:26:17.233116 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:26:17.234933 (+ 1817us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.68.190:46345: Server oryx/127.18.68.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":88,"threads_started":1}
W20260810 15:26:17.235095 2540 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 15:26:17.230273 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.130:45413 (local address 127.18.68.190:46345)
0810 15:26:17.230358 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0810 15:26:17.230360 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:26:17.230469 (+ 109us) server_negotiation.cc:407] Connection header received
0810 15:26:17.230566 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:26:17.230568 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:26:17.230586 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:26:17.230656 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:26:17.231004 (+ 348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:17.231520 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:17.232291 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:17.232481 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:17.232558 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:17.235032 (+ 2474us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.68.130:45413: BlockingRecv error: recv got EOF from 127.18.68.130:45413 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
Aug 10 15:26:17 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.131@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 15:26:17 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.131@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 15:26:17.380867 2542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:26:17.375560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46345 (local address 127.18.68.131:47513)
0810 15:26:17.375750 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0810 15:26:17.375768 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 15:26:17.375834 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:26:17.375984 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:26:17.375985 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:26:17.376181 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:26:17.376232 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:17.376234 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:17.377223 (+ 989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:17.377224 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:17.377756 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:17.377758 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:17.378285 (+ 527us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:17.378286 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:17.378357 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:17.378940 (+ 583us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:26:17.378945 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:26:17.380765 (+ 1820us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.68.190:46345: Server oryx/127.18.68.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":122,"threads_started":1}
W20260810 15:26:17.380918 2540 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 15:26:17.375642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.131:47513 (local address 127.18.68.190:46345)
0810 15:26:17.375705 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0810 15:26:17.375707 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:26:17.375836 (+ 129us) server_negotiation.cc:407] Connection header received
0810 15:26:17.375884 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:26:17.375885 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:26:17.375899 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:26:17.375965 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:26:17.376321 (+ 356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:17.377140 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:17.377885 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:17.378175 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:17.378280 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:17.380851 (+ 2571us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.68.131:47513: BlockingRecv error: recv got EOF from 127.18.68.131:47513 (error 108)
Metrics: {"server-negotiator.queue_time_us":33}
Aug 10 15:26:18 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.129@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 15:26:18 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.129@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 15:26:18.117980 2543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:26:18.112693 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46345 (local address 127.18.68.129:44011)
0810 15:26:18.112968 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0810 15:26:18.112980 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 15:26:18.113041 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:26:18.113224 (+ 183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:26:18.113225 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:26:18.113409 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:26:18.113459 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:18.113460 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:18.114278 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:18.114279 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:18.114902 (+ 623us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:18.114904 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:18.115293 (+ 389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:18.115294 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:18.115343 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:18.115851 (+ 508us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:26:18.115857 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:26:18.117916 (+ 2059us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.68.190:46345: Server oryx/127.18.68.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":253,"thread_start_us":195,"threads_started":1}
W20260810 15:26:18.118173 2544 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 15:26:18.112908 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.129:44011 (local address 127.18.68.190:46345)
0810 15:26:18.113060 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0810 15:26:18.113063 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 15:26:18.113074 (+ 11us) server_negotiation.cc:407] Connection header received
0810 15:26:18.113107 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:26:18.113108 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:26:18.113118 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:26:18.113191 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:26:18.113560 (+ 369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:18.114188 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:18.115001 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:18.115209 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:18.115274 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:18.118027 (+ 2753us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.68.129:44011: BlockingRecv error: recv got EOF from 127.18.68.129:44011 (error 108)
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":95,"threads_started":1}
Aug 10 15:26:18 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.130@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
Aug 10 15:26:18 dist-test-slave-2p8l krb5kdc[587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.18.68.130@KRBTEST.COM for oryx/127.18.68.190@KRBTEST.COM, Server not found in Kerberos database
I20260810 15:26:18.241204 2545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:26:18.235733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46345 (local address 127.18.68.130:44669)
0810 15:26:18.235922 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0810 15:26:18.235934 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 15:26:18.236006 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:26:18.236235 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:26:18.236236 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:26:18.236438 (+ 202us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:26:18.236503 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:18.236505 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:18.237241 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:18.237242 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:18.237830 (+ 588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:18.237832 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:18.238391 (+ 559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:18.238392 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:18.238445 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:18.238950 (+ 505us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:26:18.238955 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:26:18.241128 (+ 2173us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.18.68.190:46345: Server oryx/127.18.68.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":79,"threads_started":1}
W20260810 15:26:18.241571 2544 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 15:26:18.235851 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.130:44669 (local address 127.18.68.190:46345)
0810 15:26:18.235941 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0810 15:26:18.235943 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:26:18.235991 (+ 48us) server_negotiation.cc:407] Connection header received
0810 15:26:18.236087 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:26:18.236088 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:26:18.236099 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:26:18.236184 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:26:18.236592 (+ 408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:18.237123 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:18.237925 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:18.238286 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:18.238366 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:18.241508 (+ 3142us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.18.68.130:44669: BlockingRecv error: recv got EOF from 127.18.68.130:44669 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
I20260810 15:26:18.296687 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 1662
I20260810 15:26:18.311528 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 1954
I20260810 15:26:18.327217 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 2197
I20260810 15:26:18.342187 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 1531
2026-08-10T15:26:18Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (17996 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-10T15:26:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T15:26:18Z Disabled control of system clock
I20260810 15:26:18.381515 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786375520124696-18706-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786375520124696-18706-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786375520124696-18706-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.190:46401
--webserver_interface=127.18.68.190
--webserver_port=0
--builtin_ntp_servers=127.18.68.148:46457
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.68.190:46401
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260810 15:26:18.464381 2552 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:26:18.464655 2552 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:26:18.464694 2552 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:26:18.465857 2552 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 15:26:18.465926 2552 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:26:18.465946 2552 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:26:18.465966 2552 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 15:26:18.465994 2552 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 15:26:18.467408 2552 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:46457
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786375520124696-18706-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786375520124696-18706-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.68.190:46401
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.190:46401
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.68.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2552
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786375520124696-18706-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:26:18.467695 2552 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:26:18.467996 2552 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:26:18.473071 2569 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:26:18.473099 2552 server_base.cc:1034] running on GCE node
W20260810 15:26:18.473203 2564 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:26:18.473071 2565 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:26:18.473471 2552 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:26:18.473798 2552 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:26:18.474975 2552 hybrid_clock.cc:648] HybridClock initialized: now 1786375578474956 us; error 33 us; skew 500 ppm
I20260810 15:26:18.476558 2552 webserver.cc:460] Webserver started at http://127.18.68.190:36853/ using document root <none> and password file <none>
I20260810 15:26:18.476827 2552 fs_manager.cc:359] Metadata directory not provided
I20260810 15:26:18.476878 2552 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:26:18.477072 2552 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:26:18.478845 2552 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786375520124696-18706-0/minicluster-data/master-0/data/instance:
uuid: "f52ee06fc823433cb221ed17b27d4a20"
format_stamp: "Formatted at 2026-08-10 15:26:18 on dist-test-slave-2p8l"
server_key: "7c86860ba0f96d409933ad368d600a87"
server_key_iv: "a71c087dee403c39994fa2bb1d951aed"
server_key_version: "encryptionkey@0"
I20260810 15:26:18.479270 2552 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786375520124696-18706-0/minicluster-data/master-0/wal/instance:
uuid: "f52ee06fc823433cb221ed17b27d4a20"
format_stamp: "Formatted at 2026-08-10 15:26:18 on dist-test-slave-2p8l"
server_key: "7c86860ba0f96d409933ad368d600a87"
server_key_iv: "a71c087dee403c39994fa2bb1d951aed"
server_key_version: "encryptionkey@0"
I20260810 15:26:18.480773 2552 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 15:26:18.481695 2578 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:26:18.481892 2552 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:26:18.481999 2552 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786375520124696-18706-0/minicluster-data/master-0/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786375520124696-18706-0/minicluster-data/master-0/wal
uuid: "f52ee06fc823433cb221ed17b27d4a20"
format_stamp: "Formatted at 2026-08-10 15:26:18 on dist-test-slave-2p8l"
server_key: "7c86860ba0f96d409933ad368d600a87"
server_key_iv: "a71c087dee403c39994fa2bb1d951aed"
server_key_version: "encryptionkey@0"
I20260810 15:26:18.482100 2552 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786375520124696-18706-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786375520124696-18706-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786375520124696-18706-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:26:18.499956 2552 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:26:18.500367 2552 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:26:18.500546 2552 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:26:18.505491 2552 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.190:46401
I20260810 15:26:18.505539 2666 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.190:46401 every 8 connection(s)
I20260810 15:26:18.505993 2552 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
I20260810 15:26:18.506829 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 2552
I20260810 15:26:18.506913 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786375520124696-18706-0/minicluster-data/master-0/wal/instance
I20260810 15:26:18.506897 2667 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:26:18.507198 18706 external_mini_cluster.cc:1428] Setting key 56acac218ad3476ab319871ca74a20ad
I20260810 15:26:18.511183 2667 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f52ee06fc823433cb221ed17b27d4a20: Bootstrap starting.
I20260810 15:26:18.511986 2667 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f52ee06fc823433cb221ed17b27d4a20: Neither blocks nor log segments found. Creating new log.
I20260810 15:26:18.512391 2667 log.cc:824] T 00000000000000000000000000000000 P f52ee06fc823433cb221ed17b27d4a20: Log is configured to *not* fsync() on all Append() calls
I20260810 15:26:18.513228 2667 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f52ee06fc823433cb221ed17b27d4a20: No bootstrap required, opened a new log
I20260810 15:26:18.513511 2672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:26:18.507835 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50598 (local address 127.18.68.190:46401)
0810 15:26:18.508036 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0810 15:26:18.508043 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 15:26:18.508078 (+ 35us) server_negotiation.cc:407] Connection header received
0810 15:26:18.508651 (+ 573us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:26:18.508659 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:26:18.508750 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:26:18.508873 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:26:18.509151 (+ 278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:18.510019 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:18.511304 (+ 1285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:18.511728 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:18.511820 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:18.512810 (+ 990us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:26:18.512820 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:26:18.512821 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 15:26:18.512990 (+ 169us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:26:18.513022 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 15:26:18.513033 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:26:18.513111 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0810 15:26:18.513199 (+ 88us) server_negotiation.cc:299] Negotiation successful
0810 15:26:18.513280 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":122,"thread_start_us":93,"threads_started":1}
I20260810 15:26:18.515527 2667 raft_consensus.cc:348] T 00000000000000000000000000000000 P f52ee06fc823433cb221ed17b27d4a20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f52ee06fc823433cb221ed17b27d4a20" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46401 } }
I20260810 15:26:18.515681 2667 raft_consensus.cc:374] T 00000000000000000000000000000000 P f52ee06fc823433cb221ed17b27d4a20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:26:18.515707 2667 raft_consensus.cc:729] T 00000000000000000000000000000000 P f52ee06fc823433cb221ed17b27d4a20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f52ee06fc823433cb221ed17b27d4a20, State: Initialized, Role: FOLLOWER
I20260810 15:26:18.515799 2667 consensus_queue.cc:260] T 00000000000000000000000000000000 P f52ee06fc823433cb221ed17b27d4a20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f52ee06fc823433cb221ed17b27d4a20" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46401 } }
I20260810 15:26:18.515864 2667 raft_consensus.cc:388] T 00000000000000000000000000000000 P f52ee06fc823433cb221ed17b27d4a20 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 15:26:18.515887 2667 raft_consensus.cc:482] T 00000000000000000000000000000000 P f52ee06fc823433cb221ed17b27d4a20 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 15:26:18.515923 2667 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f52ee06fc823433cb221ed17b27d4a20 [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:26:18.516481 2667 raft_consensus.cc:504] T 00000000000000000000000000000000 P f52ee06fc823433cb221ed17b27d4a20 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f52ee06fc823433cb221ed17b27d4a20" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46401 } }
I20260810 15:26:18.516575 2667 leader_election.cc:302] T 00000000000000000000000000000000 P f52ee06fc823433cb221ed17b27d4a20 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f52ee06fc823433cb221ed17b27d4a20; no voters:
I20260810 15:26:18.516711 2667 leader_election.cc:288] T 00000000000000000000000000000000 P f52ee06fc823433cb221ed17b27d4a20 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 15:26:18.516791 2674 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f52ee06fc823433cb221ed17b27d4a20 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 15:26:18.517012 2674 raft_consensus.cc:686] T 00000000000000000000000000000000 P f52ee06fc823433cb221ed17b27d4a20 [term 1 LEADER]: Becoming Leader. State: Replica: f52ee06fc823433cb221ed17b27d4a20, State: Running, Role: LEADER
I20260810 15:26:18.517098 2667 sys_catalog.cc:564] T 00000000000000000000000000000000 P f52ee06fc823433cb221ed17b27d4a20 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 15:26:18.517113 2674 consensus_queue.cc:237] T 00000000000000000000000000000000 P f52ee06fc823433cb221ed17b27d4a20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f52ee06fc823433cb221ed17b27d4a20" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46401 } }
I20260810 15:26:18.517598 2676 sys_catalog.cc:455] T 00000000000000000000000000000000 P f52ee06fc823433cb221ed17b27d4a20 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f52ee06fc823433cb221ed17b27d4a20. Latest consensus state: current_term: 1 leader_uuid: "f52ee06fc823433cb221ed17b27d4a20" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f52ee06fc823433cb221ed17b27d4a20" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46401 } } }
I20260810 15:26:18.517606 2675 sys_catalog.cc:455] T 00000000000000000000000000000000 P f52ee06fc823433cb221ed17b27d4a20 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f52ee06fc823433cb221ed17b27d4a20" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f52ee06fc823433cb221ed17b27d4a20" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46401 } } }
I20260810 15:26:18.517758 2676 sys_catalog.cc:458] T 00000000000000000000000000000000 P f52ee06fc823433cb221ed17b27d4a20 [sys.catalog]: This master's current role is: LEADER
I20260810 15:26:18.517768 2675 sys_catalog.cc:458] T 00000000000000000000000000000000 P f52ee06fc823433cb221ed17b27d4a20 [sys.catalog]: This master's current role is: LEADER
I20260810 15:26:18.518026 2694 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 15:26:18.518636 2694 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 15:26:18.520272 2694 catalog_manager.cc:1347] Generated new cluster ID: da0f0281c475484ea4238b66bbc99380
I20260810 15:26:18.520332 2694 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 15:26:18.534495 2694 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 15:26:18.535391 2694 catalog_manager.cc:1504] Loading token signing keys...
I20260810 15:26:18.540679 2694 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f52ee06fc823433cb221ed17b27d4a20: Generated new TSK 0
I20260810 15:26:18.540911 2694 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 15:26:18.544862 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786375520124696-18706-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786375520124696-18706-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786375520124696-18706-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786375520124696-18706-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.68.129:0
--local_ip_for_outbound_sockets=127.18.68.129
--webserver_interface=127.18.68.129
--webserver_port=0
--tserver_master_addrs=127.18.68.190:46401
--builtin_ntp_servers=127.18.68.148:46457
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260810 15:26:18.630767 2712 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:26:18.631058 2712 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:26:18.631134 2712 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:26:18.632365 2712 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:26:18.632436 2712 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:26:18.632477 2712 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.68.129
I20260810 15:26:18.633888 2712 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:46457
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786375520124696-18706-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786375520124696-18706-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.68.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786375520124696-18706-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.68.129
--webserver_port=0
--tserver_master_addrs=127.18.68.190:46401
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2712
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.68.129
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786375520124696-18706-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:26:18.634199 2712 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:26:18.634528 2712 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:26:18.639664 2727 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:26:18.639657 2724 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:26:18.639664 2725 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:26:18.640127 2712 server_base.cc:1034] running on GCE node
I20260810 15:26:18.640424 2712 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:26:18.640707 2712 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:26:18.641902 2712 hybrid_clock.cc:648] HybridClock initialized: now 1786375578641883 us; error 37 us; skew 500 ppm
I20260810 15:26:18.643383 2712 webserver.cc:460] Webserver started at http://127.18.68.129:42343/ using document root <none> and password file <none>
I20260810 15:26:18.643633 2712 fs_manager.cc:359] Metadata directory not provided
I20260810 15:26:18.643707 2712 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:26:18.643901 2712 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:26:18.645035 2712 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786375520124696-18706-0/minicluster-data/ts-0/data/instance:
uuid: "5da7822cc57a4b3cb0f5858dc707d7e2"
format_stamp: "Formatted at 2026-08-10 15:26:18 on dist-test-slave-2p8l"
server_key: "97c0d0d1ea66e892a4d62ad4af0657f6"
server_key_iv: "1d173605eb0169454a92a6396b44a353"
server_key_version: "encryptionkey@0"
I20260810 15:26:18.645428 2712 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786375520124696-18706-0/minicluster-data/ts-0/wal/instance:
uuid: "5da7822cc57a4b3cb0f5858dc707d7e2"
format_stamp: "Formatted at 2026-08-10 15:26:18 on dist-test-slave-2p8l"
server_key: "97c0d0d1ea66e892a4d62ad4af0657f6"
server_key_iv: "1d173605eb0169454a92a6396b44a353"
server_key_version: "encryptionkey@0"
I20260810 15:26:18.646896 2712 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 15:26:18.647715 2736 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:26:18.647960 2712 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 15:26:18.648067 2712 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786375520124696-18706-0/minicluster-data/ts-0/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786375520124696-18706-0/minicluster-data/ts-0/wal
uuid: "5da7822cc57a4b3cb0f5858dc707d7e2"
format_stamp: "Formatted at 2026-08-10 15:26:18 on dist-test-slave-2p8l"
server_key: "97c0d0d1ea66e892a4d62ad4af0657f6"
server_key_iv: "1d173605eb0169454a92a6396b44a353"
server_key_version: "encryptionkey@0"
I20260810 15:26:18.648144 2712 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786375520124696-18706-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786375520124696-18706-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786375520124696-18706-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:26:18.663990 2712 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:26:18.664292 2712 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:26:18.664402 2712 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:26:18.664608 2712 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 15:26:18.665009 2712 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 15:26:18.665051 2712 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 15:26:18.665076 2712 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 15:26:18.665127 2712 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 15:26:18.671311 2712 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.129:46825
I20260810 15:26:18.671392 2930 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.129:46825 every 8 connection(s)
I20260810 15:26:18.671744 2712 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786375520124696-18706-0/minicluster-data/ts-0/data/info.pb
I20260810 15:26:18.676992 2672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:26:18.672523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.129:43729 (local address 127.18.68.190:46401)
0810 15:26:18.672649 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0810 15:26:18.672652 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 15:26:18.672802 (+ 150us) server_negotiation.cc:407] Connection header received
0810 15:26:18.673320 (+ 518us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:26:18.673321 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:26:18.673335 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:26:18.673393 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:26:18.674019 (+ 626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:18.674533 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:18.675556 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:18.675759 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:18.675812 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:18.676713 (+ 901us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:26:18.676714 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:26:18.676715 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 15:26:18.676719 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:26:18.676730 (+ 11us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 15:26:18.676733 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:26:18.676773 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0810 15:26:18.676898 (+ 125us) server_negotiation.cc:299] Negotiation successful
0810 15:26:18.676932 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260810 15:26:18.677206 2937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:26:18.672474 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46401 (local address 127.18.68.129:43729)
0810 15:26:18.672675 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0810 15:26:18.672710 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0810 15:26:18.673226 (+ 516us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:26:18.673445 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:26:18.673449 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:26:18.673456 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:26:18.673938 (+ 482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:18.673942 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:18.674628 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:18.674629 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:18.675471 (+ 842us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:18.675473 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:18.675840 (+ 367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:18.675841 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:18.675957 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:18.676577 (+ 620us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 15:26:18.676578 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:26:18.676608 (+ 30us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 15:26:18.676631 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:26:18.676810 (+ 179us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:26:18.676816 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:26:18.676819 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 15:26:18.676886 (+ 67us) client_negotiation.cc:240] Negotiation successful
0810 15:26:18.676971 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":103,"threads_started":1}
I20260810 15:26:18.677742 2933 heartbeater.cc:347] Connected to a master server at 127.18.68.190:46401
I20260810 15:26:18.677855 2933 heartbeater.cc:464] Registering TS with master...
I20260810 15:26:18.678050 2933 heartbeater.cc:511] Master 127.18.68.190:46401 requested a full tablet report, sending...
I20260810 15:26:18.678656 2610 ts_manager.cc:194] Registered new tserver with Master: 5da7822cc57a4b3cb0f5858dc707d7e2 (127.18.68.129:46825)
I20260810 15:26:18.679220 2610 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.18.68.129:43729
I20260810 15:26:18.681011 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 2712
I20260810 15:26:18.681102 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786375520124696-18706-0/minicluster-data/ts-0/wal/instance
I20260810 15:26:18.681262 18706 external_mini_cluster.cc:1428] Setting key bdeafafbc04cc2b88efc00fe852c7ddc
I20260810 15:26:18.682207 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786375520124696-18706-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786375520124696-18706-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786375520124696-18706-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786375520124696-18706-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.68.130:0
--local_ip_for_outbound_sockets=127.18.68.130
--webserver_interface=127.18.68.130
--webserver_port=0
--tserver_master_addrs=127.18.68.190:46401
--builtin_ntp_servers=127.18.68.148:46457
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260810 15:26:18.767920 2938 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:26:18.768139 2938 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:26:18.768163 2938 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:26:18.769272 2938 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:26:18.769307 2938 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:26:18.769342 2938 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.68.130
I20260810 15:26:18.770738 2938 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:46457
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786375520124696-18706-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786375520124696-18706-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.68.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786375520124696-18706-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.68.130
--webserver_port=0
--tserver_master_addrs=127.18.68.190:46401
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2938
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.68.130
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786375520124696-18706-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:26:18.770941 2938 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:26:18.771234 2938 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:26:18.778317 2953 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:26:18.778311 2949 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:26:18.778311 2957 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:26:18.778345 2938 server_base.cc:1034] running on GCE node
I20260810 15:26:18.778869 2938 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:26:18.779191 2938 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:26:18.780346 2938 hybrid_clock.cc:648] HybridClock initialized: now 1786375578780335 us; error 31 us; skew 500 ppm
I20260810 15:26:18.782225 2938 webserver.cc:460] Webserver started at http://127.18.68.130:46125/ using document root <none> and password file <none>
I20260810 15:26:18.782497 2938 fs_manager.cc:359] Metadata directory not provided
I20260810 15:26:18.782547 2938 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:26:18.782734 2938 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:26:18.784039 2938 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786375520124696-18706-0/minicluster-data/ts-1/data/instance:
uuid: "2f18e11fb99c4d2e867fe5611df5f2a2"
format_stamp: "Formatted at 2026-08-10 15:26:18 on dist-test-slave-2p8l"
server_key: "d6dd8518cdfd4c53c390490879be1864"
server_key_iv: "91b83d339e7b43b5b84efca0cff621db"
server_key_version: "encryptionkey@0"
I20260810 15:26:18.784441 2938 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786375520124696-18706-0/minicluster-data/ts-1/wal/instance:
uuid: "2f18e11fb99c4d2e867fe5611df5f2a2"
format_stamp: "Formatted at 2026-08-10 15:26:18 on dist-test-slave-2p8l"
server_key: "d6dd8518cdfd4c53c390490879be1864"
server_key_iv: "91b83d339e7b43b5b84efca0cff621db"
server_key_version: "encryptionkey@0"
I20260810 15:26:18.786047 2938 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.004s sys 0.000s
I20260810 15:26:18.787048 2964 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:26:18.787236 2938 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 15:26:18.787329 2938 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786375520124696-18706-0/minicluster-data/ts-1/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786375520124696-18706-0/minicluster-data/ts-1/wal
uuid: "2f18e11fb99c4d2e867fe5611df5f2a2"
format_stamp: "Formatted at 2026-08-10 15:26:18 on dist-test-slave-2p8l"
server_key: "d6dd8518cdfd4c53c390490879be1864"
server_key_iv: "91b83d339e7b43b5b84efca0cff621db"
server_key_version: "encryptionkey@0"
I20260810 15:26:18.787397 2938 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786375520124696-18706-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786375520124696-18706-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786375520124696-18706-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:26:18.817225 2938 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:26:18.817595 2938 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:26:18.817799 2938 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:26:18.818100 2938 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 15:26:18.818432 2938 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 15:26:18.818466 2938 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 15:26:18.818491 2938 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 15:26:18.818527 2938 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 15:26:18.824671 2938 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.130:33833
I20260810 15:26:18.824781 3161 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.130:33833 every 8 connection(s)
I20260810 15:26:18.825093 2938 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786375520124696-18706-0/minicluster-data/ts-1/data/info.pb
I20260810 15:26:18.828763 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 2938
I20260810 15:26:18.828887 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786375520124696-18706-0/minicluster-data/ts-1/wal/instance
I20260810 15:26:18.829084 18706 external_mini_cluster.cc:1428] Setting key fcf7af32e7d76679e9ba63225394324e
I20260810 15:26:18.830219 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786375520124696-18706-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786375520124696-18706-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786375520124696-18706-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786375520124696-18706-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.68.131:0
--local_ip_for_outbound_sockets=127.18.68.131
--webserver_interface=127.18.68.131
--webserver_port=0
--tserver_master_addrs=127.18.68.190:46401
--builtin_ntp_servers=127.18.68.148:46457
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260810 15:26:18.831108 2672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:26:18.825976 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.130:45081 (local address 127.18.68.190:46401)
0810 15:26:18.826024 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0810 15:26:18.826027 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 15:26:18.826304 (+ 277us) server_negotiation.cc:407] Connection header received
0810 15:26:18.826886 (+ 582us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:26:18.826888 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:26:18.826902 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:26:18.826951 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:26:18.827685 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:18.828190 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:18.829540 (+ 1350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:18.829752 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:18.829833 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:18.830817 (+ 984us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:26:18.830818 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:26:18.830819 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 15:26:18.830824 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:26:18.830840 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 15:26:18.830845 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:26:18.830894 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0810 15:26:18.830985 (+ 91us) server_negotiation.cc:299] Negotiation successful
0810 15:26:18.831013 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260810 15:26:18.831351 3166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:26:18.825933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46401 (local address 127.18.68.130:45081)
0810 15:26:18.826167 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0810 15:26:18.826203 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0810 15:26:18.826758 (+ 555us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:26:18.827033 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:26:18.827044 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:26:18.827053 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:26:18.827579 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:18.827584 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:18.828293 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:18.828294 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:18.829440 (+ 1146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:18.829443 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:18.829843 (+ 400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:18.829844 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:18.830005 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:18.830672 (+ 667us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 15:26:18.830673 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:26:18.830702 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 15:26:18.830726 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:26:18.830894 (+ 168us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:26:18.830899 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:26:18.830902 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 15:26:18.830989 (+ 87us) client_negotiation.cc:240] Negotiation successful
0810 15:26:18.831123 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":72,"threads_started":1}
I20260810 15:26:18.831869 3162 heartbeater.cc:347] Connected to a master server at 127.18.68.190:46401
I20260810 15:26:18.831986 3162 heartbeater.cc:464] Registering TS with master...
I20260810 15:26:18.832223 3162 heartbeater.cc:511] Master 127.18.68.190:46401 requested a full tablet report, sending...
I20260810 15:26:18.832625 2610 ts_manager.cc:194] Registered new tserver with Master: 2f18e11fb99c4d2e867fe5611df5f2a2 (127.18.68.130:33833)
I20260810 15:26:18.833020 2610 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.18.68.130:45081
W20260810 15:26:18.913525 3167 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:26:18.913779 3167 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:26:18.913816 3167 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:26:18.914975 3167 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:26:18.915043 3167 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:26:18.915084 3167 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.68.131
I20260810 15:26:18.916414 3167 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:46457
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786375520124696-18706-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786375520124696-18706-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.68.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786375520124696-18706-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.68.131
--webserver_port=0
--tserver_master_addrs=127.18.68.190:46401
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3167
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.68.131
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786375520124696-18706-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:26:18.916680 3167 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:26:18.916970 3167 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:26:18.922413 3180 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:26:18.922422 3176 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:26:18.922466 3177 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:26:18.922684 3167 server_base.cc:1034] running on GCE node
I20260810 15:26:18.922936 3167 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:26:18.923225 3167 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:26:18.924397 3167 hybrid_clock.cc:648] HybridClock initialized: now 1786375578924385 us; error 28 us; skew 500 ppm
I20260810 15:26:18.925866 3167 webserver.cc:460] Webserver started at http://127.18.68.131:33781/ using document root <none> and password file <none>
I20260810 15:26:18.926179 3167 fs_manager.cc:359] Metadata directory not provided
I20260810 15:26:18.926239 3167 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:26:18.926338 3167 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:26:18.927407 3167 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786375520124696-18706-0/minicluster-data/ts-2/data/instance:
uuid: "b2b545713934407fa9b87b08d4280591"
format_stamp: "Formatted at 2026-08-10 15:26:18 on dist-test-slave-2p8l"
server_key: "abed7df7f0de62862a009c488a696e52"
server_key_iv: "b4899b866b52cf7eed2d7beb1620d3f4"
server_key_version: "encryptionkey@0"
I20260810 15:26:18.927734 3167 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786375520124696-18706-0/minicluster-data/ts-2/wal/instance:
uuid: "b2b545713934407fa9b87b08d4280591"
format_stamp: "Formatted at 2026-08-10 15:26:18 on dist-test-slave-2p8l"
server_key: "abed7df7f0de62862a009c488a696e52"
server_key_iv: "b4899b866b52cf7eed2d7beb1620d3f4"
server_key_version: "encryptionkey@0"
I20260810 15:26:18.929337 3167 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 15:26:18.930347 3189 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:26:18.930505 3167 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 15:26:18.930598 3167 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786375520124696-18706-0/minicluster-data/ts-2/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786375520124696-18706-0/minicluster-data/ts-2/wal
uuid: "b2b545713934407fa9b87b08d4280591"
format_stamp: "Formatted at 2026-08-10 15:26:18 on dist-test-slave-2p8l"
server_key: "abed7df7f0de62862a009c488a696e52"
server_key_iv: "b4899b866b52cf7eed2d7beb1620d3f4"
server_key_version: "encryptionkey@0"
I20260810 15:26:18.930677 3167 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786375520124696-18706-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786375520124696-18706-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786375520124696-18706-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:26:18.959532 3167 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:26:18.959928 3167 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:26:18.960101 3167 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:26:18.960384 3167 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 15:26:18.960762 3167 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 15:26:18.960803 3167 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 15:26:18.960827 3167 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 15:26:18.960841 3167 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 15:26:18.967427 3167 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.131:40197
I20260810 15:26:18.967489 3381 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.131:40197 every 8 connection(s)
I20260810 15:26:18.967834 3167 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786375520124696-18706-0/minicluster-data/ts-2/data/info.pb
I20260810 15:26:18.973266 2672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:26:18.968741 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.131:33335 (local address 127.18.68.190:46401)
0810 15:26:18.968810 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0810 15:26:18.968812 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:26:18.968955 (+ 143us) server_negotiation.cc:407] Connection header received
0810 15:26:18.969464 (+ 509us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:26:18.969465 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:26:18.969476 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:26:18.969543 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:26:18.970341 (+ 798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:18.970826 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:18.971777 (+ 951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:18.971953 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:18.972006 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:18.972948 (+ 942us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:26:18.972949 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:26:18.972949 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 15:26:18.972954 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:26:18.972970 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 15:26:18.972975 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:26:18.973035 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0810 15:26:18.973183 (+ 148us) server_negotiation.cc:299] Negotiation successful
0810 15:26:18.973205 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260810 15:26:18.973528 3385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:26:18.968567 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46401 (local address 127.18.68.131:33335)
0810 15:26:18.968812 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0810 15:26:18.968856 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0810 15:26:18.969358 (+ 502us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:26:18.969627 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:26:18.969631 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:26:18.969639 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:26:18.970250 (+ 611us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:18.970255 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:18.970907 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:18.970908 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:18.971693 (+ 785us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:18.971696 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:18.972028 (+ 332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:18.972029 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:18.972151 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:18.972789 (+ 638us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 15:26:18.972789 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:26:18.972819 (+ 30us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 15:26:18.972842 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:26:18.973065 (+ 223us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:26:18.973072 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:26:18.973075 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 15:26:18.973167 (+ 92us) client_negotiation.cc:240] Negotiation successful
0810 15:26:18.973252 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":138,"threads_started":1}
I20260810 15:26:18.974085 3382 heartbeater.cc:347] Connected to a master server at 127.18.68.190:46401
I20260810 15:26:18.974191 3382 heartbeater.cc:464] Registering TS with master...
I20260810 15:26:18.974349 3382 heartbeater.cc:511] Master 127.18.68.190:46401 requested a full tablet report, sending...
I20260810 15:26:18.974709 2610 ts_manager.cc:194] Registered new tserver with Master: b2b545713934407fa9b87b08d4280591 (127.18.68.131:40197)
I20260810 15:26:18.975049 2610 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.18.68.131:33335
I20260810 15:26:18.976795 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 3167
I20260810 15:26:18.976919 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786375520124696-18706-0/minicluster-data/ts-2/wal/instance
I20260810 15:26:18.977123 18706 external_mini_cluster.cc:1428] Setting key 81c757dddaf448ac002ab662a0434478
I20260810 15:26:18.978225 18706 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260810 15:26:18.980083 2672 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 15:26:18.979554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50612 (local address 127.18.68.190:46401)
0810 15:26:18.979592 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0810 15:26:18.979593 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 15:26:18.979751 (+ 158us) server_negotiation.cc:407] Connection header received
0810 15:26:18.979827 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:26:18.979828 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:26:18.979837 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:26:18.979890 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:26:18.980018 (+ 128us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50612: BlockingRecv error: recv got EOF from 127.0.0.1:50612 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
I20260810 15:26:18.980301 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 2712
I20260810 15:26:19.007732 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 2938
I20260810 15:26:19.025403 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 3167
I20260810 15:26:19.057525 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 2552
2026-08-10T15:26:19Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (709 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-10T15:26:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T15:26:19Z Disabled control of system clock
I20260810 15:26:19.090687 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786375520124696-18706-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786375520124696-18706-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786375520124696-18706-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.190:40265
--webserver_interface=127.18.68.190
--webserver_port=0
--builtin_ntp_servers=127.18.68.148:35933
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.68.190:40265
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260810 15:26:19.172542 3400 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:26:19.172811 3400 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:26:19.172852 3400 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:26:19.174031 3400 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 15:26:19.174151 3400 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:26:19.174176 3400 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:26:19.174199 3400 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 15:26:19.174228 3400 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 15:26:19.175663 3400 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:35933
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786375520124696-18706-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786375520124696-18706-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.68.190:40265
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.190:40265
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.68.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3400
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786375520124696-18706-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:26:19.175945 3400 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:26:19.176267 3400 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:26:19.181514 3410 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:26:19.181510 3414 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:26:19.181622 3412 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:26:19.182161 3400 server_base.cc:1034] running on GCE node
I20260810 15:26:19.182443 3400 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:26:19.182710 3400 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:26:19.183856 3400 hybrid_clock.cc:648] HybridClock initialized: now 1786375579183846 us; error 34 us; skew 500 ppm
I20260810 15:26:19.185266 3400 webserver.cc:460] Webserver started at http://127.18.68.190:35665/ using document root <none> and password file <none>
I20260810 15:26:19.185544 3400 fs_manager.cc:359] Metadata directory not provided
I20260810 15:26:19.185616 3400 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:26:19.185758 3400 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:26:19.186897 3400 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786375520124696-18706-0/minicluster-data/master-0/data/instance:
uuid: "6bdfa3b3892a4a55a5b5b5c690e4321a"
format_stamp: "Formatted at 2026-08-10 15:26:19 on dist-test-slave-2p8l"
server_key: "60f631fa0c85295b399cbcb3d0101811"
server_key_iv: "6c18d3c7db94f96f3ab1e4bd3033dca9"
server_key_version: "encryptionkey@0"
I20260810 15:26:19.187274 3400 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786375520124696-18706-0/minicluster-data/master-0/wal/instance:
uuid: "6bdfa3b3892a4a55a5b5b5c690e4321a"
format_stamp: "Formatted at 2026-08-10 15:26:19 on dist-test-slave-2p8l"
server_key: "60f631fa0c85295b399cbcb3d0101811"
server_key_iv: "6c18d3c7db94f96f3ab1e4bd3033dca9"
server_key_version: "encryptionkey@0"
I20260810 15:26:19.188555 3400 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260810 15:26:19.189284 3425 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:26:19.189460 3400 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 15:26:19.189570 3400 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786375520124696-18706-0/minicluster-data/master-0/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786375520124696-18706-0/minicluster-data/master-0/wal
uuid: "6bdfa3b3892a4a55a5b5b5c690e4321a"
format_stamp: "Formatted at 2026-08-10 15:26:19 on dist-test-slave-2p8l"
server_key: "60f631fa0c85295b399cbcb3d0101811"
server_key_iv: "6c18d3c7db94f96f3ab1e4bd3033dca9"
server_key_version: "encryptionkey@0"
I20260810 15:26:19.189646 3400 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786375520124696-18706-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786375520124696-18706-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786375520124696-18706-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:26:19.193022 3400 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:26:19.193302 3400 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:26:19.193445 3400 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:26:19.197685 3400 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.190:40265
I20260810 15:26:19.197717 3521 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.190:40265 every 8 connection(s)
I20260810 15:26:19.198032 3400 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
I20260810 15:26:19.198719 3522 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:26:19.201366 3522 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6bdfa3b3892a4a55a5b5b5c690e4321a: Bootstrap starting.
I20260810 15:26:19.201906 3522 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6bdfa3b3892a4a55a5b5b5c690e4321a: Neither blocks nor log segments found. Creating new log.
I20260810 15:26:19.202222 3522 log.cc:824] T 00000000000000000000000000000000 P 6bdfa3b3892a4a55a5b5b5c690e4321a: Log is configured to *not* fsync() on all Append() calls
I20260810 15:26:19.202863 3522 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6bdfa3b3892a4a55a5b5b5c690e4321a: No bootstrap required, opened a new log
I20260810 15:26:19.204347 3522 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6bdfa3b3892a4a55a5b5b5c690e4321a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6bdfa3b3892a4a55a5b5b5c690e4321a" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 40265 } }
I20260810 15:26:19.204484 3522 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6bdfa3b3892a4a55a5b5b5c690e4321a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:26:19.204520 3522 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6bdfa3b3892a4a55a5b5b5c690e4321a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6bdfa3b3892a4a55a5b5b5c690e4321a, State: Initialized, Role: FOLLOWER
I20260810 15:26:19.204619 3522 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6bdfa3b3892a4a55a5b5b5c690e4321a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6bdfa3b3892a4a55a5b5b5c690e4321a" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 40265 } }
I20260810 15:26:19.204679 3522 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6bdfa3b3892a4a55a5b5b5c690e4321a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 15:26:19.204700 3522 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6bdfa3b3892a4a55a5b5b5c690e4321a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 15:26:19.204775 3522 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6bdfa3b3892a4a55a5b5b5c690e4321a [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:26:19.205293 3522 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6bdfa3b3892a4a55a5b5b5c690e4321a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6bdfa3b3892a4a55a5b5b5c690e4321a" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 40265 } }
I20260810 15:26:19.205385 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 3400
I20260810 15:26:19.205379 3522 leader_election.cc:302] T 00000000000000000000000000000000 P 6bdfa3b3892a4a55a5b5b5c690e4321a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6bdfa3b3892a4a55a5b5b5c690e4321a; no voters:
I20260810 15:26:19.205497 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786375520124696-18706-0/minicluster-data/master-0/wal/instance
I20260810 15:26:19.205569 3522 leader_election.cc:288] T 00000000000000000000000000000000 P 6bdfa3b3892a4a55a5b5b5c690e4321a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 15:26:19.205602 3528 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6bdfa3b3892a4a55a5b5b5c690e4321a [term 1 FOLLOWER]: Leader election won for term 1
I20260810 15:26:19.205719 18706 external_mini_cluster.cc:1428] Setting key 4adc1bd026af037113b69699fa3a323b
I20260810 15:26:19.205726 3528 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6bdfa3b3892a4a55a5b5b5c690e4321a [term 1 LEADER]: Becoming Leader. State: Replica: 6bdfa3b3892a4a55a5b5b5c690e4321a, State: Running, Role: LEADER
I20260810 15:26:19.205801 3528 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6bdfa3b3892a4a55a5b5b5c690e4321a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6bdfa3b3892a4a55a5b5b5c690e4321a" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 40265 } }
I20260810 15:26:19.205847 3522 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6bdfa3b3892a4a55a5b5b5c690e4321a [sys.catalog]: configured and running, proceeding with master startup.
I20260810 15:26:19.206122 3528 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6bdfa3b3892a4a55a5b5b5c690e4321a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6bdfa3b3892a4a55a5b5b5c690e4321a. Latest consensus state: current_term: 1 leader_uuid: "6bdfa3b3892a4a55a5b5b5c690e4321a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6bdfa3b3892a4a55a5b5b5c690e4321a" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 40265 } } }
I20260810 15:26:19.206202 3528 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6bdfa3b3892a4a55a5b5b5c690e4321a [sys.catalog]: This master's current role is: LEADER
I20260810 15:26:19.206662 3533 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 15:26:19.206705 3529 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6bdfa3b3892a4a55a5b5b5c690e4321a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6bdfa3b3892a4a55a5b5b5c690e4321a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6bdfa3b3892a4a55a5b5b5c690e4321a" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 40265 } } }
I20260810 15:26:19.206905 3529 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6bdfa3b3892a4a55a5b5b5c690e4321a [sys.catalog]: This master's current role is: LEADER
I20260810 15:26:19.207201 3533 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 15:26:19.209080 3533 catalog_manager.cc:1347] Generated new cluster ID: 91e2820139374bd6adce1132ccc03615
I20260810 15:26:19.209098 3538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:26:19.206228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46690 (local address 127.18.68.190:40265)
0810 15:26:19.207051 (+ 823us) server_negotiation.cc:206] Beginning negotiation
0810 15:26:19.207061 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 15:26:19.207095 (+ 34us) server_negotiation.cc:407] Connection header received
0810 15:26:19.207213 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:26:19.207219 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:26:19.207258 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:26:19.207416 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:26:19.208488 (+ 1072us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:26:19.208491 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:26:19.208492 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 15:26:19.208496 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:26:19.208542 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 15:26:19.208555 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:26:19.208669 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0810 15:26:19.208842 (+ 173us) server_negotiation.cc:299] Negotiation successful
0810 15:26:19.208902 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":747,"thread_start_us":97,"threads_started":1}
I20260810 15:26:19.209146 3533 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 15:26:19.219769 3533 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 15:26:19.219935 3533 catalog_manager.cc:1504] Loading token signing keys...
I20260810 15:26:19.234349 3533 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6bdfa3b3892a4a55a5b5b5c690e4321a: Generated new TSK 0
I20260810 15:26:19.234782 3533 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 15:26:19.243502 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786375520124696-18706-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786375520124696-18706-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786375520124696-18706-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786375520124696-18706-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.68.129:0
--local_ip_for_outbound_sockets=127.18.68.129
--webserver_interface=127.18.68.129
--webserver_port=0
--tserver_master_addrs=127.18.68.190:40265
--builtin_ntp_servers=127.18.68.148:35933
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260810 15:26:19.327822 3556 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:26:19.328066 3556 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:26:19.328106 3556 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:26:19.329275 3556 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:26:19.329340 3556 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:26:19.329382 3556 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.68.129
I20260810 15:26:19.330811 3556 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:35933
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786375520124696-18706-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786375520124696-18706-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.68.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786375520124696-18706-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.68.129
--webserver_port=0
--tserver_master_addrs=127.18.68.190:40265
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3556
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.68.129
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786375520124696-18706-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:26:19.331073 3556 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:26:19.331369 3556 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:26:19.336773 3571 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:26:19.336839 3573 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:26:19.336800 3556 server_base.cc:1034] running on GCE node
W20260810 15:26:19.336833 3569 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:26:19.337261 3556 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:26:19.337548 3556 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:26:19.338744 3556 hybrid_clock.cc:648] HybridClock initialized: now 1786375579338715 us; error 51 us; skew 500 ppm
I20260810 15:26:19.340186 3556 webserver.cc:460] Webserver started at http://127.18.68.129:44303/ using document root <none> and password file <none>
I20260810 15:26:19.340435 3556 fs_manager.cc:359] Metadata directory not provided
I20260810 15:26:19.340507 3556 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:26:19.340670 3556 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:26:19.341833 3556 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786375520124696-18706-0/minicluster-data/ts-0/data/instance:
uuid: "e3bfa02428df4e69b6b127c3bf77ec56"
format_stamp: "Formatted at 2026-08-10 15:26:19 on dist-test-slave-2p8l"
server_key: "1f2aedca39e2df5d17c464d73b9e97d4"
server_key_iv: "3c7ef8437cfb751bcdb694ad520bf1a5"
server_key_version: "encryptionkey@0"
I20260810 15:26:19.342242 3556 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786375520124696-18706-0/minicluster-data/ts-0/wal/instance:
uuid: "e3bfa02428df4e69b6b127c3bf77ec56"
format_stamp: "Formatted at 2026-08-10 15:26:19 on dist-test-slave-2p8l"
server_key: "1f2aedca39e2df5d17c464d73b9e97d4"
server_key_iv: "3c7ef8437cfb751bcdb694ad520bf1a5"
server_key_version: "encryptionkey@0"
I20260810 15:26:19.343916 3556 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 15:26:19.344720 3582 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:26:19.344905 3556 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:26:19.345009 3556 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786375520124696-18706-0/minicluster-data/ts-0/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786375520124696-18706-0/minicluster-data/ts-0/wal
uuid: "e3bfa02428df4e69b6b127c3bf77ec56"
format_stamp: "Formatted at 2026-08-10 15:26:19 on dist-test-slave-2p8l"
server_key: "1f2aedca39e2df5d17c464d73b9e97d4"
server_key_iv: "3c7ef8437cfb751bcdb694ad520bf1a5"
server_key_version: "encryptionkey@0"
I20260810 15:26:19.345093 3556 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786375520124696-18706-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786375520124696-18706-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786375520124696-18706-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:26:19.348529 3556 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:26:19.348812 3556 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:26:19.348955 3556 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:26:19.349196 3556 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 15:26:19.349524 3556 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 15:26:19.349584 3556 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 15:26:19.349624 3556 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 15:26:19.349653 3556 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 15:26:19.355722 3556 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.129:46387
I20260810 15:26:19.355786 3780 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.129:46387 every 8 connection(s)
I20260810 15:26:19.356097 3556 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786375520124696-18706-0/minicluster-data/ts-0/data/info.pb
I20260810 15:26:19.359185 3538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:26:19.356827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.129:57905 (local address 127.18.68.190:40265)
0810 15:26:19.356917 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0810 15:26:19.356919 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:26:19.357120 (+ 201us) server_negotiation.cc:407] Connection header received
0810 15:26:19.357564 (+ 444us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:26:19.357565 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:26:19.357572 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:26:19.357634 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:26:19.358931 (+ 1297us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:26:19.358932 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:26:19.358932 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 15:26:19.358938 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:26:19.358956 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 15:26:19.358961 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:26:19.359045 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0810 15:26:19.359102 (+ 57us) server_negotiation.cc:299] Negotiation successful
0810 15:26:19.359118 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260810 15:26:19.359392 3783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:26:19.356782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:40265 (local address 127.18.68.129:57905)
0810 15:26:19.356988 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0810 15:26:19.357028 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0810 15:26:19.357475 (+ 447us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:26:19.357690 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:26:19.357693 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:26:19.357701 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:26:19.358759 (+ 1058us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 15:26:19.358760 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:26:19.358793 (+ 33us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 15:26:19.358827 (+ 34us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:26:19.359031 (+ 204us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:26:19.359033 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:26:19.359036 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 15:26:19.359099 (+ 63us) client_negotiation.cc:240] Negotiation successful
0810 15:26:19.359148 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":103,"threads_started":1}
I20260810 15:26:19.359443 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 3556
I20260810 15:26:19.359560 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786375520124696-18706-0/minicluster-data/ts-0/wal/instance
I20260810 15:26:19.359812 18706 external_mini_cluster.cc:1428] Setting key 3500c7e013c8f5773dee4efd11b4bdfe
I20260810 15:26:19.359941 3781 heartbeater.cc:347] Connected to a master server at 127.18.68.190:40265
I20260810 15:26:19.360069 3781 heartbeater.cc:464] Registering TS with master...
I20260810 15:26:19.360232 3781 heartbeater.cc:511] Master 127.18.68.190:40265 requested a full tablet report, sending...
I20260810 15:26:19.360816 3458 ts_manager.cc:194] Registered new tserver with Master: e3bfa02428df4e69b6b127c3bf77ec56 (127.18.68.129:46387)
I20260810 15:26:19.360883 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786375520124696-18706-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786375520124696-18706-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786375520124696-18706-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786375520124696-18706-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.68.130:0
--local_ip_for_outbound_sockets=127.18.68.130
--webserver_interface=127.18.68.130
--webserver_port=0
--tserver_master_addrs=127.18.68.190:40265
--builtin_ntp_servers=127.18.68.148:35933
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260810 15:26:19.444866 3787 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:26:19.445092 3787 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:26:19.445116 3787 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:26:19.446410 3787 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:26:19.446458 3787 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:26:19.446485 3787 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.68.130
I20260810 15:26:19.447909 3787 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:35933
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786375520124696-18706-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786375520124696-18706-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.68.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786375520124696-18706-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.68.130
--webserver_port=0
--tserver_master_addrs=127.18.68.190:40265
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3787
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.68.130
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786375520124696-18706-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:26:19.448174 3787 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:26:19.448498 3787 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:26:19.453691 3793 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:26:19.453712 3799 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:26:19.453713 3796 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:26:19.454041 3787 server_base.cc:1034] running on GCE node
I20260810 15:26:19.454352 3787 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:26:19.454610 3787 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:26:19.455804 3787 hybrid_clock.cc:648] HybridClock initialized: now 1786375579455794 us; error 30 us; skew 500 ppm
I20260810 15:26:19.457075 3787 webserver.cc:460] Webserver started at http://127.18.68.130:42945/ using document root <none> and password file <none>
I20260810 15:26:19.457346 3787 fs_manager.cc:359] Metadata directory not provided
I20260810 15:26:19.457393 3787 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:26:19.457530 3787 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:26:19.458706 3787 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786375520124696-18706-0/minicluster-data/ts-1/data/instance:
uuid: "148807e5210f42c39ce056f41f225c2c"
format_stamp: "Formatted at 2026-08-10 15:26:19 on dist-test-slave-2p8l"
server_key: "499c49b4e68435c1aa10d67660be8ff1"
server_key_iv: "fb520541bb7d7e75e4f09ba98c92941b"
server_key_version: "encryptionkey@0"
I20260810 15:26:19.459069 3787 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786375520124696-18706-0/minicluster-data/ts-1/wal/instance:
uuid: "148807e5210f42c39ce056f41f225c2c"
format_stamp: "Formatted at 2026-08-10 15:26:19 on dist-test-slave-2p8l"
server_key: "499c49b4e68435c1aa10d67660be8ff1"
server_key_iv: "fb520541bb7d7e75e4f09ba98c92941b"
server_key_version: "encryptionkey@0"
I20260810 15:26:19.460448 3787 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260810 15:26:19.461303 3807 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:26:19.461540 3787 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 15:26:19.461632 3787 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786375520124696-18706-0/minicluster-data/ts-1/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786375520124696-18706-0/minicluster-data/ts-1/wal
uuid: "148807e5210f42c39ce056f41f225c2c"
format_stamp: "Formatted at 2026-08-10 15:26:19 on dist-test-slave-2p8l"
server_key: "499c49b4e68435c1aa10d67660be8ff1"
server_key_iv: "fb520541bb7d7e75e4f09ba98c92941b"
server_key_version: "encryptionkey@0"
I20260810 15:26:19.461730 3787 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786375520124696-18706-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786375520124696-18706-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786375520124696-18706-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:26:19.465317 3787 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:26:19.465600 3787 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:26:19.465737 3787 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:26:19.465948 3787 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 15:26:19.466295 3787 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 15:26:19.466331 3787 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 15:26:19.466351 3787 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 15:26:19.466403 3787 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 15:26:19.472250 3787 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.130:37581
I20260810 15:26:19.472311 4001 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.130:37581 every 8 connection(s)
I20260810 15:26:19.472648 3787 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786375520124696-18706-0/minicluster-data/ts-1/data/info.pb
I20260810 15:26:19.475854 3538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:26:19.473441 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.130:50507 (local address 127.18.68.190:40265)
0810 15:26:19.473540 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0810 15:26:19.473542 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:26:19.473732 (+ 190us) server_negotiation.cc:407] Connection header received
0810 15:26:19.474318 (+ 586us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:26:19.474320 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:26:19.474326 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:26:19.474387 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:26:19.475549 (+ 1162us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:26:19.475551 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:26:19.475552 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 15:26:19.475557 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:26:19.475574 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 15:26:19.475578 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:26:19.475639 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0810 15:26:19.475766 (+ 127us) server_negotiation.cc:299] Negotiation successful
0810 15:26:19.475782 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260810 15:26:19.476058 4005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:26:19.473355 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:40265 (local address 127.18.68.130:50507)
0810 15:26:19.473601 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0810 15:26:19.473635 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0810 15:26:19.474203 (+ 568us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:26:19.474454 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:26:19.474459 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:26:19.474474 (+ 15us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:26:19.475391 (+ 917us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 15:26:19.475391 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:26:19.475420 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 15:26:19.475447 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:26:19.475648 (+ 201us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:26:19.475653 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:26:19.475656 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 15:26:19.475775 (+ 119us) client_negotiation.cc:240] Negotiation successful
0810 15:26:19.475837 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":95,"threads_started":1}
I20260810 15:26:19.476509 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 3787
I20260810 15:26:19.476624 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786375520124696-18706-0/minicluster-data/ts-1/wal/instance
I20260810 15:26:19.476617 4002 heartbeater.cc:347] Connected to a master server at 127.18.68.190:40265
I20260810 15:26:19.476730 4002 heartbeater.cc:464] Registering TS with master...
I20260810 15:26:19.476847 18706 external_mini_cluster.cc:1428] Setting key 63b6639eccae1feb803afc5c4a94a5db
I20260810 15:26:19.476897 4002 heartbeater.cc:511] Master 127.18.68.190:40265 requested a full tablet report, sending...
I20260810 15:26:19.477274 3456 ts_manager.cc:194] Registered new tserver with Master: 148807e5210f42c39ce056f41f225c2c (127.18.68.130:37581)
I20260810 15:26:19.477890 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786375520124696-18706-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786375520124696-18706-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786375520124696-18706-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786375520124696-18706-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.68.131:0
--local_ip_for_outbound_sockets=127.18.68.131
--webserver_interface=127.18.68.131
--webserver_port=0
--tserver_master_addrs=127.18.68.190:40265
--builtin_ntp_servers=127.18.68.148:35933
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260810 15:26:19.562177 4006 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:26:19.562430 4006 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:26:19.562470 4006 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:26:19.563649 4006 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:26:19.563712 4006 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:26:19.563756 4006 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.68.131
I20260810 15:26:19.565188 4006 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:35933
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786375520124696-18706-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786375520124696-18706-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.68.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786375520124696-18706-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.68.131
--webserver_port=0
--tserver_master_addrs=127.18.68.190:40265
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4006
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.68.131
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786375520124696-18706-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:26:19.565488 4006 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:26:19.565796 4006 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:26:19.571115 4017 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:26:19.571149 4018 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:26:19.571269 4006 server_base.cc:1034] running on GCE node
W20260810 15:26:19.571305 4021 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:26:19.571604 4006 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:26:19.571851 4006 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:26:19.573025 4006 hybrid_clock.cc:648] HybridClock initialized: now 1786375579573006 us; error 42 us; skew 500 ppm
I20260810 15:26:19.574429 4006 webserver.cc:460] Webserver started at http://127.18.68.131:38143/ using document root <none> and password file <none>
I20260810 15:26:19.574677 4006 fs_manager.cc:359] Metadata directory not provided
I20260810 15:26:19.574748 4006 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:26:19.574887 4006 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:26:19.575984 4006 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786375520124696-18706-0/minicluster-data/ts-2/data/instance:
uuid: "88f3744764c147ed8b69a62da3dd3387"
format_stamp: "Formatted at 2026-08-10 15:26:19 on dist-test-slave-2p8l"
server_key: "99295fa254553b678a659eae3dcac534"
server_key_iv: "82d5a215e31e4c33742ec33a0cb9af24"
server_key_version: "encryptionkey@0"
I20260810 15:26:19.576376 4006 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786375520124696-18706-0/minicluster-data/ts-2/wal/instance:
uuid: "88f3744764c147ed8b69a62da3dd3387"
format_stamp: "Formatted at 2026-08-10 15:26:19 on dist-test-slave-2p8l"
server_key: "99295fa254553b678a659eae3dcac534"
server_key_iv: "82d5a215e31e4c33742ec33a0cb9af24"
server_key_version: "encryptionkey@0"
I20260810 15:26:19.577767 4006 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 15:26:19.578742 4037 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:26:19.578938 4006 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 15:26:19.579069 4006 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786375520124696-18706-0/minicluster-data/ts-2/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786375520124696-18706-0/minicluster-data/ts-2/wal
uuid: "88f3744764c147ed8b69a62da3dd3387"
format_stamp: "Formatted at 2026-08-10 15:26:19 on dist-test-slave-2p8l"
server_key: "99295fa254553b678a659eae3dcac534"
server_key_iv: "82d5a215e31e4c33742ec33a0cb9af24"
server_key_version: "encryptionkey@0"
I20260810 15:26:19.579162 4006 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786375520124696-18706-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786375520124696-18706-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786375520124696-18706-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:26:19.582890 4006 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:26:19.583189 4006 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:26:19.583343 4006 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:26:19.583581 4006 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 15:26:19.583916 4006 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 15:26:19.583974 4006 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 15:26:19.584025 4006 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 15:26:19.584055 4006 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 15:26:19.590716 4006 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.131:36179
I20260810 15:26:19.590761 4226 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.131:36179 every 8 connection(s)
I20260810 15:26:19.591116 4006 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786375520124696-18706-0/minicluster-data/ts-2/data/info.pb
I20260810 15:26:19.593592 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 4006
I20260810 15:26:19.593734 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786375520124696-18706-0/minicluster-data/ts-2/wal/instance
I20260810 15:26:19.593935 18706 external_mini_cluster.cc:1428] Setting key b30375887e7f114da04fb48417e0ef1e
I20260810 15:26:19.594870 3538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:26:19.591960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.131:59981 (local address 127.18.68.190:40265)
0810 15:26:19.592033 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0810 15:26:19.592035 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:26:19.592310 (+ 275us) server_negotiation.cc:407] Connection header received
0810 15:26:19.592875 (+ 565us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:26:19.592877 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:26:19.592903 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:26:19.592972 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:26:19.594568 (+ 1596us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:26:19.594569 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:26:19.594570 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 15:26:19.594575 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:26:19.594594 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 15:26:19.594604 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:26:19.594669 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0810 15:26:19.594776 (+ 107us) server_negotiation.cc:299] Negotiation successful
0810 15:26:19.594794 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260810 15:26:19.595099 4232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:26:19.591967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:40265 (local address 127.18.68.131:59981)
0810 15:26:19.592182 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0810 15:26:19.592218 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0810 15:26:19.592745 (+ 527us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:26:19.593058 (+ 313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:26:19.593063 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:26:19.593079 (+ 16us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:26:19.594363 (+ 1284us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 15:26:19.594363 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:26:19.594414 (+ 51us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 15:26:19.594455 (+ 41us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:26:19.594681 (+ 226us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:26:19.594689 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:26:19.594692 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 15:26:19.594777 (+ 85us) client_negotiation.cc:240] Negotiation successful
0810 15:26:19.594846 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":98,"threads_started":1}
I20260810 15:26:19.595557 4227 heartbeater.cc:347] Connected to a master server at 127.18.68.190:40265
I20260810 15:26:19.595649 4227 heartbeater.cc:464] Registering TS with master...
I20260810 15:26:19.595826 4227 heartbeater.cc:511] Master 127.18.68.190:40265 requested a full tablet report, sending...
I20260810 15:26:19.596233 3458 ts_manager.cc:194] Registered new tserver with Master: 88f3744764c147ed8b69a62da3dd3387 (127.18.68.131:36179)
I20260810 15:26:19.606184 18706 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260810 15:26:19.608310 3538 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 15:26:19.607810 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46702 (local address 127.18.68.190:40265)
0810 15:26:19.607876 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0810 15:26:19.607877 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 15:26:19.607978 (+ 101us) server_negotiation.cc:407] Connection header received
0810 15:26:19.608039 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:26:19.608039 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:26:19.608044 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:26:19.608085 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:26:19.608236 (+ 151us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46702: BlockingRecv error: recv got EOF from 127.0.0.1:46702 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
I20260810 15:26:19.608381 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 3556
I20260810 15:26:19.629343 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 3787
I20260810 15:26:19.640007 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 4006
I20260810 15:26:19.653609 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 3400
2026-08-10T15:26:19Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (598 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786375520124696-18706-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 15:26:19 dist-test-slave-2p8l krb5kdc[4241](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 15:26:19 dist-test-slave-2p8l krb5kdc[4241](info): set up 2 sockets
Aug 10 15:26:19 dist-test-slave-2p8l krb5kdc[4241](info): commencing operation
krb5kdc: starting...
W20260810 15:26:20.953473 18706 mini_kdc.cc:121] Time spent starting KDC: real 1.272s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786375520124696-18706-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786375520124696-18706-0/krb5kdc/test-user.keytab.
Aug 10 15:26:21 dist-test-slave-2p8l krb5kdc[4241](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375581, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T15:26:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T15:26:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.68.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.68.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.68.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab.
Entry for principal kudu/127.18.68.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab.
I20260810 15:26:21.081234 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786375520124696-18706-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786375520124696-18706-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786375520124696-18706-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.190:41749
--webserver_interface=127.18.68.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab
--principal=kudu/127.18.68.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:40729
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.68.190:41749
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:26:21.162611 4257 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:26:21.162813 4257 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:26:21.162835 4257 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:26:21.163914 4257 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 15:26:21.163950 4257 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:26:21.163965 4257 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:26:21.163978 4257 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 15:26:21.163990 4257 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 15:26:21.165433 4257 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:40729
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786375520124696-18706-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786375520124696-18706-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.68.190:41749
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab
--principal=kudu/127.18.68.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.190:41749
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.68.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4257
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786375520124696-18706-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:26:21.165693 4257 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:26:21.165874 4257 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:26:21.170701 4269 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:26:21.170714 4274 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:26:21.170740 4257 server_base.cc:1034] running on GCE node
W20260810 15:26:21.170718 4268 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:26:21.171151 4257 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:26:21.171443 4257 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:26:21.172585 4257 hybrid_clock.cc:648] HybridClock initialized: now 1786375581172573 us; error 29 us; skew 500 ppm
Aug 10 15:26:21 dist-test-slave-2p8l krb5kdc[4241](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375581, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:26:21.178227 4257 init.cc:377] Logged in from keytab as kudu/127.18.68.190@KRBTEST.COM (short username kudu)
I20260810 15:26:21.178716 4257 webserver.cc:460] Webserver started at http://127.18.68.190:39829/ using document root <none> and password file <none>
I20260810 15:26:21.178964 4257 fs_manager.cc:359] Metadata directory not provided
I20260810 15:26:21.179009 4257 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:26:21.179188 4257 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:26:21.180303 4257 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786375520124696-18706-0/minicluster-data/master-0/data/instance:
uuid: "e9b68f44db734ca08b60950a45d89cd0"
format_stamp: "Formatted at 2026-08-10 15:26:21 on dist-test-slave-2p8l"
server_key: "adf953785cfb0de9b92f6fd2b338ee4c"
server_key_iv: "e238266787f97b7151c95332404f49a8"
server_key_version: "encryptionkey@0"
I20260810 15:26:21.180771 4257 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786375520124696-18706-0/minicluster-data/master-0/wal/instance:
uuid: "e9b68f44db734ca08b60950a45d89cd0"
format_stamp: "Formatted at 2026-08-10 15:26:21 on dist-test-slave-2p8l"
server_key: "adf953785cfb0de9b92f6fd2b338ee4c"
server_key_iv: "e238266787f97b7151c95332404f49a8"
server_key_version: "encryptionkey@0"
I20260810 15:26:21.182257 4257 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 15:26:21.183082 4285 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:26:21.183301 4257 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:26:21.183408 4257 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786375520124696-18706-0/minicluster-data/master-0/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786375520124696-18706-0/minicluster-data/master-0/wal
uuid: "e9b68f44db734ca08b60950a45d89cd0"
format_stamp: "Formatted at 2026-08-10 15:26:21 on dist-test-slave-2p8l"
server_key: "adf953785cfb0de9b92f6fd2b338ee4c"
server_key_iv: "e238266787f97b7151c95332404f49a8"
server_key_version: "encryptionkey@0"
I20260810 15:26:21.183495 4257 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786375520124696-18706-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786375520124696-18706-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786375520124696-18706-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:26:21.199720 4257 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:26:21.201820 4257 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:26:21.202003 4257 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:26:21.206144 4257 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.190:41749
I20260810 15:26:21.206187 4387 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.190:41749 every 8 connection(s)
I20260810 15:26:21.206558 4257 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
I20260810 15:26:21.207597 4388 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:26:21.210423 4388 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e9b68f44db734ca08b60950a45d89cd0: Bootstrap starting.
I20260810 15:26:21.211028 4388 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e9b68f44db734ca08b60950a45d89cd0: Neither blocks nor log segments found. Creating new log.
I20260810 15:26:21.211324 4388 log.cc:824] T 00000000000000000000000000000000 P e9b68f44db734ca08b60950a45d89cd0: Log is configured to *not* fsync() on all Append() calls
I20260810 15:26:21.212040 4388 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e9b68f44db734ca08b60950a45d89cd0: No bootstrap required, opened a new log
I20260810 15:26:21.213588 4388 raft_consensus.cc:348] T 00000000000000000000000000000000 P e9b68f44db734ca08b60950a45d89cd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9b68f44db734ca08b60950a45d89cd0" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 41749 } }
I20260810 15:26:21.213747 4388 raft_consensus.cc:374] T 00000000000000000000000000000000 P e9b68f44db734ca08b60950a45d89cd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:26:21.213806 4388 raft_consensus.cc:729] T 00000000000000000000000000000000 P e9b68f44db734ca08b60950a45d89cd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9b68f44db734ca08b60950a45d89cd0, State: Initialized, Role: FOLLOWER
I20260810 15:26:21.213973 4388 consensus_queue.cc:260] T 00000000000000000000000000000000 P e9b68f44db734ca08b60950a45d89cd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9b68f44db734ca08b60950a45d89cd0" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 41749 } }
I20260810 15:26:21.214094 4388 raft_consensus.cc:388] T 00000000000000000000000000000000 P e9b68f44db734ca08b60950a45d89cd0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 15:26:21.214133 4388 raft_consensus.cc:482] T 00000000000000000000000000000000 P e9b68f44db734ca08b60950a45d89cd0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 15:26:21.214181 4388 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e9b68f44db734ca08b60950a45d89cd0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:26:21.214962 4388 raft_consensus.cc:504] T 00000000000000000000000000000000 P e9b68f44db734ca08b60950a45d89cd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9b68f44db734ca08b60950a45d89cd0" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 41749 } }
I20260810 15:26:21.215050 4388 leader_election.cc:302] T 00000000000000000000000000000000 P e9b68f44db734ca08b60950a45d89cd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e9b68f44db734ca08b60950a45d89cd0; no voters:
I20260810 15:26:21.215231 4388 leader_election.cc:288] T 00000000000000000000000000000000 P e9b68f44db734ca08b60950a45d89cd0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 15:26:21.215305 4392 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e9b68f44db734ca08b60950a45d89cd0 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 15:26:21.215461 4392 raft_consensus.cc:686] T 00000000000000000000000000000000 P e9b68f44db734ca08b60950a45d89cd0 [term 1 LEADER]: Becoming Leader. State: Replica: e9b68f44db734ca08b60950a45d89cd0, State: Running, Role: LEADER
I20260810 15:26:21.215499 4388 sys_catalog.cc:564] T 00000000000000000000000000000000 P e9b68f44db734ca08b60950a45d89cd0 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 15:26:21.215543 4392 consensus_queue.cc:237] T 00000000000000000000000000000000 P e9b68f44db734ca08b60950a45d89cd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9b68f44db734ca08b60950a45d89cd0" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 41749 } }
I20260810 15:26:21.215912 4394 sys_catalog.cc:455] T 00000000000000000000000000000000 P e9b68f44db734ca08b60950a45d89cd0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e9b68f44db734ca08b60950a45d89cd0. Latest consensus state: current_term: 1 leader_uuid: "e9b68f44db734ca08b60950a45d89cd0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9b68f44db734ca08b60950a45d89cd0" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 41749 } } }
I20260810 15:26:21.216027 4394 sys_catalog.cc:458] T 00000000000000000000000000000000 P e9b68f44db734ca08b60950a45d89cd0 [sys.catalog]: This master's current role is: LEADER
I20260810 15:26:21.215900 4393 sys_catalog.cc:455] T 00000000000000000000000000000000 P e9b68f44db734ca08b60950a45d89cd0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e9b68f44db734ca08b60950a45d89cd0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9b68f44db734ca08b60950a45d89cd0" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 41749 } } }
I20260810 15:26:21.216138 4393 sys_catalog.cc:458] T 00000000000000000000000000000000 P e9b68f44db734ca08b60950a45d89cd0 [sys.catalog]: This master's current role is: LEADER
I20260810 15:26:21.216390 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 4257
I20260810 15:26:21.216490 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786375520124696-18706-0/minicluster-data/master-0/wal/instance
I20260810 15:26:21.216709 18706 external_mini_cluster.cc:1428] Setting key 87d3795276d127c3930545f89912c466
I20260810 15:26:21.216867 4406 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 15:26:21.217654 4406 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 15:26:21.219462 4406 catalog_manager.cc:1347] Generated new cluster ID: 59bcce751b934987bf23752609a336c5
I20260810 15:26:21.219523 4406 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 10 15:26:21 dist-test-slave-2p8l krb5kdc[4241](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375581, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
I20260810 15:26:21.227705 4422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:26:21.217428 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55010 (local address 127.18.68.190:41749)
0810 15:26:21.217859 (+ 431us) server_negotiation.cc:206] Beginning negotiation
0810 15:26:21.217869 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 15:26:21.217902 (+ 33us) server_negotiation.cc:407] Connection header received
0810 15:26:21.218001 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:26:21.218007 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:26:21.218049 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:26:21.218263 (+ 214us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:26:21.218887 (+ 624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:21.220036 (+ 1149us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:21.220804 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:21.221222 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:21.221351 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:21.223773 (+ 2422us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:26:21.223777 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:26:21.223777 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:26:21.223789 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:26:21.226129 (+ 2340us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:26:21.226503 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:26:21.226506 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:26:21.226507 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:26:21.226611 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:26:21.226830 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:26:21.226831 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:26:21.226832 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:26:21.227062 (+ 230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:26:21.227237 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0810 15:26:21.227344 (+ 107us) server_negotiation.cc:299] Negotiation successful
0810 15:26:21.227488 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":339,"thread_start_us":86,"threads_started":1}
I20260810 15:26:21.231467 4406 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 15:26:21.231957 4406 catalog_manager.cc:1504] Loading token signing keys...
I20260810 15:26:21.243191 4406 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e9b68f44db734ca08b60950a45d89cd0: Generated new TSK 0
I20260810 15:26:21.243405 4406 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.18.68.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.68.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.68.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.129.keytab.
Entry for principal kudu/127.18.68.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.129.keytab.
I20260810 15:26:21.277202 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786375520124696-18706-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786375520124696-18706-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786375520124696-18706-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786375520124696-18706-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.68.129:0
--local_ip_for_outbound_sockets=127.18.68.129
--webserver_interface=127.18.68.129
--webserver_port=0
--tserver_master_addrs=127.18.68.190:41749
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.129.keytab
--principal=kudu/127.18.68.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:40729
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:26:21.359717 4428 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:26:21.359925 4428 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:26:21.359949 4428 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:26:21.361105 4428 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:26:21.361148 4428 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:26:21.361176 4428 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.68.129
I20260810 15:26:21.362731 4428 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:40729
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786375520124696-18706-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786375520124696-18706-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.129.keytab
--principal=kudu/127.18.68.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.68.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786375520124696-18706-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.68.129
--webserver_port=0
--tserver_master_addrs=127.18.68.190:41749
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4428
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.68.129
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786375520124696-18706-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:26:21.362972 4428 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:26:21.363221 4428 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:26:21.368346 4436 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:26:21.368397 4428 server_base.cc:1034] running on GCE node
W20260810 15:26:21.368340 4439 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:26:21.368340 4441 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:26:21.368754 4428 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:26:21.368968 4428 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:26:21.370178 4428 hybrid_clock.cc:648] HybridClock initialized: now 1786375581370161 us; error 39 us; skew 500 ppm
Aug 10 15:26:21 dist-test-slave-2p8l krb5kdc[4241](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375581, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:26:21.372851 4428 init.cc:377] Logged in from keytab as kudu/127.18.68.129@KRBTEST.COM (short username kudu)
I20260810 15:26:21.373273 4428 webserver.cc:460] Webserver started at http://127.18.68.129:42377/ using document root <none> and password file <none>
I20260810 15:26:21.373486 4428 fs_manager.cc:359] Metadata directory not provided
I20260810 15:26:21.373529 4428 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:26:21.373669 4428 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:26:21.374764 4428 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786375520124696-18706-0/minicluster-data/ts-0/data/instance:
uuid: "06b09a929d7745398feb52fc9fe2e2f1"
format_stamp: "Formatted at 2026-08-10 15:26:21 on dist-test-slave-2p8l"
server_key: "fb962d51d6b6eced64785d740475933e"
server_key_iv: "2ba23a1e927730cad8e39caa5d186f72"
server_key_version: "encryptionkey@0"
I20260810 15:26:21.375114 4428 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786375520124696-18706-0/minicluster-data/ts-0/wal/instance:
uuid: "06b09a929d7745398feb52fc9fe2e2f1"
format_stamp: "Formatted at 2026-08-10 15:26:21 on dist-test-slave-2p8l"
server_key: "fb962d51d6b6eced64785d740475933e"
server_key_iv: "2ba23a1e927730cad8e39caa5d186f72"
server_key_version: "encryptionkey@0"
I20260810 15:26:21.376425 4428 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 15:26:21.377134 4456 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:26:21.377322 4428 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 15:26:21.377416 4428 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786375520124696-18706-0/minicluster-data/ts-0/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786375520124696-18706-0/minicluster-data/ts-0/wal
uuid: "06b09a929d7745398feb52fc9fe2e2f1"
format_stamp: "Formatted at 2026-08-10 15:26:21 on dist-test-slave-2p8l"
server_key: "fb962d51d6b6eced64785d740475933e"
server_key_iv: "2ba23a1e927730cad8e39caa5d186f72"
server_key_version: "encryptionkey@0"
I20260810 15:26:21.377485 4428 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786375520124696-18706-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786375520124696-18706-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786375520124696-18706-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:26:21.397430 4428 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:26:21.399600 4428 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:26:21.399748 4428 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:26:21.399988 4428 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 15:26:21.400324 4428 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 15:26:21.400382 4428 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 15:26:21.400424 4428 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 15:26:21.400451 4428 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 15:26:21.406594 4428 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.129:34289
I20260810 15:26:21.406692 4657 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.129:34289 every 8 connection(s)
I20260810 15:26:21.406989 4428 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786375520124696-18706-0/minicluster-data/ts-0/data/info.pb
I20260810 15:26:21.412542 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 4428
I20260810 15:26:21.412660 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786375520124696-18706-0/minicluster-data/ts-0/wal/instance
I20260810 15:26:21.412884 18706 external_mini_cluster.cc:1428] Setting key d1bc077bfc9cc6c74e52775e2e5fb914
Aug 10 15:26:21 dist-test-slave-2p8l krb5kdc[4241](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375581, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.129@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
I20260810 15:26:21.416860 4422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:26:21.407776 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.129:58059 (local address 127.18.68.190:41749)
0810 15:26:21.407839 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0810 15:26:21.407841 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:26:21.408019 (+ 178us) server_negotiation.cc:407] Connection header received
0810 15:26:21.408532 (+ 513us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:26:21.408533 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:26:21.408545 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:26:21.408605 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:26:21.409491 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:21.409997 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:21.410991 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:21.411188 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:21.411244 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:21.413584 (+ 2340us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:26:21.413586 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:26:21.413586 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:26:21.413592 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:26:21.415260 (+ 1668us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:26:21.415800 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:26:21.415802 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:26:21.415802 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:26:21.415867 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:26:21.416144 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:26:21.416145 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:26:21.416145 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:26:21.416263 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:26:21.416340 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0810 15:26:21.416650 (+ 310us) server_negotiation.cc:299] Negotiation successful
0810 15:26:21.416770 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260810 15:26:21.416994 4662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:26:21.407745 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:41749 (local address 127.18.68.129:58059)
0810 15:26:21.407893 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0810 15:26:21.407934 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0810 15:26:21.408448 (+ 514us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:26:21.408654 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:26:21.408657 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:26:21.409226 (+ 569us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:26:21.409416 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:21.409420 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:21.410121 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:21.410121 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:21.410919 (+ 798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:21.410921 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:21.411265 (+ 344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:21.411266 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:21.411362 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:21.411791 (+ 429us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:26:21.411798 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:26:21.413476 (+ 1678us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:26:21.415344 (+ 1868us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:26:21.415351 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:26:21.415353 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:26:21.415708 (+ 355us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:26:21.415939 (+ 231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:26:21.415940 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:26:21.415940 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:26:21.416056 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:26:21.416343 (+ 287us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:26:21.416350 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:26:21.416506 (+ 156us) client_negotiation.cc:769] Sending connection context
0810 15:26:21.416618 (+ 112us) client_negotiation.cc:240] Negotiation successful
0810 15:26:21.416773 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":78,"threads_started":1}
I20260810 15:26:21.417505 4660 heartbeater.cc:347] Connected to a master server at 127.18.68.190:41749
I20260810 15:26:21.417608 4660 heartbeater.cc:464] Registering TS with master...
I20260810 15:26:21.417797 4660 heartbeater.cc:511] Master 127.18.68.190:41749 requested a full tablet report, sending...
I20260810 15:26:21.418339 4319 ts_manager.cc:194] Registered new tserver with Master: 06b09a929d7745398feb52fc9fe2e2f1 (127.18.68.129:34289)
I20260810 15:26:21.418962 4319 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.68.129@KRBTEST.COM'} at 127.18.68.129:58059
WARNING: no policy specified for kudu/127.18.68.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.68.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.68.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.130.keytab.
Entry for principal kudu/127.18.68.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.130.keytab.
I20260810 15:26:21.438797 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786375520124696-18706-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786375520124696-18706-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786375520124696-18706-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786375520124696-18706-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.68.130:0
--local_ip_for_outbound_sockets=127.18.68.130
--webserver_interface=127.18.68.130
--webserver_port=0
--tserver_master_addrs=127.18.68.190:41749
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.130.keytab
--principal=kudu/127.18.68.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:40729
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:26:21.519996 4672 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:26:21.520221 4672 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:26:21.520260 4672 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:26:21.521377 4672 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:26:21.521437 4672 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:26:21.521478 4672 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.68.130
I20260810 15:26:21.523008 4672 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:40729
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786375520124696-18706-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786375520124696-18706-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.130.keytab
--principal=kudu/127.18.68.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.68.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786375520124696-18706-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.68.130
--webserver_port=0
--tserver_master_addrs=127.18.68.190:41749
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4672
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.68.130
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786375520124696-18706-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:26:21.523268 4672 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:26:21.523490 4672 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:26:21.528563 4679 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:26:21.528481 4680 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:26:21.528618 4672 server_base.cc:1034] running on GCE node
W20260810 15:26:21.528479 4688 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:26:21.528985 4672 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:26:21.529196 4672 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:26:21.530370 4672 hybrid_clock.cc:648] HybridClock initialized: now 1786375581530361 us; error 28 us; skew 500 ppm
Aug 10 15:26:21 dist-test-slave-2p8l krb5kdc[4241](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375581, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:26:21.532981 4672 init.cc:377] Logged in from keytab as kudu/127.18.68.130@KRBTEST.COM (short username kudu)
I20260810 15:26:21.533454 4672 webserver.cc:460] Webserver started at http://127.18.68.130:35939/ using document root <none> and password file <none>
I20260810 15:26:21.533710 4672 fs_manager.cc:359] Metadata directory not provided
I20260810 15:26:21.533782 4672 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:26:21.533931 4672 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:26:21.535022 4672 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786375520124696-18706-0/minicluster-data/ts-1/data/instance:
uuid: "1bd774dc8f8e4745a919151dfbceb0e8"
format_stamp: "Formatted at 2026-08-10 15:26:21 on dist-test-slave-2p8l"
server_key: "d8469c4e8a549c162c712326ba3fe4c1"
server_key_iv: "ef843dae86689991388dff14aa9b4035"
server_key_version: "encryptionkey@0"
I20260810 15:26:21.535395 4672 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786375520124696-18706-0/minicluster-data/ts-1/wal/instance:
uuid: "1bd774dc8f8e4745a919151dfbceb0e8"
format_stamp: "Formatted at 2026-08-10 15:26:21 on dist-test-slave-2p8l"
server_key: "d8469c4e8a549c162c712326ba3fe4c1"
server_key_iv: "ef843dae86689991388dff14aa9b4035"
server_key_version: "encryptionkey@0"
I20260810 15:26:21.536728 4672 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 15:26:21.537497 4702 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:26:21.537696 4672 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:26:21.537789 4672 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786375520124696-18706-0/minicluster-data/ts-1/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786375520124696-18706-0/minicluster-data/ts-1/wal
uuid: "1bd774dc8f8e4745a919151dfbceb0e8"
format_stamp: "Formatted at 2026-08-10 15:26:21 on dist-test-slave-2p8l"
server_key: "d8469c4e8a549c162c712326ba3fe4c1"
server_key_iv: "ef843dae86689991388dff14aa9b4035"
server_key_version: "encryptionkey@0"
I20260810 15:26:21.537875 4672 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786375520124696-18706-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786375520124696-18706-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786375520124696-18706-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:26:21.550446 4672 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:26:21.552327 4672 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:26:21.552493 4672 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:26:21.552731 4672 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 15:26:21.553045 4672 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 15:26:21.553100 4672 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 15:26:21.553141 4672 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 15:26:21.553176 4672 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 15:26:21.559092 4672 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.130:39031
I20260810 15:26:21.559154 4893 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.130:39031 every 8 connection(s)
I20260810 15:26:21.559458 4672 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786375520124696-18706-0/minicluster-data/ts-1/data/info.pb
I20260810 15:26:21.563324 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 4672
I20260810 15:26:21.563442 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786375520124696-18706-0/minicluster-data/ts-1/wal/instance
I20260810 15:26:21.563678 18706 external_mini_cluster.cc:1428] Setting key f26cb664a07eb63c065b090c9015ceeb
Aug 10 15:26:21 dist-test-slave-2p8l krb5kdc[4241](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375581, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.130@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
I20260810 15:26:21.569832 4422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:26:21.560228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.130:45697 (local address 127.18.68.190:41749)
0810 15:26:21.560276 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0810 15:26:21.560278 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:26:21.560528 (+ 250us) server_negotiation.cc:407] Connection header received
0810 15:26:21.561083 (+ 555us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:26:21.561084 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:26:21.561096 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:26:21.561151 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:26:21.562134 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:21.562663 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:21.564040 (+ 1377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:21.564241 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:21.564323 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:21.566963 (+ 2640us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:26:21.566964 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:26:21.566965 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:26:21.566972 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:26:21.568300 (+ 1328us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:26:21.568844 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:26:21.568845 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:26:21.568845 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:26:21.568899 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:26:21.569215 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:26:21.569215 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:26:21.569215 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:26:21.569316 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:26:21.569369 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0810 15:26:21.569703 (+ 334us) server_negotiation.cc:299] Negotiation successful
0810 15:26:21.569771 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260810 15:26:21.570183 4898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:26:21.560197 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:41749 (local address 127.18.68.130:45697)
0810 15:26:21.560406 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0810 15:26:21.560443 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0810 15:26:21.560971 (+ 528us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:26:21.561232 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:26:21.561236 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:26:21.561815 (+ 579us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:26:21.562000 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:21.562005 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:21.562768 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:21.562769 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:21.563946 (+ 1177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:21.563949 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:21.564330 (+ 381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:21.564331 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:21.564459 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:21.565004 (+ 545us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:26:21.565014 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:26:21.566862 (+ 1848us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:26:21.568385 (+ 1523us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:26:21.568392 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:26:21.568395 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:26:21.568761 (+ 366us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:26:21.568972 (+ 211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:26:21.568973 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:26:21.568973 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:26:21.569141 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:26:21.569389 (+ 248us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:26:21.569395 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:26:21.569561 (+ 166us) client_negotiation.cc:769] Sending connection context
0810 15:26:21.569684 (+ 123us) client_negotiation.cc:240] Negotiation successful
0810 15:26:21.569868 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":94,"threads_started":1}
I20260810 15:26:21.570725 4895 heartbeater.cc:347] Connected to a master server at 127.18.68.190:41749
I20260810 15:26:21.570819 4895 heartbeater.cc:464] Registering TS with master...
I20260810 15:26:21.570994 4895 heartbeater.cc:511] Master 127.18.68.190:41749 requested a full tablet report, sending...
I20260810 15:26:21.571393 4319 ts_manager.cc:194] Registered new tserver with Master: 1bd774dc8f8e4745a919151dfbceb0e8 (127.18.68.130:39031)
I20260810 15:26:21.571781 4319 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.68.130@KRBTEST.COM'} at 127.18.68.130:45697
WARNING: no policy specified for kudu/127.18.68.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.68.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.68.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.131.keytab.
Entry for principal kudu/127.18.68.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.131.keytab.
I20260810 15:26:21.590117 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786375520124696-18706-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786375520124696-18706-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786375520124696-18706-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786375520124696-18706-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.68.131:0
--local_ip_for_outbound_sockets=127.18.68.131
--webserver_interface=127.18.68.131
--webserver_port=0
--tserver_master_addrs=127.18.68.190:41749
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.131.keytab
--principal=kudu/127.18.68.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:40729
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:26:21.672276 4901 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:26:21.672544 4901 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:26:21.672600 4901 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:26:21.673828 4901 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:26:21.673906 4901 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:26:21.673951 4901 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.68.131
I20260810 15:26:21.675482 4901 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:40729
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786375520124696-18706-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786375520124696-18706-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.131.keytab
--principal=kudu/127.18.68.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.68.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786375520124696-18706-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.68.131
--webserver_port=0
--tserver_master_addrs=127.18.68.190:41749
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4901
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.68.131
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786375520124696-18706-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:26:21.675766 4901 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:26:21.676009 4901 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:26:21.681203 4913 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:26:21.681245 4910 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:26:21.681237 4909 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:26:21.681308 4901 server_base.cc:1034] running on GCE node
I20260810 15:26:21.681526 4901 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:26:21.681782 4901 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:26:21.682966 4901 hybrid_clock.cc:648] HybridClock initialized: now 1786375581682935 us; error 45 us; skew 500 ppm
Aug 10 15:26:21 dist-test-slave-2p8l krb5kdc[4241](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375581, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:26:21.685554 4901 init.cc:377] Logged in from keytab as kudu/127.18.68.131@KRBTEST.COM (short username kudu)
I20260810 15:26:21.686053 4901 webserver.cc:460] Webserver started at http://127.18.68.131:37175/ using document root <none> and password file <none>
I20260810 15:26:21.686352 4901 fs_manager.cc:359] Metadata directory not provided
I20260810 15:26:21.686399 4901 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:26:21.686530 4901 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:26:21.687631 4901 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786375520124696-18706-0/minicluster-data/ts-2/data/instance:
uuid: "5b7e6ca13f9846cdbb96236a0ae04f6b"
format_stamp: "Formatted at 2026-08-10 15:26:21 on dist-test-slave-2p8l"
server_key: "e2bb0fcd0a646541a723eb194ce8a8e6"
server_key_iv: "9a45d600c20c1a0408720e1e42f6c601"
server_key_version: "encryptionkey@0"
I20260810 15:26:21.687989 4901 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786375520124696-18706-0/minicluster-data/ts-2/wal/instance:
uuid: "5b7e6ca13f9846cdbb96236a0ae04f6b"
format_stamp: "Formatted at 2026-08-10 15:26:21 on dist-test-slave-2p8l"
server_key: "e2bb0fcd0a646541a723eb194ce8a8e6"
server_key_iv: "9a45d600c20c1a0408720e1e42f6c601"
server_key_version: "encryptionkey@0"
I20260810 15:26:21.689306 4901 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 15:26:21.690088 4928 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:26:21.690322 4901 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:26:21.690428 4901 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786375520124696-18706-0/minicluster-data/ts-2/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786375520124696-18706-0/minicluster-data/ts-2/wal
uuid: "5b7e6ca13f9846cdbb96236a0ae04f6b"
format_stamp: "Formatted at 2026-08-10 15:26:21 on dist-test-slave-2p8l"
server_key: "e2bb0fcd0a646541a723eb194ce8a8e6"
server_key_iv: "9a45d600c20c1a0408720e1e42f6c601"
server_key_version: "encryptionkey@0"
I20260810 15:26:21.690510 4901 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786375520124696-18706-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786375520124696-18706-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786375520124696-18706-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:26:21.721210 4901 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:26:21.723729 4901 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:26:21.723906 4901 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:26:21.724176 4901 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 15:26:21.724522 4901 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 15:26:21.724581 4901 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 15:26:21.724624 4901 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 15:26:21.724670 4901 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 15:26:21.730998 4901 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.131:36633
I20260810 15:26:21.731045 5124 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.131:36633 every 8 connection(s)
I20260810 15:26:21.731397 4901 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786375520124696-18706-0/minicluster-data/ts-2/data/info.pb
I20260810 15:26:21.735183 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 4901
I20260810 15:26:21.735302 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786375520124696-18706-0/minicluster-data/ts-2/wal/instance
I20260810 15:26:21.735515 18706 external_mini_cluster.cc:1428] Setting key c89125e7204e4f6b8d09c13366c282cc
Aug 10 15:26:21 dist-test-slave-2p8l krb5kdc[4241](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375581, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.131@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
I20260810 15:26:21.741024 4422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:26:21.732171 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.131:55621 (local address 127.18.68.190:41749)
0810 15:26:21.732245 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0810 15:26:21.732247 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:26:21.732460 (+ 213us) server_negotiation.cc:407] Connection header received
0810 15:26:21.732934 (+ 474us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:26:21.732935 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:26:21.732946 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:26:21.732995 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:26:21.733900 (+ 905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:21.734449 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:21.735887 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:21.736147 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:21.736198 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:21.738474 (+ 2276us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:26:21.738475 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:26:21.738475 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:26:21.738482 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:26:21.739692 (+ 1210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:26:21.740062 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:26:21.740062 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:26:21.740063 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:26:21.740113 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:26:21.740330 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:26:21.740330 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:26:21.740330 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:26:21.740440 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:26:21.740623 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0810 15:26:21.740890 (+ 267us) server_negotiation.cc:299] Negotiation successful
0810 15:26:21.740960 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260810 15:26:21.741134 5130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:26:21.732167 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:41749 (local address 127.18.68.131:55621)
0810 15:26:21.732339 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0810 15:26:21.732375 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0810 15:26:21.732855 (+ 480us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:26:21.733054 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:26:21.733057 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:26:21.733609 (+ 552us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:26:21.733826 (+ 217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:21.733831 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:21.734560 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:21.734560 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:21.735782 (+ 1222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:21.735785 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:21.736233 (+ 448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:21.736235 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:21.736396 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:21.736896 (+ 500us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:26:21.736904 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:26:21.738330 (+ 1426us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:26:21.739767 (+ 1437us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:26:21.739773 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:26:21.739775 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:26:21.739992 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:26:21.740172 (+ 180us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:26:21.740172 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:26:21.740173 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:26:21.740271 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:26:21.740613 (+ 342us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:26:21.740621 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:26:21.740739 (+ 118us) client_negotiation.cc:769] Sending connection context
0810 15:26:21.740829 (+ 90us) client_negotiation.cc:240] Negotiation successful
0810 15:26:21.740949 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":92,"threads_started":1}
I20260810 15:26:21.741652 5125 heartbeater.cc:347] Connected to a master server at 127.18.68.190:41749
I20260810 15:26:21.741750 5125 heartbeater.cc:464] Registering TS with master...
I20260810 15:26:21.741894 5125 heartbeater.cc:511] Master 127.18.68.190:41749 requested a full tablet report, sending...
I20260810 15:26:21.742271 4319 ts_manager.cc:194] Registered new tserver with Master: 5b7e6ca13f9846cdbb96236a0ae04f6b (127.18.68.131:36633)
I20260810 15:26:21.742597 4319 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.68.131@KRBTEST.COM'} at 127.18.68.131:55621
I20260810 15:26:21.747458 18706 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 15:26:21.754642 4422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:26:21.748757 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55024 (local address 127.18.68.190:41749)
0810 15:26:21.748819 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0810 15:26:21.748820 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 15:26:21.748879 (+ 59us) server_negotiation.cc:407] Connection header received
0810 15:26:21.748931 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:26:21.748931 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:26:21.748940 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:26:21.748987 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:26:21.749490 (+ 503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:21.749987 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:21.750721 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:21.750904 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:21.750964 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:21.752057 (+ 1093us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:26:21.752059 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:26:21.752059 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:26:21.752065 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:26:21.753500 (+ 1435us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:26:21.753800 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:26:21.753801 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:26:21.753801 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:26:21.753850 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:26:21.754052 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:26:21.754054 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:26:21.754054 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:26:21.754272 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:26:21.754362 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0810 15:26:21.754511 (+ 149us) server_negotiation.cc:299] Negotiation successful
0810 15:26:21.754580 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260810 15:26:21.756316 4319 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55024:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 15:26:21.757831 4319 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 15:26:21.764458 5149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:26:21.760473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.129:34289 (local address 127.0.0.1:50766)
0810 15:26:21.760655 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0810 15:26:21.760695 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0810 15:26:21.760763 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:26:21.761114 (+ 351us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:26:21.761117 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:26:21.761120 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:26:21.761192 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:21.761194 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:21.762213 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:21.762214 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:21.763362 (+ 1148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:21.763364 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:21.764168 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:21.764169 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:21.764250 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:21.764264 (+ 14us) client_negotiation.cc:769] Sending connection context
0810 15:26:21.764339 (+ 75us) client_negotiation.cc:240] Negotiation successful
0810 15:26:21.764385 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":65,"threads_started":1}
I20260810 15:26:21.764757 5153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:26:21.760569 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50766 (local address 127.18.68.129:34289)
0810 15:26:21.760919 (+ 350us) server_negotiation.cc:206] Beginning negotiation
0810 15:26:21.760924 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 15:26:21.760934 (+ 10us) server_negotiation.cc:407] Connection header received
0810 15:26:21.760976 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:26:21.760979 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:26:21.760995 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:26:21.761271 (+ 276us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:26:21.761344 (+ 73us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:21.762105 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:21.763439 (+ 1334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:21.764076 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:21.764151 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:21.764213 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0810 15:26:21.764373 (+ 160us) server_negotiation.cc:299] Negotiation successful
0810 15:26:21.764413 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":310,"thread_start_us":84,"threads_started":1}
I20260810 15:26:21.764881 5150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:26:21.760539 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.131:36633 (local address 127.0.0.1:49456)
0810 15:26:21.760953 (+ 414us) negotiation.cc:107] Waiting for socket to connect
0810 15:26:21.760962 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 15:26:21.761001 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:26:21.761270 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:26:21.761271 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:26:21.761273 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:26:21.761320 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:21.761322 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:21.762662 (+ 1340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:21.762663 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:21.763636 (+ 973us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:21.763638 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:21.764620 (+ 982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:21.764621 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:21.764690 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:21.764694 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 15:26:21.764751 (+ 57us) client_negotiation.cc:240] Negotiation successful
0810 15:26:21.764795 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":398,"mutex_wait_us":13,"thread_start_us":89,"threads_started":1}
I20260810 15:26:21.765033 5155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:26:21.760800 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49456 (local address 127.18.68.131:36633)
0810 15:26:21.761037 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0810 15:26:21.761049 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 15:26:21.761058 (+ 9us) server_negotiation.cc:407] Connection header received
0810 15:26:21.761108 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:26:21.761110 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:26:21.761126 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:26:21.761201 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:26:21.761401 (+ 200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:21.762544 (+ 1143us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:21.763726 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:21.764440 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:21.764521 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:21.764581 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0810 15:26:21.764787 (+ 206us) server_negotiation.cc:299] Negotiation successful
0810 15:26:21.764831 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":197,"thread_start_us":112,"threads_started":1}
I20260810 15:26:21.765717 5152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:26:21.760539 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.130:39031 (local address 127.0.0.1:54364)
0810 15:26:21.760803 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0810 15:26:21.760814 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 15:26:21.760874 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:26:21.761305 (+ 431us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:26:21.761305 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:26:21.761307 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:26:21.761380 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:21.761381 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:21.763717 (+ 2336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:21.763718 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:21.764579 (+ 861us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:21.764582 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:21.765481 (+ 899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:21.765482 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:21.765553 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:21.765557 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 15:26:21.765616 (+ 59us) client_negotiation.cc:240] Negotiation successful
0810 15:26:21.765654 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":242,"thread_start_us":99,"threads_started":1}
I20260810 15:26:21.765745 5154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:26:21.760792 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54364 (local address 127.18.68.130:39031)
0810 15:26:21.761000 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0810 15:26:21.761081 (+ 81us) server_negotiation.cc:399] Waiting for connection header
0810 15:26:21.761090 (+ 9us) server_negotiation.cc:407] Connection header received
0810 15:26:21.761129 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:26:21.761131 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:26:21.761147 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:26:21.761224 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:26:21.761463 (+ 239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:21.762562 (+ 1099us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:21.764671 (+ 2109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:21.765407 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:21.765479 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:21.765531 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0810 15:26:21.765629 (+ 98us) server_negotiation.cc:299] Negotiation successful
0810 15:26:21.765670 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":180,"thread_start_us":98,"threads_started":1}
I20260810 15:26:21.765812 4542 tablet_service.cc:1467] Processing CreateTablet for tablet 314ef11626b8472eb3f4e8f4892f63c6 (DEFAULT_TABLE table=test-table [id=e4d615d0d340452680c1f9c28d404001]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 15:26:21.766289 4542 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 314ef11626b8472eb3f4e8f4892f63c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:26:21.766597 5012 tablet_service.cc:1467] Processing CreateTablet for tablet 314ef11626b8472eb3f4e8f4892f63c6 (DEFAULT_TABLE table=test-table [id=e4d615d0d340452680c1f9c28d404001]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 15:26:21.766723 4786 tablet_service.cc:1467] Processing CreateTablet for tablet 314ef11626b8472eb3f4e8f4892f63c6 (DEFAULT_TABLE table=test-table [id=e4d615d0d340452680c1f9c28d404001]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 15:26:21.766930 5012 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 314ef11626b8472eb3f4e8f4892f63c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:26:21.767004 4786 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 314ef11626b8472eb3f4e8f4892f63c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:26:21.769172 5158 tablet_bootstrap.cc:492] T 314ef11626b8472eb3f4e8f4892f63c6 P 06b09a929d7745398feb52fc9fe2e2f1: Bootstrap starting.
I20260810 15:26:21.769775 5158 tablet_bootstrap.cc:654] T 314ef11626b8472eb3f4e8f4892f63c6 P 06b09a929d7745398feb52fc9fe2e2f1: Neither blocks nor log segments found. Creating new log.
I20260810 15:26:21.770242 5160 tablet_bootstrap.cc:492] T 314ef11626b8472eb3f4e8f4892f63c6 P 1bd774dc8f8e4745a919151dfbceb0e8: Bootstrap starting.
I20260810 15:26:21.770443 5162 tablet_bootstrap.cc:492] T 314ef11626b8472eb3f4e8f4892f63c6 P 5b7e6ca13f9846cdbb96236a0ae04f6b: Bootstrap starting.
I20260810 15:26:21.770558 5158 log.cc:824] T 314ef11626b8472eb3f4e8f4892f63c6 P 06b09a929d7745398feb52fc9fe2e2f1: Log is configured to *not* fsync() on all Append() calls
I20260810 15:26:21.770910 5160 tablet_bootstrap.cc:654] T 314ef11626b8472eb3f4e8f4892f63c6 P 1bd774dc8f8e4745a919151dfbceb0e8: Neither blocks nor log segments found. Creating new log.
I20260810 15:26:21.771134 5162 tablet_bootstrap.cc:654] T 314ef11626b8472eb3f4e8f4892f63c6 P 5b7e6ca13f9846cdbb96236a0ae04f6b: Neither blocks nor log segments found. Creating new log.
I20260810 15:26:21.771454 5160 log.cc:824] T 314ef11626b8472eb3f4e8f4892f63c6 P 1bd774dc8f8e4745a919151dfbceb0e8: Log is configured to *not* fsync() on all Append() calls
I20260810 15:26:21.771519 5158 tablet_bootstrap.cc:492] T 314ef11626b8472eb3f4e8f4892f63c6 P 06b09a929d7745398feb52fc9fe2e2f1: No bootstrap required, opened a new log
I20260810 15:26:21.771647 5158 ts_tablet_manager.cc:1397] T 314ef11626b8472eb3f4e8f4892f63c6 P 06b09a929d7745398feb52fc9fe2e2f1: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260810 15:26:21.771662 5162 log.cc:824] T 314ef11626b8472eb3f4e8f4892f63c6 P 5b7e6ca13f9846cdbb96236a0ae04f6b: Log is configured to *not* fsync() on all Append() calls
I20260810 15:26:21.772212 5160 tablet_bootstrap.cc:492] T 314ef11626b8472eb3f4e8f4892f63c6 P 1bd774dc8f8e4745a919151dfbceb0e8: No bootstrap required, opened a new log
I20260810 15:26:21.772282 5160 ts_tablet_manager.cc:1397] T 314ef11626b8472eb3f4e8f4892f63c6 P 1bd774dc8f8e4745a919151dfbceb0e8: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 15:26:21.772416 5162 tablet_bootstrap.cc:492] T 314ef11626b8472eb3f4e8f4892f63c6 P 5b7e6ca13f9846cdbb96236a0ae04f6b: No bootstrap required, opened a new log
I20260810 15:26:21.772506 5162 ts_tablet_manager.cc:1397] T 314ef11626b8472eb3f4e8f4892f63c6 P 5b7e6ca13f9846cdbb96236a0ae04f6b: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 15:26:21.773833 5162 raft_consensus.cc:348] T 314ef11626b8472eb3f4e8f4892f63c6 P 5b7e6ca13f9846cdbb96236a0ae04f6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06b09a929d7745398feb52fc9fe2e2f1" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 34289 } } peers { permanent_uuid: "1bd774dc8f8e4745a919151dfbceb0e8" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 39031 } } peers { permanent_uuid: "5b7e6ca13f9846cdbb96236a0ae04f6b" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 36633 } }
I20260810 15:26:21.773813 5158 raft_consensus.cc:348] T 314ef11626b8472eb3f4e8f4892f63c6 P 06b09a929d7745398feb52fc9fe2e2f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06b09a929d7745398feb52fc9fe2e2f1" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 34289 } } peers { permanent_uuid: "1bd774dc8f8e4745a919151dfbceb0e8" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 39031 } } peers { permanent_uuid: "5b7e6ca13f9846cdbb96236a0ae04f6b" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 36633 } }
I20260810 15:26:21.773985 5158 raft_consensus.cc:374] T 314ef11626b8472eb3f4e8f4892f63c6 P 06b09a929d7745398feb52fc9fe2e2f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:26:21.773986 5162 raft_consensus.cc:374] T 314ef11626b8472eb3f4e8f4892f63c6 P 5b7e6ca13f9846cdbb96236a0ae04f6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:26:21.774029 5162 raft_consensus.cc:729] T 314ef11626b8472eb3f4e8f4892f63c6 P 5b7e6ca13f9846cdbb96236a0ae04f6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b7e6ca13f9846cdbb96236a0ae04f6b, State: Initialized, Role: FOLLOWER
I20260810 15:26:21.774029 5158 raft_consensus.cc:729] T 314ef11626b8472eb3f4e8f4892f63c6 P 06b09a929d7745398feb52fc9fe2e2f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06b09a929d7745398feb52fc9fe2e2f1, State: Initialized, Role: FOLLOWER
I20260810 15:26:21.774169 5162 consensus_queue.cc:260] T 314ef11626b8472eb3f4e8f4892f63c6 P 5b7e6ca13f9846cdbb96236a0ae04f6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06b09a929d7745398feb52fc9fe2e2f1" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 34289 } } peers { permanent_uuid: "1bd774dc8f8e4745a919151dfbceb0e8" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 39031 } } peers { permanent_uuid: "5b7e6ca13f9846cdbb96236a0ae04f6b" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 36633 } }
I20260810 15:26:21.774209 5158 consensus_queue.cc:260] T 314ef11626b8472eb3f4e8f4892f63c6 P 06b09a929d7745398feb52fc9fe2e2f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06b09a929d7745398feb52fc9fe2e2f1" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 34289 } } peers { permanent_uuid: "1bd774dc8f8e4745a919151dfbceb0e8" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 39031 } } peers { permanent_uuid: "5b7e6ca13f9846cdbb96236a0ae04f6b" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 36633 } }
I20260810 15:26:21.774251 5160 raft_consensus.cc:348] T 314ef11626b8472eb3f4e8f4892f63c6 P 1bd774dc8f8e4745a919151dfbceb0e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06b09a929d7745398feb52fc9fe2e2f1" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 34289 } } peers { permanent_uuid: "1bd774dc8f8e4745a919151dfbceb0e8" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 39031 } } peers { permanent_uuid: "5b7e6ca13f9846cdbb96236a0ae04f6b" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 36633 } }
I20260810 15:26:21.774403 5160 raft_consensus.cc:374] T 314ef11626b8472eb3f4e8f4892f63c6 P 1bd774dc8f8e4745a919151dfbceb0e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:26:21.774448 5160 raft_consensus.cc:729] T 314ef11626b8472eb3f4e8f4892f63c6 P 1bd774dc8f8e4745a919151dfbceb0e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1bd774dc8f8e4745a919151dfbceb0e8, State: Initialized, Role: FOLLOWER
I20260810 15:26:21.774453 5162 ts_tablet_manager.cc:1428] T 314ef11626b8472eb3f4e8f4892f63c6 P 5b7e6ca13f9846cdbb96236a0ae04f6b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 15:26:21.774508 5158 ts_tablet_manager.cc:1428] T 314ef11626b8472eb3f4e8f4892f63c6 P 06b09a929d7745398feb52fc9fe2e2f1: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 15:26:21.774560 5160 consensus_queue.cc:260] T 314ef11626b8472eb3f4e8f4892f63c6 P 1bd774dc8f8e4745a919151dfbceb0e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06b09a929d7745398feb52fc9fe2e2f1" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 34289 } } peers { permanent_uuid: "1bd774dc8f8e4745a919151dfbceb0e8" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 39031 } } peers { permanent_uuid: "5b7e6ca13f9846cdbb96236a0ae04f6b" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 36633 } }
I20260810 15:26:21.774658 4660 heartbeater.cc:503] Master 127.18.68.190:41749 was elected leader, sending a full tablet report...
I20260810 15:26:21.774797 5125 heartbeater.cc:503] Master 127.18.68.190:41749 was elected leader, sending a full tablet report...
I20260810 15:26:21.774824 5160 ts_tablet_manager.cc:1428] T 314ef11626b8472eb3f4e8f4892f63c6 P 1bd774dc8f8e4745a919151dfbceb0e8: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260810 15:26:21.774968 4895 heartbeater.cc:503] Master 127.18.68.190:41749 was elected leader, sending a full tablet report...
W20260810 15:26:21.810024 4896 tablet.cc:2369] T 314ef11626b8472eb3f4e8f4892f63c6 P 1bd774dc8f8e4745a919151dfbceb0e8: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 15:26:21.907748 4661 tablet.cc:2369] T 314ef11626b8472eb3f4e8f4892f63c6 P 06b09a929d7745398feb52fc9fe2e2f1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 15:26:21.949949 5168 raft_consensus.cc:482] T 314ef11626b8472eb3f4e8f4892f63c6 P 5b7e6ca13f9846cdbb96236a0ae04f6b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 15:26:21.950124 5168 raft_consensus.cc:504] T 314ef11626b8472eb3f4e8f4892f63c6 P 5b7e6ca13f9846cdbb96236a0ae04f6b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06b09a929d7745398feb52fc9fe2e2f1" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 34289 } } peers { permanent_uuid: "1bd774dc8f8e4745a919151dfbceb0e8" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 39031 } } peers { permanent_uuid: "5b7e6ca13f9846cdbb96236a0ae04f6b" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 36633 } }
I20260810 15:26:21.950575 5168 leader_election.cc:288] T 314ef11626b8472eb3f4e8f4892f63c6 P 5b7e6ca13f9846cdbb96236a0ae04f6b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06b09a929d7745398feb52fc9fe2e2f1 (127.18.68.129:34289), 1bd774dc8f8e4745a919151dfbceb0e8 (127.18.68.130:39031)
I20260810 15:26:21.953395 5130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:26:21.950798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.129:34289 (local address 127.18.68.131:55227)
0810 15:26:21.950843 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0810 15:26:21.950857 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 15:26:21.950910 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:26:21.951070 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:26:21.951071 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:26:21.951072 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:26:21.951154 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:21.951156 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:21.951807 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:21.951809 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:21.952562 (+ 753us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:21.952564 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:21.953112 (+ 548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:21.953113 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:21.953194 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:21.953199 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 15:26:21.953280 (+ 81us) client_negotiation.cc:240] Negotiation successful
0810 15:26:21.953324 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":20}
I20260810 15:26:21.953395 5153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:26:21.950842 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.131:55227 (local address 127.18.68.129:34289)
0810 15:26:21.950893 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0810 15:26:21.950896 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 15:26:21.950908 (+ 12us) server_negotiation.cc:407] Connection header received
0810 15:26:21.950982 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:26:21.950983 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:26:21.950995 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:26:21.951068 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:26:21.951238 (+ 170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:21.951720 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:21.952656 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:21.953011 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:21.953114 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:21.953122 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0810 15:26:21.953290 (+ 168us) server_negotiation.cc:299] Negotiation successful
0810 15:26:21.953326 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260810 15:26:21.953768 5154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:26:21.950899 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.131:40463 (local address 127.18.68.130:39031)
0810 15:26:21.950967 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0810 15:26:21.950970 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 15:26:21.951212 (+ 242us) server_negotiation.cc:407] Connection header received
0810 15:26:21.951295 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:26:21.951296 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:26:21.951307 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:26:21.951353 (+ 46us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:26:21.951533 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:21.952010 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:21.952908 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:21.953391 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:21.953491 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:21.953499 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0810 15:26:21.953661 (+ 162us) server_negotiation.cc:299] Negotiation successful
0810 15:26:21.953704 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260810 15:26:21.953773 5174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:26:21.950805 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.130:39031 (local address 127.18.68.131:40463)
0810 15:26:21.951123 (+ 318us) negotiation.cc:107] Waiting for socket to connect
0810 15:26:21.951134 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 15:26:21.951226 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:26:21.951355 (+ 129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:26:21.951355 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:26:21.951357 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:26:21.951447 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:21.951449 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:21.952097 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:21.952098 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:21.952810 (+ 712us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:26:21.952812 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:26:21.953495 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:26:21.953496 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:26:21.953578 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:21.953581 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 15:26:21.953654 (+ 73us) client_negotiation.cc:240] Negotiation successful
0810 15:26:21.953693 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":299,"mutex_wait_us":141,"thread_start_us":122,"threads_started":1}
I20260810 15:26:21.953815 4581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "314ef11626b8472eb3f4e8f4892f63c6" candidate_uuid: "5b7e6ca13f9846cdbb96236a0ae04f6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06b09a929d7745398feb52fc9fe2e2f1" is_pre_election: true
I20260810 15:26:21.953955 4581 raft_consensus.cc:2454] T 314ef11626b8472eb3f4e8f4892f63c6 P 06b09a929d7745398feb52fc9fe2e2f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b7e6ca13f9846cdbb96236a0ae04f6b in term 0.
I20260810 15:26:21.954276 4930 leader_election.cc:302] T 314ef11626b8472eb3f4e8f4892f63c6 P 5b7e6ca13f9846cdbb96236a0ae04f6b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06b09a929d7745398feb52fc9fe2e2f1, 5b7e6ca13f9846cdbb96236a0ae04f6b; no voters:
I20260810 15:26:21.954421 5168 raft_consensus.cc:2781] T 314ef11626b8472eb3f4e8f4892f63c6 P 5b7e6ca13f9846cdbb96236a0ae04f6b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 15:26:21.954483 5168 raft_consensus.cc:482] T 314ef11626b8472eb3f4e8f4892f63c6 P 5b7e6ca13f9846cdbb96236a0ae04f6b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 15:26:21.954418 4817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "314ef11626b8472eb3f4e8f4892f63c6" candidate_uuid: "5b7e6ca13f9846cdbb96236a0ae04f6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bd774dc8f8e4745a919151dfbceb0e8" is_pre_election: true
I20260810 15:26:21.954509 5168 raft_consensus.cc:3037] T 314ef11626b8472eb3f4e8f4892f63c6 P 5b7e6ca13f9846cdbb96236a0ae04f6b [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:26:21.954613 4817 raft_consensus.cc:2454] T 314ef11626b8472eb3f4e8f4892f63c6 P 1bd774dc8f8e4745a919151dfbceb0e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b7e6ca13f9846cdbb96236a0ae04f6b in term 0.
I20260810 15:26:21.955300 5168 raft_consensus.cc:504] T 314ef11626b8472eb3f4e8f4892f63c6 P 5b7e6ca13f9846cdbb96236a0ae04f6b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06b09a929d7745398feb52fc9fe2e2f1" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 34289 } } peers { permanent_uuid: "1bd774dc8f8e4745a919151dfbceb0e8" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 39031 } } peers { permanent_uuid: "5b7e6ca13f9846cdbb96236a0ae04f6b" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 36633 } }
I20260810 15:26:21.955446 5168 leader_election.cc:288] T 314ef11626b8472eb3f4e8f4892f63c6 P 5b7e6ca13f9846cdbb96236a0ae04f6b [CANDIDATE]: Term 1 election: Requested vote from peers 06b09a929d7745398feb52fc9fe2e2f1 (127.18.68.129:34289), 1bd774dc8f8e4745a919151dfbceb0e8 (127.18.68.130:39031)
I20260810 15:26:21.955593 4581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "314ef11626b8472eb3f4e8f4892f63c6" candidate_uuid: "5b7e6ca13f9846cdbb96236a0ae04f6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06b09a929d7745398feb52fc9fe2e2f1"
I20260810 15:26:21.955686 4581 raft_consensus.cc:3037] T 314ef11626b8472eb3f4e8f4892f63c6 P 06b09a929d7745398feb52fc9fe2e2f1 [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:26:21.955641 4817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "314ef11626b8472eb3f4e8f4892f63c6" candidate_uuid: "5b7e6ca13f9846cdbb96236a0ae04f6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bd774dc8f8e4745a919151dfbceb0e8"
I20260810 15:26:21.955751 4817 raft_consensus.cc:3037] T 314ef11626b8472eb3f4e8f4892f63c6 P 1bd774dc8f8e4745a919151dfbceb0e8 [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:26:21.956344 4581 raft_consensus.cc:2454] T 314ef11626b8472eb3f4e8f4892f63c6 P 06b09a929d7745398feb52fc9fe2e2f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b7e6ca13f9846cdbb96236a0ae04f6b in term 1.
I20260810 15:26:21.956506 4930 leader_election.cc:302] T 314ef11626b8472eb3f4e8f4892f63c6 P 5b7e6ca13f9846cdbb96236a0ae04f6b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06b09a929d7745398feb52fc9fe2e2f1, 5b7e6ca13f9846cdbb96236a0ae04f6b; no voters:
I20260810 15:26:21.956601 5168 raft_consensus.cc:2781] T 314ef11626b8472eb3f4e8f4892f63c6 P 5b7e6ca13f9846cdbb96236a0ae04f6b [term 1 FOLLOWER]: Leader election won for term 1
I20260810 15:26:21.956737 5168 raft_consensus.cc:686] T 314ef11626b8472eb3f4e8f4892f63c6 P 5b7e6ca13f9846cdbb96236a0ae04f6b [term 1 LEADER]: Becoming Leader. State: Replica: 5b7e6ca13f9846cdbb96236a0ae04f6b, State: Running, Role: LEADER
I20260810 15:26:21.956791 4817 raft_consensus.cc:2454] T 314ef11626b8472eb3f4e8f4892f63c6 P 1bd774dc8f8e4745a919151dfbceb0e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b7e6ca13f9846cdbb96236a0ae04f6b in term 1.
I20260810 15:26:21.956843 5168 consensus_queue.cc:237] T 314ef11626b8472eb3f4e8f4892f63c6 P 5b7e6ca13f9846cdbb96236a0ae04f6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06b09a929d7745398feb52fc9fe2e2f1" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 34289 } } peers { permanent_uuid: "1bd774dc8f8e4745a919151dfbceb0e8" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 39031 } } peers { permanent_uuid: "5b7e6ca13f9846cdbb96236a0ae04f6b" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 36633 } }
I20260810 15:26:21.957702 4315 catalog_manager.cc:5495] T 314ef11626b8472eb3f4e8f4892f63c6 P 5b7e6ca13f9846cdbb96236a0ae04f6b reported cstate change: term changed from 0 to 1, leader changed from <none> to 5b7e6ca13f9846cdbb96236a0ae04f6b (127.18.68.131). New cstate: current_term: 1 leader_uuid: "5b7e6ca13f9846cdbb96236a0ae04f6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06b09a929d7745398feb52fc9fe2e2f1" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 34289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1bd774dc8f8e4745a919151dfbceb0e8" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 39031 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b7e6ca13f9846cdbb96236a0ae04f6b" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 36633 } health_report { overall_health: HEALTHY } } }
W20260810 15:26:21.981994 5127 tablet.cc:2369] T 314ef11626b8472eb3f4e8f4892f63c6 P 5b7e6ca13f9846cdbb96236a0ae04f6b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 15:26:21.990890 5155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:26:21.988262 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49468 (local address 127.18.68.131:36633)
0810 15:26:21.988344 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0810 15:26:21.988346 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:26:21.988355 (+ 9us) server_negotiation.cc:407] Connection header received
0810 15:26:21.988394 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:26:21.988395 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:26:21.988413 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:26:21.988490 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 15:26:21.988652 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:21.989136 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:21.989925 (+ 789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:26:21.990199 (+ 274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:26:21.990258 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:26:21.990461 (+ 203us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 15:26:21.990582 (+ 121us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 15:26:21.990665 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0810 15:26:21.990778 (+ 113us) server_negotiation.cc:299] Negotiation successful
0810 15:26:21.990799 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260810 15:26:21.993180 4581 raft_consensus.cc:1261] T 314ef11626b8472eb3f4e8f4892f63c6 P 06b09a929d7745398feb52fc9fe2e2f1 [term 1 FOLLOWER]: Refusing update from remote peer 5b7e6ca13f9846cdbb96236a0ae04f6b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 15:26:21.993196 4817 raft_consensus.cc:1261] T 314ef11626b8472eb3f4e8f4892f63c6 P 1bd774dc8f8e4745a919151dfbceb0e8 [term 1 FOLLOWER]: Refusing update from remote peer 5b7e6ca13f9846cdbb96236a0ae04f6b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 15:26:21.993618 5175 consensus_queue.cc:1035] T 314ef11626b8472eb3f4e8f4892f63c6 P 5b7e6ca13f9846cdbb96236a0ae04f6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "06b09a929d7745398feb52fc9fe2e2f1" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 34289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 15:26:21.993784 5168 consensus_queue.cc:1035] T 314ef11626b8472eb3f4e8f4892f63c6 P 5b7e6ca13f9846cdbb96236a0ae04f6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1bd774dc8f8e4745a919151dfbceb0e8" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 39031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 15:26:21.996248 5178 mvcc.cc:205] Tried to move back new op lower bound from 7316994383840555008 to 7316994383695773696. Current Snapshot: MvccSnapshot[applied={T|T < 7316994383840555008}]
I20260810 15:26:21.996874 5179 mvcc.cc:205] Tried to move back new op lower bound from 7316994383840555008 to 7316994383695773696. Current Snapshot: MvccSnapshot[applied={T|T < 7316994383840555008}]
I20260810 15:26:21.996955 5180 mvcc.cc:205] Tried to move back new op lower bound from 7316994383840555008 to 7316994383695773696. Current Snapshot: MvccSnapshot[applied={T|T < 7316994383840555008 or (T in {7316994383840555008})}]
I20260810 15:26:21.999363 4319 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55024:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 15:26:21.999464 4319 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55024:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 15:26:22.000305 4319 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e9b68f44db734ca08b60950a45d89cd0: Sending DeleteTablet for 3 replicas of tablet 314ef11626b8472eb3f4e8f4892f63c6
I20260810 15:26:22.000669 4542 tablet_service.cc:1514] Processing DeleteTablet for tablet 314ef11626b8472eb3f4e8f4892f63c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 15:26:21 UTC) from {username='kudu', principal='kudu/127.18.68.190@KRBTEST.COM'} at 127.0.0.1:50766
I20260810 15:26:22.000665 5012 tablet_service.cc:1514] Processing DeleteTablet for tablet 314ef11626b8472eb3f4e8f4892f63c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 15:26:21 UTC) from {username='kudu', principal='kudu/127.18.68.190@KRBTEST.COM'} at 127.0.0.1:49456
I20260810 15:26:22.000929 5198 tablet_replica.cc:330] T 314ef11626b8472eb3f4e8f4892f63c6 P 06b09a929d7745398feb52fc9fe2e2f1: stopping tablet replica
I20260810 15:26:22.000921 4786 tablet_service.cc:1514] Processing DeleteTablet for tablet 314ef11626b8472eb3f4e8f4892f63c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 15:26:21 UTC) from {username='kudu', principal='kudu/127.18.68.190@KRBTEST.COM'} at 127.0.0.1:54364
I20260810 15:26:22.001070 5198 raft_consensus.cc:2229] T 314ef11626b8472eb3f4e8f4892f63c6 P 06b09a929d7745398feb52fc9fe2e2f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 15:26:22.001137 5200 tablet_replica.cc:330] T 314ef11626b8472eb3f4e8f4892f63c6 P 1bd774dc8f8e4745a919151dfbceb0e8: stopping tablet replica
I20260810 15:26:22.001227 5198 raft_consensus.cc:2258] T 314ef11626b8472eb3f4e8f4892f63c6 P 06b09a929d7745398feb52fc9fe2e2f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 15:26:22.001237 5200 raft_consensus.cc:2229] T 314ef11626b8472eb3f4e8f4892f63c6 P 1bd774dc8f8e4745a919151dfbceb0e8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 15:26:22.001338 5200 raft_consensus.cc:2258] T 314ef11626b8472eb3f4e8f4892f63c6 P 1bd774dc8f8e4745a919151dfbceb0e8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 15:26:22.001379 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 4428
I20260810 15:26:22.001447 5192 tablet_replica.cc:330] T 314ef11626b8472eb3f4e8f4892f63c6 P 5b7e6ca13f9846cdbb96236a0ae04f6b: stopping tablet replica
I20260810 15:26:22.001549 5192 raft_consensus.cc:2229] T 314ef11626b8472eb3f4e8f4892f63c6 P 5b7e6ca13f9846cdbb96236a0ae04f6b [term 1 LEADER]: Raft consensus shutting down.
I20260810 15:26:22.001677 5192 raft_consensus.cc:2258] T 314ef11626b8472eb3f4e8f4892f63c6 P 5b7e6ca13f9846cdbb96236a0ae04f6b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 15:26:22.001868 5200 ts_tablet_manager.cc:1905] T 314ef11626b8472eb3f4e8f4892f63c6 P 1bd774dc8f8e4745a919151dfbceb0e8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 15:26:22.002240 5192 ts_tablet_manager.cc:1905] T 314ef11626b8472eb3f4e8f4892f63c6 P 5b7e6ca13f9846cdbb96236a0ae04f6b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 15:26:22.004015 5192 ts_tablet_manager.cc:1918] T 314ef11626b8472eb3f4e8f4892f63c6 P 5b7e6ca13f9846cdbb96236a0ae04f6b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 15:26:22.004115 5192 log.cc:1196] T 314ef11626b8472eb3f4e8f4892f63c6 P 5b7e6ca13f9846cdbb96236a0ae04f6b: Deleting WAL directory at /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786375520124696-18706-0/minicluster-data/ts-2/wal/wals/314ef11626b8472eb3f4e8f4892f63c6
I20260810 15:26:22.004106 5200 ts_tablet_manager.cc:1918] T 314ef11626b8472eb3f4e8f4892f63c6 P 1bd774dc8f8e4745a919151dfbceb0e8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 15:26:22.004186 5200 log.cc:1196] T 314ef11626b8472eb3f4e8f4892f63c6 P 1bd774dc8f8e4745a919151dfbceb0e8: Deleting WAL directory at /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786375520124696-18706-0/minicluster-data/ts-1/wal/wals/314ef11626b8472eb3f4e8f4892f63c6
I20260810 15:26:22.004480 5192 ts_tablet_manager.cc:1939] T 314ef11626b8472eb3f4e8f4892f63c6 P 5b7e6ca13f9846cdbb96236a0ae04f6b: Deleting consensus metadata
I20260810 15:26:22.004565 5200 ts_tablet_manager.cc:1939] T 314ef11626b8472eb3f4e8f4892f63c6 P 1bd774dc8f8e4745a919151dfbceb0e8: Deleting consensus metadata
I20260810 15:26:22.004967 4291 catalog_manager.cc:4841] TS 5b7e6ca13f9846cdbb96236a0ae04f6b (127.18.68.131:36633): tablet 314ef11626b8472eb3f4e8f4892f63c6 (table test-table [id=e4d615d0d340452680c1f9c28d404001]) successfully deleted
I20260810 15:26:22.004984 4292 catalog_manager.cc:4841] TS 1bd774dc8f8e4745a919151dfbceb0e8 (127.18.68.130:39031): tablet 314ef11626b8472eb3f4e8f4892f63c6 (table test-table [id=e4d615d0d340452680c1f9c28d404001]) successfully deleted
W20260810 15:26:22.014858 4287 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.18.68.129:34289 (error 108)
I20260810 15:26:22.015415 5152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:26:22.015263 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.129:34289 (local address 127.0.0.1:50776)
0810 15:26:22.015327 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0810 15:26:22.015371 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.129:34289: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260810 15:26:22.015498 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 4672
W20260810 15:26:22.015543 4287 catalog_manager.cc:4584] TS 06b09a929d7745398feb52fc9fe2e2f1 (127.18.68.129:34289): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 314ef11626b8472eb3f4e8f4892f63c6: Network error: Client connection negotiation failed: client connection to 127.18.68.129:34289: connect: Connection refused (error 111)
I20260810 15:26:22.025853 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 4901
I20260810 15:26:22.039319 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 4257
2026-08-10T15:26:22Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2386 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 15:26:22 dist-test-slave-2p8l krb5kdc[5206](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 15:26:22 dist-test-slave-2p8l krb5kdc[5206](info): set up 2 sockets
Aug 10 15:26:22 dist-test-slave-2p8l krb5kdc[5206](info): commencing operation
krb5kdc: starting...
W20260810 15:26:23.354247 18706 mini_kdc.cc:121] Time spent starting KDC: real 1.287s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/krb5kdc/test-user.keytab.
Aug 10 15:26:23 dist-test-slave-2p8l krb5kdc[5206](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375583, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T15:26:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T15:26:23Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.18.68.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.18.68.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.18.68.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/krb5kdc/rangeradmin_127.18.68.148@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.18.68.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/krb5kdc/rangeradmin_127.18.68.148@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.18.68.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.18.68.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.18.68.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/krb5kdc/rangerlookup_127.18.68.148@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.18.68.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/krb5kdc/rangerlookup_127.18.68.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.18.68.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.18.68.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.18.68.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/krb5kdc/HTTP_127.18.68.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.18.68.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/krb5kdc/HTTP_127.18.68.148@KRBTEST.COM.keytab.
I20260810 15:26:23.532536 18706 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskspH5IZ/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/minicluster-data/postgres -l logfile start
2026-08-10 15:26:26.057 UTC [5254] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-10 15:26:26.057 UTC [5254] LOG: listening on IPv4 address "127.18.68.148", port 55897
2026-08-10 15:26:26.061 UTC [5254] LOG: listening on Unix socket "/tmp/.s.PGSQL.55897"
2026-08-10 15:26:26.083 UTC [5259] LOG: database system was shut down at 2026-08-10 15:26:24 UTC
2026-08-10 15:26:26.087 UTC [5254] LOG: database system is ready to accept connections
I20260810 15:26:27.320062 18706 mini_postgres.cc:96] Postgres bound to 55897
2026-08-10 15:26:27.327 UTC [5276] FATAL: database "slave" does not exist
127.18.68.148:55897 - accepting connections
I20260810 15:26:27.327721 18706 mini_ranger.cc:161] Starting Ranger...
I20260810 15:26:27.346534 18706 mini_ranger.cc:84] Created miniranger Postgres user
I20260810 15:26:27.826607 18706 mini_ranger.cc:87] Created ranger Postgres database
I20260810 15:26:27.826704 18706 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/minicluster-data/ranger-admin
2026-08-10 15:26:28,096 [I] DB FLAVOR :POSTGRES
2026-08-10 15:26:28,096 [I] --------- Verifying Ranger DB connection ---------
2026-08-10 15:26:28,096 [I] Checking connection..
2026-08-10 15:26:28,096 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskspH5IZ/build/release/bin/postgresql.jar:/tmp/dist-test-taskspH5IZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.68.148:55897/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-10 15:26:28,378 [I] Checking connection passed.
2026-08-10 15:26:28,378 [I] --------- Verifying version history table ---------
2026-08-10 15:26:28,378 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskspH5IZ/build/release/bin/postgresql.jar:/tmp/dist-test-taskspH5IZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.68.148:55897/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-10 15:26:28,635 [I] Table x_db_version_h does not exist in database ranger
2026-08-10 15:26:28,635 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskspH5IZ/build/release/bin/postgresql.jar:/tmp/dist-test-taskspH5IZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.68.148:55897/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-10 15:26:28,912 [I] Table x_db_version_h does not exist in database ranger
2026-08-10 15:26:28,912 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-10 15:26:28,912 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskspH5IZ/build/release/bin/postgresql.jar:/tmp/dist-test-taskspH5IZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.68.148:55897/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskspH5IZ/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-10 15:26:29.173 UTC [5384] WARNING: there is no transaction in progress
2026-08-10 15:26:29,183 [I] create_dbversion_catalog.sql file imported successfully
2026-08-10 15:26:29,184 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskspH5IZ/build/release/bin/postgresql.jar:/tmp/dist-test-taskspH5IZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.68.148:55897/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-10 15:26:29,445 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-10 15:26:29,445 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-10 15:26:29,445 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskspH5IZ/build/release/bin/postgresql.jar:/tmp/dist-test-taskspH5IZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.68.148:55897/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-10 15:26:29,705 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskspH5IZ/build/release/bin/postgresql.jar:/tmp/dist-test-taskspH5IZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.68.148:55897/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-10 15:26:29,958 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskspH5IZ/build/release/bin/postgresql.jar:/tmp/dist-test-taskspH5IZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.68.148:55897/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-2p8l.c.gcp-upstream.internal','N') ;"
2026-08-10 15:26:30,205 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskspH5IZ/build/release/bin/postgresql.jar:/tmp/dist-test-taskspH5IZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.68.148:55897/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-10 15:26:30,466 [I] Table x_portal_user does not exist in database ranger
2026-08-10 15:26:30,466 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskspH5IZ/build/release/bin/postgresql.jar:/tmp/dist-test-taskspH5IZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.68.148:55897/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-10 15:26:30,735 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-10 15:26:30,735 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskspH5IZ/build/release/bin/postgresql.jar:/tmp/dist-test-taskspH5IZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.68.148:55897/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-10 15:26:30,977 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskspH5IZ/build/release/bin/postgresql.jar:/tmp/dist-test-taskspH5IZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.68.148:55897/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-10 15:26:31,233 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-10 15:26:31,233 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskspH5IZ/build/release/bin/postgresql.jar:/tmp/dist-test-taskspH5IZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.68.148:55897/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskspH5IZ/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-10 15:26:32.244 UTC [5583] WARNING: there is no transaction in progress
2026-08-10 15:26:32.261 UTC [5583] WARNING: there is no transaction in progress
2026-08-10 15:26:32.276 UTC [5583] WARNING: there is no transaction in progress
2026-08-10 15:26:32.291 UTC [5583] WARNING: there is no transaction in progress
2026-08-10 15:26:32.306 UTC [5583] WARNING: there is no transaction in progress
2026-08-10 15:26:32.323 UTC [5583] WARNING: there is no transaction in progress
2026-08-10 15:26:32.378 UTC [5583] WARNING: there is no transaction in progress
2026-08-10 15:26:32.385 UTC [5583] WARNING: there is no transaction in progress
2026-08-10 15:26:32.400 UTC [5583] WARNING: there is no transaction in progress
2026-08-10 15:26:32.410 UTC [5583] WARNING: there is no transaction in progress
2026-08-10 15:26:32.421 UTC [5583] WARNING: there is no transaction in progress
2026-08-10 15:26:32.435 UTC [5583] WARNING: there is no transaction in progress
2026-08-10 15:26:32.445 UTC [5583] WARNING: there is no transaction in progress
2026-08-10 15:26:32.451 UTC [5583] WARNING: there is no transaction in progress
2026-08-10 15:26:32.457 UTC [5583] WARNING: there is no transaction in progress
2026-08-10 15:26:32.464 UTC [5583] WARNING: there is no transaction in progress
2026-08-10 15:26:33,193 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-10 15:26:33,193 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskspH5IZ/build/release/bin/postgresql.jar:/tmp/dist-test-taskspH5IZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.68.148:55897/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-10 15:26:33,461 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-10 15:26:33,462 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskspH5IZ/build/release/bin/postgresql.jar:/tmp/dist-test-taskspH5IZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.68.148:55897/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-10 15:26:33,716 [I] Table x_portal_user already exists in database 'ranger'
2026-08-10 15:26:33,717 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskspH5IZ/build/release/bin/postgresql.jar:/tmp/dist-test-taskspH5IZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.68.148:55897/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-10 15:26:34,002 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-10 15:26:34,002 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskspH5IZ/build/release/bin/postgresql.jar:/tmp/dist-test-taskspH5IZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.68.148:55897/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-10 15:26:34,246 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskspH5IZ/build/release/bin/postgresql.jar:/tmp/dist-test-taskspH5IZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.68.148:55897/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-10 15:26:34,504 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskspH5IZ/build/release/bin/postgresql.jar:/tmp/dist-test-taskspH5IZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.68.148:55897/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-2p8l.c.gcp-upstream.internal';"
2026-08-10 15:26:34,741 [I] CORE_DB_SCHEMA import status has been updated
2026-08-10 15:26:34,742 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskspH5IZ/build/release/bin/postgresql.jar:/tmp/dist-test-taskspH5IZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.68.148:55897/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-10 15:26:35,013 [I] DB_PATCHES have already been applied
I20260810 15:26:35.019105 18706 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/minicluster-data/ranger-admin:/tmp/dist-test-taskspH5IZ/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskspH5IZ/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskspH5IZ/build/release/bin/postgresql.jar:/tmp/dist-test-taskspH5IZ/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260810 15:26:35.019187 18706 mini_ranger.cc:193] Using host: 127.18.68.148
I20260810 15:26:35.023232 18706 mini_ranger.cc:227] Ranger admin URL: http://127.18.68.148:52157
Aug 10, 2026 3:26:35 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 10, 2026 3:26:35 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 10, 2026 3:26:35 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/minicluster-data/ranger-admin/ews/webapp
Aug 10, 2026 3:26:35 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 10, 2026 3:26:35 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 10, 2026 3:26:35 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/minicluster-data/ranger-admin/ews/webapp].
Aug 10, 2026 3:26:35 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260810 15:26:36.505631 18706 mini_ranger.cc:160] Time spent starting Ranger: real 9.178s user 0.004s sys 0.008s
Aug 10, 2026 3:26:57 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 10, 2026 3:26:57 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.UserREST
Aug 10, 2026 3:26:57 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 10, 2026 3:26:57 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 10, 2026 3:26:57 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 10, 2026 3:26:57 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 10, 2026 3:26:57 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 10, 2026 3:26:57 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 10, 2026 3:26:57 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 10, 2026 3:26:57 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 10, 2026 3:26:57 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 10, 2026 3:26:57 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 10, 2026 3:26:57 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 10, 2026 3:26:57 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 10, 2026 3:26:57 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 10, 2026 3:26:57 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 10, 2026 3:26:57 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 10, 2026 3:26:58 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260810 15:26:58.774094 18706 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.18.68.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.18.68.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.18.68.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/krb5kdc/rangerkms_127.18.68.148@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.18.68.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/krb5kdc/rangerkms_127.18.68.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.18.68.148@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.18.68.148@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.18.68.148@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/krb5kdc/HTTP_127.18.68.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.18.68.148@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/krb5kdc/HTTP_127.18.68.148@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 10 15:26:58 dist-test-slave-2p8l krb5kdc[5206](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375618, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260810 15:26:58.866571 18706 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260810 15:26:58.877339 18706 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260810 15:26:59.795693 18706 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260810 15:26:59.795787 18706 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/minicluster-data/ranger-kms
I20260810 15:26:59.795806 18706 mini_ranger_kms.cc:227] Using postgres at 127.18.68.148:55897
2026-08-10 15:27:00,070 [I] DB FLAVOR :POSTGRES
2026-08-10 15:27:00,071 [I] --------- Verifying Ranger DB connection ---------
2026-08-10 15:27:00,071 [I] Checking connection
2026-08-10 15:27:00,071 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskspH5IZ/build/release/bin/postgresql.jar:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.68.148:55897/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-10 15:27:00,352 [I] connection success
2026-08-10 15:27:00,352 [I] --------- Verifying Ranger DB tables ---------
2026-08-10 15:27:00,352 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-10 15:27:00,352 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskspH5IZ/build/release/bin/postgresql.jar:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.68.148:55897/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-10 15:27:00,636 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-10 15:27:00,637 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-10 15:27:00,637 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-10 15:27:00,637 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskspH5IZ/build/release/bin/postgresql.jar:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.68.148:55897/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-10 15:27:00,929 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260810 15:27:01.436072 18706 mini_ranger_kms.cc:310] Created kms service
I20260810 15:27:01.679831 18706 mini_ranger_kms.cc:326] Created kudu user
I20260810 15:27:01.728615 18706 mini_ranger_kms.cc:343] Created rangerkms user
Aug 10 15:27:01 dist-test-slave-2p8l krb5kdc[5206](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375618, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.18.68.148@KRBTEST.COM
I20260810 15:27:02.233522 18706 mini_ranger_kms.cc:384] Added ranger policy
I20260810 15:27:02.233649 18706 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/minicluster-data/ranger-kms:/tmp/dist-test-taskspH5IZ/build/release/bin/postgresql.jar:/tmp/dist-test-taskspH5IZ/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskspH5IZ/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260810 15:27:02.233671 18706 mini_ranger_kms.cc:240] Using host: 127.18.68.148
I20260810 15:27:02.237774 18706 mini_ranger_kms.cc:276] Ranger KMS PID: 5903
I20260810 15:27:02.237916 18706 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.18.68.148:53479
Aug 10, 2026 3:27:03 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 10, 2026 3:27:03 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 10, 2026 3:27:03 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 10, 2026 3:27:03 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 10, 2026 3:27:03 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/minicluster-data/ranger-kms/ews/webapp].
Aug 10, 2026 3:27:03 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 10 15:27:04 dist-test-slave-2p8l krb5kdc[5206](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786375624, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.18.68.148@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:27:05.129669 18706 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.263s user 0.007s sys 0.247s
I20260810 15:27:05.129784 18706 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260810 15:27:05.129866 18706 mini_ranger_kms.cc:401] 127.18.68.148:53479/kms/v1/keys
Aug 10 15:27:05 dist-test-slave-2p8l krb5kdc[5206](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375624, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.18.68.148@KRBTEST.COM for HTTP/127.18.68.148@KRBTEST.COM
Aug 10 15:27:05 dist-test-slave-2p8l krb5kdc[5206](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375624, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.18.68.148@KRBTEST.COM for HTTP/127.18.68.148@KRBTEST.COM
Aug 10 15:27:08 dist-test-slave-2p8l krb5kdc[5206](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375628, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.18.68.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.68.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.68.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab.
Entry for principal kudu/127.18.68.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab.
I20260810 15:27:08.233251 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.190:35599
--webserver_interface=127.18.68.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab
--principal=kudu/127.18.68.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:43731
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.68.190:35599
--ranger_config_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.18.68.148:53479/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:27:08.318828 5985 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:27:08.319046 5985 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:27:08.319068 5985 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:27:08.320259 5985 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 15:27:08.320303 5985 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:27:08.320317 5985 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:27:08.320329 5985 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 15:27:08.320343 5985 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 15:27:08.321959 5985 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:43731
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/minicluster-data/master-0/wal
--ranger_kms_url=127.18.68.148:53479/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.18.68.190:35599
--ranger_config_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab
--principal=kudu/127.18.68.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.190:35599
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.68.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5985
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:27:08.322244 5985 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:27:08.322503 5985 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:27:08.328094 5995 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:27:08.328135 5994 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:27:08.328263 5999 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:27:08.328148 5985 server_base.cc:1034] running on GCE node
I20260810 15:27:08.328709 5985 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:27:08.329038 5985 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:27:08.330204 5985 hybrid_clock.cc:648] HybridClock initialized: now 1786375628330187 us; error 33 us; skew 500 ppm
Aug 10 15:27:08 dist-test-slave-2p8l krb5kdc[5206](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375628, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:27:08.332960 5985 init.cc:377] Logged in from keytab as kudu/127.18.68.190@KRBTEST.COM (short username kudu)
I20260810 15:27:08.333519 5985 webserver.cc:460] Webserver started at http://127.18.68.190:40973/ using document root <none> and password file <none>
I20260810 15:27:08.333755 5985 fs_manager.cc:359] Metadata directory not provided
I20260810 15:27:08.333815 5985 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:27:08.333964 5985 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 15:27:08 dist-test-slave-2p8l krb5kdc[5206](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375628, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.190@KRBTEST.COM for HTTP/127.18.68.148@KRBTEST.COM
I20260810 15:27:08.382615 5985 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/minicluster-data/master-0/data/instance:
uuid: "49ef2b1815a44efda8cb7e407d16a389"
format_stamp: "Formatted at 2026-08-10 15:27:08 on dist-test-slave-2p8l"
server_key: "e57b2854a2a94970b80de1f4972bb5a6"
server_key_iv: "257518b34dfe93cd34670ef50bb20839"
server_key_version: "kuduclusterkey@0"
I20260810 15:27:08.383101 5985 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/minicluster-data/master-0/wal/instance:
uuid: "49ef2b1815a44efda8cb7e407d16a389"
format_stamp: "Formatted at 2026-08-10 15:27:08 on dist-test-slave-2p8l"
server_key: "e57b2854a2a94970b80de1f4972bb5a6"
server_key_iv: "257518b34dfe93cd34670ef50bb20839"
server_key_version: "kuduclusterkey@0"
I20260810 15:27:08.385247 5985 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260810 15:27:08.401449 6011 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:27:08.401630 5985 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260810 15:27:08.401728 5985 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/minicluster-data/master-0/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/minicluster-data/master-0/wal
uuid: "49ef2b1815a44efda8cb7e407d16a389"
format_stamp: "Formatted at 2026-08-10 15:27:08 on dist-test-slave-2p8l"
server_key: "e57b2854a2a94970b80de1f4972bb5a6"
server_key_iv: "257518b34dfe93cd34670ef50bb20839"
server_key_version: "kuduclusterkey@0"
I20260810 15:27:08.401836 5985 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:27:08.418846 5985 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:27:08.421272 5985 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:27:08.421440 5985 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:27:08.426764 5985 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.190:35599
I20260810 15:27:08.426868 6102 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.190:35599 every 8 connection(s)
I20260810 15:27:08.427268 5985 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
I20260810 15:27:08.428058 6105 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:27:08.430253 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 5985
I20260810 15:27:08.430363 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/minicluster-data/master-0/wal/instance
I20260810 15:27:08.430574 18706 external_mini_cluster.cc:1428] Setting key cf51027e8883635a9227cbdebd019f8c
I20260810 15:27:08.431130 6105 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 49ef2b1815a44efda8cb7e407d16a389: Bootstrap starting.
I20260810 15:27:08.431825 6105 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 49ef2b1815a44efda8cb7e407d16a389: Neither blocks nor log segments found. Creating new log.
I20260810 15:27:08.432149 6105 log.cc:824] T 00000000000000000000000000000000 P 49ef2b1815a44efda8cb7e407d16a389: Log is configured to *not* fsync() on all Append() calls
I20260810 15:27:08.433040 6105 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 49ef2b1815a44efda8cb7e407d16a389: No bootstrap required, opened a new log
I20260810 15:27:08.435560 6105 raft_consensus.cc:348] T 00000000000000000000000000000000 P 49ef2b1815a44efda8cb7e407d16a389 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49ef2b1815a44efda8cb7e407d16a389" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 35599 } }
I20260810 15:27:08.435745 6105 raft_consensus.cc:374] T 00000000000000000000000000000000 P 49ef2b1815a44efda8cb7e407d16a389 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:27:08.435783 6105 raft_consensus.cc:729] T 00000000000000000000000000000000 P 49ef2b1815a44efda8cb7e407d16a389 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49ef2b1815a44efda8cb7e407d16a389, State: Initialized, Role: FOLLOWER
I20260810 15:27:08.435956 6105 consensus_queue.cc:260] T 00000000000000000000000000000000 P 49ef2b1815a44efda8cb7e407d16a389 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49ef2b1815a44efda8cb7e407d16a389" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 35599 } }
I20260810 15:27:08.436062 6105 raft_consensus.cc:388] T 00000000000000000000000000000000 P 49ef2b1815a44efda8cb7e407d16a389 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 15:27:08.436091 6105 raft_consensus.cc:482] T 00000000000000000000000000000000 P 49ef2b1815a44efda8cb7e407d16a389 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 15:27:08.436131 6105 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 49ef2b1815a44efda8cb7e407d16a389 [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:27:08.436833 6105 raft_consensus.cc:504] T 00000000000000000000000000000000 P 49ef2b1815a44efda8cb7e407d16a389 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49ef2b1815a44efda8cb7e407d16a389" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 35599 } }
I20260810 15:27:08.436950 6105 leader_election.cc:302] T 00000000000000000000000000000000 P 49ef2b1815a44efda8cb7e407d16a389 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 49ef2b1815a44efda8cb7e407d16a389; no voters:
Aug 10 15:27:08 dist-test-slave-2p8l krb5kdc[5206](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375628, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
I20260810 15:27:08.437973 6105 leader_election.cc:288] T 00000000000000000000000000000000 P 49ef2b1815a44efda8cb7e407d16a389 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 15:27:08.438026 6112 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 49ef2b1815a44efda8cb7e407d16a389 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 15:27:08.438294 6112 raft_consensus.cc:686] T 00000000000000000000000000000000 P 49ef2b1815a44efda8cb7e407d16a389 [term 1 LEADER]: Becoming Leader. State: Replica: 49ef2b1815a44efda8cb7e407d16a389, State: Running, Role: LEADER
I20260810 15:27:08.438366 6105 sys_catalog.cc:564] T 00000000000000000000000000000000 P 49ef2b1815a44efda8cb7e407d16a389 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 15:27:08.438450 6112 consensus_queue.cc:237] T 00000000000000000000000000000000 P 49ef2b1815a44efda8cb7e407d16a389 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49ef2b1815a44efda8cb7e407d16a389" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 35599 } }
I20260810 15:27:08.438884 6112 sys_catalog.cc:455] T 00000000000000000000000000000000 P 49ef2b1815a44efda8cb7e407d16a389 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "49ef2b1815a44efda8cb7e407d16a389" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49ef2b1815a44efda8cb7e407d16a389" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 35599 } } }
I20260810 15:27:08.439041 6112 sys_catalog.cc:458] T 00000000000000000000000000000000 P 49ef2b1815a44efda8cb7e407d16a389 [sys.catalog]: This master's current role is: LEADER
I20260810 15:27:08.439268 6112 sys_catalog.cc:455] T 00000000000000000000000000000000 P 49ef2b1815a44efda8cb7e407d16a389 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 49ef2b1815a44efda8cb7e407d16a389. Latest consensus state: current_term: 1 leader_uuid: "49ef2b1815a44efda8cb7e407d16a389" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49ef2b1815a44efda8cb7e407d16a389" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 35599 } } }
I20260810 15:27:08.439388 6112 sys_catalog.cc:458] T 00000000000000000000000000000000 P 49ef2b1815a44efda8cb7e407d16a389 [sys.catalog]: This master's current role is: LEADER
I20260810 15:27:08.439576 6126 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 15:27:08.439823 6105 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260810 15:27:08.440183 6126 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 15:27:08.446849 6126 catalog_manager.cc:1347] Generated new cluster ID: 0d04a14688ce4dd99fe010fce20366a8
I20260810 15:27:08.447012 6126 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 15:27:08.455754 6110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:27:08.431151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55046 (local address 127.18.68.190:35599)
0810 15:27:08.431346 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0810 15:27:08.431356 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 15:27:08.431482 (+ 126us) server_negotiation.cc:407] Connection header received
0810 15:27:08.432079 (+ 597us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:27:08.432089 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:27:08.432168 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:27:08.432340 (+ 172us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:27:08.433271 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:27:08.434215 (+ 944us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:27:08.434977 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:27:08.435421 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:27:08.435550 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:27:08.438460 (+ 2910us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:27:08.438464 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:27:08.438464 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:27:08.438478 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:27:08.443302 (+ 4824us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:27:08.450158 (+ 6856us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:27:08.450164 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:27:08.450165 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:27:08.450342 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:27:08.454148 (+ 3806us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:27:08.454150 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:27:08.454150 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:27:08.454756 (+ 606us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:27:08.454988 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0810 15:27:08.455143 (+ 155us) server_negotiation.cc:299] Negotiation successful
0810 15:27:08.455429 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":91,"threads_started":1}
I20260810 15:27:08.466585 6126 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 15:27:08.467440 6126 catalog_manager.cc:1504] Loading token signing keys...
I20260810 15:27:08.472589 6126 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 49ef2b1815a44efda8cb7e407d16a389: Generated new TSK 0
I20260810 15:27:08.472893 6126 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.18.68.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.68.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.68.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.129.keytab.
Entry for principal kudu/127.18.68.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.129.keytab.
I20260810 15:27:09.299364 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.18.68.148:53479/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.68.129:0
--local_ip_for_outbound_sockets=127.18.68.129
--webserver_interface=127.18.68.129
--webserver_port=0
--tserver_master_addrs=127.18.68.190:35599
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.129.keytab
--principal=kudu/127.18.68.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:43731
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:27:09.413944 6174 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:27:09.414196 6174 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:27:09.414223 6174 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:27:09.415436 6174 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:27:09.415483 6174 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:27:09.415511 6174 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.68.129
I20260810 15:27:09.417217 6174 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:43731
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.18.68.148:53479/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.129.keytab
--principal=kudu/127.18.68.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.68.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.68.129
--webserver_port=0
--tserver_master_addrs=127.18.68.190:35599
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6174
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.68.129
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:27:09.417500 6174 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:27:09.417800 6174 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:27:09.424108 6191 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:27:09.424124 6194 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:27:09.424118 6192 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:27:09.424664 6174 server_base.cc:1034] running on GCE node
I20260810 15:27:09.424921 6174 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:27:09.425185 6174 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:27:09.426378 6174 hybrid_clock.cc:648] HybridClock initialized: now 1786375629426341 us; error 56 us; skew 500 ppm
Aug 10 15:27:09 dist-test-slave-2p8l krb5kdc[5206](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375629, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:27:09.429167 6174 init.cc:377] Logged in from keytab as kudu/127.18.68.129@KRBTEST.COM (short username kudu)
I20260810 15:27:09.429627 6174 webserver.cc:460] Webserver started at http://127.18.68.129:34983/ using document root <none> and password file <none>
I20260810 15:27:09.429880 6174 fs_manager.cc:359] Metadata directory not provided
I20260810 15:27:09.429951 6174 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:27:09.430161 6174 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 15:27:09 dist-test-slave-2p8l krb5kdc[5206](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375629, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.129@KRBTEST.COM for HTTP/127.18.68.148@KRBTEST.COM
I20260810 15:27:09.445799 6174 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/minicluster-data/ts-0/data/instance:
uuid: "93a671093602410aac46d1251a80f930"
format_stamp: "Formatted at 2026-08-10 15:27:09 on dist-test-slave-2p8l"
server_key: "20ce33287fbc1ebdb9e1559b6d0cf07b"
server_key_iv: "a57e890d943227250055ddc42170e18e"
server_key_version: "kuduclusterkey@0"
I20260810 15:27:09.446457 6174 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/minicluster-data/ts-0/wal/instance:
uuid: "93a671093602410aac46d1251a80f930"
format_stamp: "Formatted at 2026-08-10 15:27:09 on dist-test-slave-2p8l"
server_key: "20ce33287fbc1ebdb9e1559b6d0cf07b"
server_key_iv: "a57e890d943227250055ddc42170e18e"
server_key_version: "kuduclusterkey@0"
I20260810 15:27:09.448105 6174 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:27:09.464288 6211 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:27:09.464570 6174 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:27:09.464675 6174 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/minicluster-data/ts-0/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/minicluster-data/ts-0/wal
uuid: "93a671093602410aac46d1251a80f930"
format_stamp: "Formatted at 2026-08-10 15:27:09 on dist-test-slave-2p8l"
server_key: "20ce33287fbc1ebdb9e1559b6d0cf07b"
server_key_iv: "a57e890d943227250055ddc42170e18e"
server_key_version: "kuduclusterkey@0"
I20260810 15:27:09.464767 6174 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:27:09.492347 6174 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:27:09.495012 6174 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:27:09.495249 6174 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:27:09.495524 6174 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 15:27:09.495956 6174 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 15:27:09.496058 6174 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 15:27:09.496160 6174 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 15:27:09.496239 6174 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 15:27:09.503093 6174 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.129:36559
I20260810 15:27:09.503631 6174 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/minicluster-data/ts-0/data/info.pb
I20260810 15:27:09.507282 6398 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.129:36559 every 8 connection(s)
I20260810 15:27:09.508809 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 6174
I20260810 15:27:09.508925 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/minicluster-data/ts-0/wal/instance
I20260810 15:27:09.509163 18706 external_mini_cluster.cc:1428] Setting key 0ae419025596349793cb7fb14726da51
Aug 10 15:27:09 dist-test-slave-2p8l krb5kdc[5206](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375629, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.129@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
I20260810 15:27:09.520043 6401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:27:09.508132 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.129:34523 (local address 127.18.68.190:35599)
0810 15:27:09.508269 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0810 15:27:09.508271 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:27:09.508534 (+ 263us) server_negotiation.cc:407] Connection header received
0810 15:27:09.509223 (+ 689us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:27:09.509225 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:27:09.509241 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:27:09.509288 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:27:09.510489 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:27:09.511278 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:27:09.512748 (+ 1470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:27:09.513054 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:27:09.513106 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:27:09.516176 (+ 3070us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:27:09.516178 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:27:09.516179 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:27:09.516188 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:27:09.518219 (+ 2031us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:27:09.518786 (+ 567us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:27:09.518788 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:27:09.518788 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:27:09.518860 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:27:09.519198 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:27:09.519199 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:27:09.519200 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:27:09.519340 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:27:09.519409 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0810 15:27:09.519796 (+ 387us) server_negotiation.cc:299] Negotiation successful
0810 15:27:09.519898 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":69,"threads_started":1}
I20260810 15:27:09.520188 6402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:27:09.508125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:35599 (local address 127.18.68.129:34523)
0810 15:27:09.508354 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0810 15:27:09.508408 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0810 15:27:09.509091 (+ 683us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:27:09.509481 (+ 390us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:27:09.509485 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:27:09.510042 (+ 557us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:27:09.510372 (+ 330us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:27:09.510380 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:27:09.511405 (+ 1025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:27:09.511406 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:27:09.512632 (+ 1226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:27:09.512636 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:27:09.513216 (+ 580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:27:09.513217 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:27:09.513371 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:27:09.514117 (+ 746us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:27:09.514128 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:27:09.516043 (+ 1915us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:27:09.518317 (+ 2274us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:27:09.518327 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:27:09.518330 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:27:09.518689 (+ 359us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:27:09.518952 (+ 263us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:27:09.518953 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:27:09.518954 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:27:09.519119 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:27:09.519418 (+ 299us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:27:09.519426 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:27:09.519622 (+ 196us) client_negotiation.cc:769] Sending connection context
0810 15:27:09.519753 (+ 131us) client_negotiation.cc:240] Negotiation successful
0810 15:27:09.519936 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":135,"threads_started":1}
I20260810 15:27:09.520977 6399 heartbeater.cc:347] Connected to a master server at 127.18.68.190:35599
I20260810 15:27:09.521102 6399 heartbeater.cc:464] Registering TS with master...
I20260810 15:27:09.521306 6399 heartbeater.cc:511] Master 127.18.68.190:35599 requested a full tablet report, sending...
I20260810 15:27:09.521908 6044 ts_manager.cc:194] Registered new tserver with Master: 93a671093602410aac46d1251a80f930 (127.18.68.129:36559)
I20260810 15:27:09.522794 6044 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.68.129@KRBTEST.COM'} at 127.18.68.129:34523
WARNING: no policy specified for kudu/127.18.68.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.68.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.68.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.130.keytab.
Entry for principal kudu/127.18.68.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.130.keytab.
I20260810 15:27:09.549811 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.18.68.148:53479/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.68.130:0
--local_ip_for_outbound_sockets=127.18.68.130
--webserver_interface=127.18.68.130
--webserver_port=0
--tserver_master_addrs=127.18.68.190:35599
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.130.keytab
--principal=kudu/127.18.68.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:43731
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:27:09.676033 6408 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:27:09.676438 6408 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:27:09.676543 6408 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:27:09.678480 6408 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:27:09.678617 6408 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:27:09.678721 6408 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.68.130
I20260810 15:27:09.681167 6408 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:43731
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.18.68.148:53479/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.130.keytab
--principal=kudu/127.18.68.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.68.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.68.130
--webserver_port=0
--tserver_master_addrs=127.18.68.190:35599
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6408
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.68.130
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:27:09.681598 6408 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:27:09.681934 6408 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:27:09.688815 6430 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:27:09.689169 6426 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:27:09.690855 6408 server_base.cc:1034] running on GCE node
W20260810 15:27:09.694263 6425 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:27:09.694662 6408 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:27:09.694988 6408 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
Aug 10 15:27:09 dist-test-slave-2p8l krb5kdc[5206](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786375629, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:27:09.696166 6408 hybrid_clock.cc:648] HybridClock initialized: now 1786375629696131 us; error 49 us; skew 500 ppm
Aug 10 15:27:09 dist-test-slave-2p8l krb5kdc[5206](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375629, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:27:09.699877 6408 init.cc:377] Logged in from keytab as kudu/127.18.68.130@KRBTEST.COM (short username kudu)
I20260810 15:27:09.700448 6408 webserver.cc:460] Webserver started at http://127.18.68.130:38251/ using document root <none> and password file <none>
I20260810 15:27:09.701160 6408 fs_manager.cc:359] Metadata directory not provided
I20260810 15:27:09.701675 6408 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:27:09.701884 6408 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 15:27:09 dist-test-slave-2p8l krb5kdc[5206](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375629, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.130@KRBTEST.COM for HTTP/127.18.68.148@KRBTEST.COM
I20260810 15:27:09.726787 6408 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/minicluster-data/ts-1/data/instance:
uuid: "2d9314531f284b10b6243cda433d3f85"
format_stamp: "Formatted at 2026-08-10 15:27:09 on dist-test-slave-2p8l"
server_key: "78b92e39c4d265ab899eb4d264319e30"
server_key_iv: "c993340705b335aa8bf7c164d540ff60"
server_key_version: "kuduclusterkey@0"
I20260810 15:27:09.727393 6408 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/minicluster-data/ts-1/wal/instance:
uuid: "2d9314531f284b10b6243cda433d3f85"
format_stamp: "Formatted at 2026-08-10 15:27:09 on dist-test-slave-2p8l"
server_key: "78b92e39c4d265ab899eb4d264319e30"
server_key_iv: "c993340705b335aa8bf7c164d540ff60"
server_key_version: "kuduclusterkey@0"
I20260810 15:27:09.731012 6408 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.000s
I20260810 15:27:09.755421 6439 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:27:09.755710 6408 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260810 15:27:09.755807 6408 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/minicluster-data/ts-1/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/minicluster-data/ts-1/wal
uuid: "2d9314531f284b10b6243cda433d3f85"
format_stamp: "Formatted at 2026-08-10 15:27:09 on dist-test-slave-2p8l"
server_key: "78b92e39c4d265ab899eb4d264319e30"
server_key_iv: "c993340705b335aa8bf7c164d540ff60"
server_key_version: "kuduclusterkey@0"
I20260810 15:27:09.755903 6408 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:27:09.785751 6408 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:27:09.788476 6408 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:27:09.788702 6408 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:27:09.788964 6408 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 15:27:09.789404 6408 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 15:27:09.789510 6408 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 15:27:09.789602 6408 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 15:27:09.789669 6408 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 15:27:09.800117 6408 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.130:36243
I20260810 15:27:09.800585 6408 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/minicluster-data/ts-1/data/info.pb
I20260810 15:27:09.801360 6628 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.130:36243 every 8 connection(s)
I20260810 15:27:09.803009 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 6408
I20260810 15:27:09.803131 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/minicluster-data/ts-1/wal/instance
I20260810 15:27:09.803340 18706 external_mini_cluster.cc:1428] Setting key 52930413eef84f81a3b49ef84e1bb41a
Aug 10 15:27:09 dist-test-slave-2p8l krb5kdc[5206](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375629, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.130@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
I20260810 15:27:09.817574 6401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:27:09.801629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.130:44925 (local address 127.18.68.190:35599)
0810 15:27:09.801701 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0810 15:27:09.801704 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 15:27:09.802392 (+ 688us) server_negotiation.cc:407] Connection header received
0810 15:27:09.803970 (+ 1578us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:27:09.803971 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:27:09.803987 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:27:09.804019 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:27:09.807007 (+ 2988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:27:09.807737 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:27:09.809292 (+ 1555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:27:09.809619 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:27:09.809667 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:27:09.812465 (+ 2798us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:27:09.812467 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:27:09.812468 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:27:09.812478 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:27:09.814494 (+ 2016us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:27:09.816199 (+ 1705us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:27:09.816201 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:27:09.816201 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:27:09.816281 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:27:09.816631 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:27:09.816632 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:27:09.816633 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:27:09.816797 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:27:09.816864 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0810 15:27:09.817343 (+ 479us) server_negotiation.cc:299] Negotiation successful
0810 15:27:09.817456 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260810 15:27:09.818511 6633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:27:09.801479 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:35599 (local address 127.18.68.130:44925)
0810 15:27:09.802239 (+ 760us) negotiation.cc:107] Waiting for socket to connect
0810 15:27:09.802292 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0810 15:27:09.803843 (+ 1551us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:27:09.806320 (+ 2477us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:27:09.806325 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:27:09.806588 (+ 263us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:27:09.806882 (+ 294us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:27:09.806888 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:27:09.807862 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:27:09.807863 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:27:09.809181 (+ 1318us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:27:09.809185 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:27:09.809771 (+ 586us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:27:09.809772 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:27:09.809920 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:27:09.810686 (+ 766us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:27:09.810697 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:27:09.812343 (+ 1646us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:27:09.814610 (+ 2267us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:27:09.814619 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:27:09.814621 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:27:09.814963 (+ 342us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:27:09.816374 (+ 1411us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:27:09.816375 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:27:09.816376 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:27:09.816535 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:27:09.816908 (+ 373us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:27:09.816915 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:27:09.817106 (+ 191us) client_negotiation.cc:769] Sending connection context
0810 15:27:09.817971 (+ 865us) client_negotiation.cc:240] Negotiation successful
0810 15:27:09.818238 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":706,"thread_start_us":89,"threads_started":1}
I20260810 15:27:09.819340 6630 heartbeater.cc:347] Connected to a master server at 127.18.68.190:35599
I20260810 15:27:09.819497 6630 heartbeater.cc:464] Registering TS with master...
I20260810 15:27:09.819780 6630 heartbeater.cc:511] Master 127.18.68.190:35599 requested a full tablet report, sending...
I20260810 15:27:09.820263 6044 ts_manager.cc:194] Registered new tserver with Master: 2d9314531f284b10b6243cda433d3f85 (127.18.68.130:36243)
WARNING: no policy specified for kudu/127.18.68.131@KRBTEST.COM; defaulting to no policy
I20260810 15:27:09.820824 6044 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.68.130@KRBTEST.COM'} at 127.18.68.130:44925
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.68.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.68.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.131.keytab.
Entry for principal kudu/127.18.68.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.131.keytab.
I20260810 15:27:09.841822 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.18.68.148:53479/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.68.131:0
--local_ip_for_outbound_sockets=127.18.68.131
--webserver_interface=127.18.68.131
--webserver_port=0
--tserver_master_addrs=127.18.68.190:35599
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.131.keytab
--principal=kudu/127.18.68.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:43731
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:27:09.977994 6636 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:27:09.978438 6636 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:27:09.978533 6636 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:27:09.980634 6636 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:27:09.980886 6636 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:27:09.980988 6636 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.68.131
I20260810 15:27:09.983501 6636 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:43731
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.18.68.148:53479/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.131.keytab
--principal=kudu/127.18.68.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.68.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.68.131
--webserver_port=0
--tserver_master_addrs=127.18.68.190:35599
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6636
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.68.131
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:27:09.984119 6636 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:27:09.984469 6636 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:27:09.992110 6644 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:27:09.992564 6643 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:27:09.992835 6646 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:27:09.994185 6636 server_base.cc:1034] running on GCE node
I20260810 15:27:09.994427 6636 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:27:09.994717 6636 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:27:09.995905 6636 hybrid_clock.cc:648] HybridClock initialized: now 1786375629995881 us; error 36 us; skew 500 ppm
Aug 10 15:27:09 dist-test-slave-2p8l krb5kdc[5206](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375629, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:27:09.999522 6636 init.cc:377] Logged in from keytab as kudu/127.18.68.131@KRBTEST.COM (short username kudu)
I20260810 15:27:10.000116 6636 webserver.cc:460] Webserver started at http://127.18.68.131:43455/ using document root <none> and password file <none>
I20260810 15:27:10.000391 6636 fs_manager.cc:359] Metadata directory not provided
I20260810 15:27:10.000447 6636 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:27:10.000584 6636 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 15:27:09 dist-test-slave-2p8l krb5kdc[5206](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375629, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.131@KRBTEST.COM for HTTP/127.18.68.148@KRBTEST.COM
I20260810 15:27:10.015897 6636 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/minicluster-data/ts-2/data/instance:
uuid: "bc1f8730565843cfa39e85deec982534"
format_stamp: "Formatted at 2026-08-10 15:27:10 on dist-test-slave-2p8l"
server_key: "39631b96bb1327aac46465de06f16a5b"
server_key_iv: "17b45d18c18c3700714ae4204640d8f1"
server_key_version: "kuduclusterkey@0"
I20260810 15:27:10.016532 6636 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/minicluster-data/ts-2/wal/instance:
uuid: "bc1f8730565843cfa39e85deec982534"
format_stamp: "Formatted at 2026-08-10 15:27:10 on dist-test-slave-2p8l"
server_key: "39631b96bb1327aac46465de06f16a5b"
server_key_iv: "17b45d18c18c3700714ae4204640d8f1"
server_key_version: "kuduclusterkey@0"
I20260810 15:27:10.018918 6636 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260810 15:27:10.042151 6658 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:27:10.042410 6636 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:27:10.042512 6636 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/minicluster-data/ts-2/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/minicluster-data/ts-2/wal
uuid: "bc1f8730565843cfa39e85deec982534"
format_stamp: "Formatted at 2026-08-10 15:27:10 on dist-test-slave-2p8l"
server_key: "39631b96bb1327aac46465de06f16a5b"
server_key_iv: "17b45d18c18c3700714ae4204640d8f1"
server_key_version: "kuduclusterkey@0"
I20260810 15:27:10.042623 6636 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:27:10.066937 6636 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:27:10.069396 6636 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:27:10.069561 6636 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:27:10.069808 6636 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 15:27:10.070238 6636 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 15:27:10.070291 6636 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 15:27:10.070333 6636 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 15:27:10.070358 6636 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 15:27:10.078048 6636 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.131:39571
I20260810 15:27:10.078385 6839 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.131:39571 every 8 connection(s)
I20260810 15:27:10.079089 6636 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/minicluster-data/ts-2/data/info.pb
I20260810 15:27:10.082401 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 6636
I20260810 15:27:10.082521 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/minicluster-data/ts-2/wal/instance
I20260810 15:27:10.082722 18706 external_mini_cluster.cc:1428] Setting key 134931bc91390d80ee4e4ff42cdb4071
Aug 10 15:27:10 dist-test-slave-2p8l krb5kdc[5206](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375629, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.131@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
I20260810 15:27:10.091253 6401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:27:10.079946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.131:49369 (local address 127.18.68.190:35599)
0810 15:27:10.079995 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0810 15:27:10.079998 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 15:27:10.080246 (+ 248us) server_negotiation.cc:407] Connection header received
0810 15:27:10.080980 (+ 734us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:27:10.080982 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:27:10.080995 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:27:10.081030 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:27:10.081924 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:27:10.082730 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:27:10.084271 (+ 1541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:27:10.084591 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:27:10.084643 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:27:10.087601 (+ 2958us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:27:10.087602 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:27:10.087603 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:27:10.087610 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:27:10.089471 (+ 1861us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:27:10.090014 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:27:10.090016 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:27:10.090016 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:27:10.090122 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:27:10.090430 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:27:10.090431 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:27:10.090431 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:27:10.090582 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:27:10.090634 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0810 15:27:10.091052 (+ 418us) server_negotiation.cc:299] Negotiation successful
0810 15:27:10.091151 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260810 15:27:10.091897 6842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:27:10.079916 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:35599 (local address 127.18.68.131:49369)
0810 15:27:10.080100 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0810 15:27:10.080150 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0810 15:27:10.080843 (+ 693us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:27:10.081226 (+ 383us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:27:10.081230 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:27:10.081504 (+ 274us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:27:10.081804 (+ 300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:27:10.081811 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:27:10.082859 (+ 1048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:27:10.082860 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:27:10.084160 (+ 1300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:27:10.084163 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:27:10.084746 (+ 583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:27:10.084747 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:27:10.084898 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:27:10.085562 (+ 664us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:27:10.085573 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:27:10.087463 (+ 1890us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:27:10.089590 (+ 2127us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:27:10.089598 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:27:10.089601 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:27:10.089916 (+ 315us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:27:10.090207 (+ 291us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:27:10.090208 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:27:10.090208 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:27:10.090351 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:27:10.090692 (+ 341us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:27:10.090699 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:27:10.090875 (+ 176us) client_negotiation.cc:769] Sending connection context
0810 15:27:10.091397 (+ 522us) client_negotiation.cc:240] Negotiation successful
0810 15:27:10.091643 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":98,"threads_started":1}
I20260810 15:27:10.095103 6840 heartbeater.cc:347] Connected to a master server at 127.18.68.190:35599
I20260810 15:27:10.095224 6840 heartbeater.cc:464] Registering TS with master...
I20260810 15:27:10.095451 6840 heartbeater.cc:511] Master 127.18.68.190:35599 requested a full tablet report, sending...
I20260810 15:27:10.095865 6044 ts_manager.cc:194] Registered new tserver with Master: bc1f8730565843cfa39e85deec982534 (127.18.68.131:39571)
I20260810 15:27:10.096441 6044 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.68.131@KRBTEST.COM'} at 127.18.68.131:49369
I20260810 15:27:10.105648 18706 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 15:27:10.116125 6401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:27:10.107526 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55052 (local address 127.18.68.190:35599)
0810 15:27:10.107585 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0810 15:27:10.107587 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:27:10.107596 (+ 9us) server_negotiation.cc:407] Connection header received
0810 15:27:10.107621 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:27:10.107622 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:27:10.107632 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:27:10.107687 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:27:10.108488 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:27:10.109365 (+ 877us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:27:10.110513 (+ 1148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:27:10.110850 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:27:10.110945 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:27:10.112613 (+ 1668us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:27:10.112615 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:27:10.112615 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:27:10.112625 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:27:10.114656 (+ 2031us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:27:10.115139 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:27:10.115141 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:27:10.115141 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:27:10.115218 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:27:10.115458 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:27:10.115459 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:27:10.115459 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:27:10.115623 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:27:10.115757 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0810 15:27:10.115917 (+ 160us) server_negotiation.cc:299] Negotiation successful
0810 15:27:10.116017 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260810 15:27:10.118243 6044 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55052:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 15:27:10.120908 6044 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 15:27:10.132474 6872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:27:10.125355 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.131:39571 (local address 127.0.0.1:39626)
0810 15:27:10.127148 (+ 1793us) negotiation.cc:107] Waiting for socket to connect
0810 15:27:10.127158 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 15:27:10.127208 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:27:10.127469 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:27:10.127472 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:27:10.127475 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:27:10.127553 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:27:10.127555 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:27:10.129348 (+ 1793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:27:10.129349 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:27:10.131076 (+ 1727us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:27:10.131079 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:27:10.132184 (+ 1105us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:27:10.132185 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:27:10.132265 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:27:10.132269 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 15:27:10.132323 (+ 54us) client_negotiation.cc:240] Negotiation successful
0810 15:27:10.132366 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1777,"mutex_wait_us":57,"thread_start_us":84,"threads_started":1}
I20260810 15:27:10.132921 6864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:27:10.125691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55420 (local address 127.18.68.129:36559)
0810 15:27:10.126798 (+ 1107us) server_negotiation.cc:206] Beginning negotiation
0810 15:27:10.126803 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 15:27:10.126815 (+ 12us) server_negotiation.cc:407] Connection header received
0810 15:27:10.126851 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:27:10.126853 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:27:10.126869 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:27:10.126945 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:27:10.127738 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:27:10.129166 (+ 1428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:27:10.130896 (+ 1730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:27:10.131885 (+ 989us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:27:10.131968 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:27:10.132039 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0810 15:27:10.132783 (+ 744us) server_negotiation.cc:299] Negotiation successful
0810 15:27:10.132835 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1068,"thread_start_us":64,"threads_started":1}
I20260810 15:27:10.133126 6863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:27:10.125100 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.129:36559 (local address 127.0.0.1:55420)
0810 15:27:10.126535 (+ 1435us) negotiation.cc:107] Waiting for socket to connect
0810 15:27:10.126580 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0810 15:27:10.126650 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:27:10.127638 (+ 988us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:27:10.127639 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:27:10.127641 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:27:10.127669 (+ 28us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:27:10.127670 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:27:10.129281 (+ 1611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:27:10.129282 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:27:10.130778 (+ 1496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:27:10.130782 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:27:10.132082 (+ 1300us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:27:10.132084 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:27:10.132172 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:27:10.132188 (+ 16us) client_negotiation.cc:769] Sending connection context
0810 15:27:10.132271 (+ 83us) client_negotiation.cc:240] Negotiation successful
0810 15:27:10.132329 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1402,"thread_start_us":86,"threads_started":1}
I20260810 15:27:10.133385 6865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:27:10.125841 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39626 (local address 127.18.68.131:39571)
0810 15:27:10.127094 (+ 1253us) server_negotiation.cc:206] Beginning negotiation
0810 15:27:10.127098 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 15:27:10.127261 (+ 163us) server_negotiation.cc:407] Connection header received
0810 15:27:10.127301 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:27:10.127303 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:27:10.127317 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:27:10.127383 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:27:10.127749 (+ 366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:27:10.129250 (+ 1501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:27:10.131197 (+ 1947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:27:10.131980 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:27:10.132069 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:27:10.132146 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0810 15:27:10.132965 (+ 819us) server_negotiation.cc:299] Negotiation successful
0810 15:27:10.133298 (+ 333us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1214,"thread_start_us":85,"threads_started":1}
I20260810 15:27:10.133983 6290 tablet_service.cc:1467] Processing CreateTablet for tablet dee57d1553d649eabdacc997a5dc641e (DEFAULT_TABLE table=test-table [id=62ae7e8034794c65b6c274ab0a109328]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 15:27:10.134457 6290 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dee57d1553d649eabdacc997a5dc641e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:27:10.134500 6713 tablet_service.cc:1467] Processing CreateTablet for tablet dee57d1553d649eabdacc997a5dc641e (DEFAULT_TABLE table=test-table [id=62ae7e8034794c65b6c274ab0a109328]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 15:27:10.134842 6713 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dee57d1553d649eabdacc997a5dc641e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:27:10.140988 6877 tablet_bootstrap.cc:492] T dee57d1553d649eabdacc997a5dc641e P bc1f8730565843cfa39e85deec982534: Bootstrap starting.
I20260810 15:27:10.142120 6877 tablet_bootstrap.cc:654] T dee57d1553d649eabdacc997a5dc641e P bc1f8730565843cfa39e85deec982534: Neither blocks nor log segments found. Creating new log.
I20260810 15:27:10.142498 6877 log.cc:824] T dee57d1553d649eabdacc997a5dc641e P bc1f8730565843cfa39e85deec982534: Log is configured to *not* fsync() on all Append() calls
I20260810 15:27:10.142890 6876 tablet_bootstrap.cc:492] T dee57d1553d649eabdacc997a5dc641e P 93a671093602410aac46d1251a80f930: Bootstrap starting.
I20260810 15:27:10.143697 6876 tablet_bootstrap.cc:654] T dee57d1553d649eabdacc997a5dc641e P 93a671093602410aac46d1251a80f930: Neither blocks nor log segments found. Creating new log.
I20260810 15:27:10.144054 6876 log.cc:824] T dee57d1553d649eabdacc997a5dc641e P 93a671093602410aac46d1251a80f930: Log is configured to *not* fsync() on all Append() calls
I20260810 15:27:10.144176 6861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:27:10.126241 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.130:36243 (local address 127.0.0.1:57200)
0810 15:27:10.128623 (+ 2382us) negotiation.cc:107] Waiting for socket to connect
0810 15:27:10.128634 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 15:27:10.128680 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:27:10.138504 (+ 9824us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:27:10.138506 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:27:10.138509 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:27:10.138558 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:27:10.138560 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:27:10.140830 (+ 2270us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:27:10.140832 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:27:10.142107 (+ 1275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:27:10.142111 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:27:10.143836 (+ 1725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:27:10.143838 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:27:10.143913 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:27:10.143918 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 15:27:10.143967 (+ 49us) client_negotiation.cc:240] Negotiation successful
0810 15:27:10.144027 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2364,"thread_start_us":72,"threads_started":1}
I20260810 15:27:10.144577 6873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:27:10.126258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57200 (local address 127.18.68.130:36243)
0810 15:27:10.138217 (+ 11959us) server_negotiation.cc:206] Beginning negotiation
0810 15:27:10.138223 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 15:27:10.138237 (+ 14us) server_negotiation.cc:407] Connection header received
0810 15:27:10.138282 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:27:10.138285 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:27:10.138303 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:27:10.138400 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:27:10.140006 (+ 1606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:27:10.140727 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:27:10.142298 (+ 1571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:27:10.143650 (+ 1352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:27:10.143729 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:27:10.144405 (+ 676us) server_negotiation.cc:1035] Waiting for connection context
0810 15:27:10.144436 (+ 31us) server_negotiation.cc:299] Negotiation successful
0810 15:27:10.144483 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11895,"thread_start_us":112,"threads_started":1}
I20260810 15:27:10.145169 6519 tablet_service.cc:1467] Processing CreateTablet for tablet dee57d1553d649eabdacc997a5dc641e (DEFAULT_TABLE table=test-table [id=62ae7e8034794c65b6c274ab0a109328]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 15:27:10.145506 6519 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dee57d1553d649eabdacc997a5dc641e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:27:10.148643 6888 tablet_bootstrap.cc:492] T dee57d1553d649eabdacc997a5dc641e P 2d9314531f284b10b6243cda433d3f85: Bootstrap starting.
I20260810 15:27:10.149518 6877 tablet_bootstrap.cc:492] T dee57d1553d649eabdacc997a5dc641e P bc1f8730565843cfa39e85deec982534: No bootstrap required, opened a new log
I20260810 15:27:10.149619 6877 ts_tablet_manager.cc:1397] T dee57d1553d649eabdacc997a5dc641e P bc1f8730565843cfa39e85deec982534: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.002s
I20260810 15:27:10.149868 6888 tablet_bootstrap.cc:654] T dee57d1553d649eabdacc997a5dc641e P 2d9314531f284b10b6243cda433d3f85: Neither blocks nor log segments found. Creating new log.
I20260810 15:27:10.150300 6888 log.cc:824] T dee57d1553d649eabdacc997a5dc641e P 2d9314531f284b10b6243cda433d3f85: Log is configured to *not* fsync() on all Append() calls
I20260810 15:27:10.151144 6888 tablet_bootstrap.cc:492] T dee57d1553d649eabdacc997a5dc641e P 2d9314531f284b10b6243cda433d3f85: No bootstrap required, opened a new log
I20260810 15:27:10.151208 6888 ts_tablet_manager.cc:1397] T dee57d1553d649eabdacc997a5dc641e P 2d9314531f284b10b6243cda433d3f85: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20260810 15:27:10.152087 6877 raft_consensus.cc:348] T dee57d1553d649eabdacc997a5dc641e P bc1f8730565843cfa39e85deec982534 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a671093602410aac46d1251a80f930" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 36559 } } peers { permanent_uuid: "bc1f8730565843cfa39e85deec982534" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 39571 } } peers { permanent_uuid: "2d9314531f284b10b6243cda433d3f85" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 36243 } }
I20260810 15:27:10.152259 6877 raft_consensus.cc:374] T dee57d1553d649eabdacc997a5dc641e P bc1f8730565843cfa39e85deec982534 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:27:10.152295 6877 raft_consensus.cc:729] T dee57d1553d649eabdacc997a5dc641e P bc1f8730565843cfa39e85deec982534 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc1f8730565843cfa39e85deec982534, State: Initialized, Role: FOLLOWER
I20260810 15:27:10.152436 6877 consensus_queue.cc:260] T dee57d1553d649eabdacc997a5dc641e P bc1f8730565843cfa39e85deec982534 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a671093602410aac46d1251a80f930" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 36559 } } peers { permanent_uuid: "bc1f8730565843cfa39e85deec982534" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 39571 } } peers { permanent_uuid: "2d9314531f284b10b6243cda433d3f85" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 36243 } }
I20260810 15:27:10.152722 6877 ts_tablet_manager.cc:1428] T dee57d1553d649eabdacc997a5dc641e P bc1f8730565843cfa39e85deec982534: Time spent starting tablet: real 0.003s user 0.003s sys 0.001s
I20260810 15:27:10.152837 6840 heartbeater.cc:503] Master 127.18.68.190:35599 was elected leader, sending a full tablet report...
I20260810 15:27:10.153303 6888 raft_consensus.cc:348] T dee57d1553d649eabdacc997a5dc641e P 2d9314531f284b10b6243cda433d3f85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a671093602410aac46d1251a80f930" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 36559 } } peers { permanent_uuid: "bc1f8730565843cfa39e85deec982534" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 39571 } } peers { permanent_uuid: "2d9314531f284b10b6243cda433d3f85" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 36243 } }
I20260810 15:27:10.153445 6888 raft_consensus.cc:374] T dee57d1553d649eabdacc997a5dc641e P 2d9314531f284b10b6243cda433d3f85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:27:10.153476 6888 raft_consensus.cc:729] T dee57d1553d649eabdacc997a5dc641e P 2d9314531f284b10b6243cda433d3f85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d9314531f284b10b6243cda433d3f85, State: Initialized, Role: FOLLOWER
I20260810 15:27:10.153578 6888 consensus_queue.cc:260] T dee57d1553d649eabdacc997a5dc641e P 2d9314531f284b10b6243cda433d3f85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a671093602410aac46d1251a80f930" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 36559 } } peers { permanent_uuid: "bc1f8730565843cfa39e85deec982534" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 39571 } } peers { permanent_uuid: "2d9314531f284b10b6243cda433d3f85" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 36243 } }
I20260810 15:27:10.153831 6888 ts_tablet_manager.cc:1428] T dee57d1553d649eabdacc997a5dc641e P 2d9314531f284b10b6243cda433d3f85: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260810 15:27:10.153983 6630 heartbeater.cc:503] Master 127.18.68.190:35599 was elected leader, sending a full tablet report...
I20260810 15:27:10.154605 6876 tablet_bootstrap.cc:492] T dee57d1553d649eabdacc997a5dc641e P 93a671093602410aac46d1251a80f930: No bootstrap required, opened a new log
I20260810 15:27:10.154683 6876 ts_tablet_manager.cc:1397] T dee57d1553d649eabdacc997a5dc641e P 93a671093602410aac46d1251a80f930: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.000s
I20260810 15:27:10.156862 6876 raft_consensus.cc:348] T dee57d1553d649eabdacc997a5dc641e P 93a671093602410aac46d1251a80f930 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a671093602410aac46d1251a80f930" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 36559 } } peers { permanent_uuid: "bc1f8730565843cfa39e85deec982534" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 39571 } } peers { permanent_uuid: "2d9314531f284b10b6243cda433d3f85" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 36243 } }
I20260810 15:27:10.157025 6876 raft_consensus.cc:374] T dee57d1553d649eabdacc997a5dc641e P 93a671093602410aac46d1251a80f930 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:27:10.157071 6876 raft_consensus.cc:729] T dee57d1553d649eabdacc997a5dc641e P 93a671093602410aac46d1251a80f930 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93a671093602410aac46d1251a80f930, State: Initialized, Role: FOLLOWER
I20260810 15:27:10.157188 6876 consensus_queue.cc:260] T dee57d1553d649eabdacc997a5dc641e P 93a671093602410aac46d1251a80f930 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a671093602410aac46d1251a80f930" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 36559 } } peers { permanent_uuid: "bc1f8730565843cfa39e85deec982534" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 39571 } } peers { permanent_uuid: "2d9314531f284b10b6243cda433d3f85" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 36243 } }
I20260810 15:27:10.157631 6876 ts_tablet_manager.cc:1428] T dee57d1553d649eabdacc997a5dc641e P 93a671093602410aac46d1251a80f930: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 15:27:10.157755 6399 heartbeater.cc:503] Master 127.18.68.190:35599 was elected leader, sending a full tablet report...
I20260810 15:27:10.221345 6892 raft_consensus.cc:482] T dee57d1553d649eabdacc997a5dc641e P 93a671093602410aac46d1251a80f930 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 15:27:10.221535 6892 raft_consensus.cc:504] T dee57d1553d649eabdacc997a5dc641e P 93a671093602410aac46d1251a80f930 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a671093602410aac46d1251a80f930" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 36559 } } peers { permanent_uuid: "bc1f8730565843cfa39e85deec982534" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 39571 } } peers { permanent_uuid: "2d9314531f284b10b6243cda433d3f85" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 36243 } }
I20260810 15:27:10.222862 6892 leader_election.cc:288] T dee57d1553d649eabdacc997a5dc641e P 93a671093602410aac46d1251a80f930 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc1f8730565843cfa39e85deec982534 (127.18.68.131:39571), 2d9314531f284b10b6243cda433d3f85 (127.18.68.130:36243)
I20260810 15:27:10.231585 6873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:27:10.222794 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.129:44287 (local address 127.18.68.130:36243)
0810 15:27:10.222838 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0810 15:27:10.222840 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:27:10.227662 (+ 4822us) server_negotiation.cc:407] Connection header received
0810 15:27:10.227789 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:27:10.227791 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:27:10.227811 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:27:10.227846 (+ 35us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:27:10.228117 (+ 271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:27:10.228863 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:27:10.230551 (+ 1688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:27:10.231103 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:27:10.231151 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:27:10.231160 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0810 15:27:10.231455 (+ 295us) server_negotiation.cc:299] Negotiation successful
0810 15:27:10.231502 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260810 15:27:10.231879 6893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:27:10.222574 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.130:36243 (local address 127.18.68.129:44287)
0810 15:27:10.227579 (+ 5005us) negotiation.cc:107] Waiting for socket to connect
0810 15:27:10.227590 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 15:27:10.227702 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:27:10.227926 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:27:10.227927 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:27:10.227929 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:27:10.228027 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:27:10.228030 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:27:10.229006 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:27:10.229007 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:27:10.230272 (+ 1265us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:27:10.230274 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:27:10.231219 (+ 945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:27:10.231219 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:27:10.231289 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:27:10.231292 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 15:27:10.231751 (+ 459us) client_negotiation.cc:240] Negotiation successful
0810 15:27:10.231798 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4989,"thread_start_us":108,"threads_started":1}
I20260810 15:27:10.232277 6558 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dee57d1553d649eabdacc997a5dc641e" candidate_uuid: "93a671093602410aac46d1251a80f930" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d9314531f284b10b6243cda433d3f85" is_pre_election: true
I20260810 15:27:10.232481 6558 raft_consensus.cc:2454] T dee57d1553d649eabdacc997a5dc641e P 2d9314531f284b10b6243cda433d3f85 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93a671093602410aac46d1251a80f930 in term 0.
I20260810 15:27:10.232776 6212 leader_election.cc:302] T dee57d1553d649eabdacc997a5dc641e P 93a671093602410aac46d1251a80f930 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d9314531f284b10b6243cda433d3f85, 93a671093602410aac46d1251a80f930; no voters:
I20260810 15:27:10.232936 6892 raft_consensus.cc:2781] T dee57d1553d649eabdacc997a5dc641e P 93a671093602410aac46d1251a80f930 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 15:27:10.232991 6892 raft_consensus.cc:482] T dee57d1553d649eabdacc997a5dc641e P 93a671093602410aac46d1251a80f930 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 15:27:10.233016 6892 raft_consensus.cc:3037] T dee57d1553d649eabdacc997a5dc641e P 93a671093602410aac46d1251a80f930 [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:27:10.234028 6892 raft_consensus.cc:504] T dee57d1553d649eabdacc997a5dc641e P 93a671093602410aac46d1251a80f930 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a671093602410aac46d1251a80f930" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 36559 } } peers { permanent_uuid: "bc1f8730565843cfa39e85deec982534" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 39571 } } peers { permanent_uuid: "2d9314531f284b10b6243cda433d3f85" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 36243 } }
I20260810 15:27:10.234212 6892 leader_election.cc:288] T dee57d1553d649eabdacc997a5dc641e P 93a671093602410aac46d1251a80f930 [CANDIDATE]: Term 1 election: Requested vote from peers bc1f8730565843cfa39e85deec982534 (127.18.68.131:39571), 2d9314531f284b10b6243cda433d3f85 (127.18.68.130:36243)
I20260810 15:27:10.234274 6865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:27:10.222190 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.129:46905 (local address 127.18.68.131:39571)
0810 15:27:10.222238 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0810 15:27:10.222241 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 15:27:10.227662 (+ 5421us) server_negotiation.cc:407] Connection header received
0810 15:27:10.229866 (+ 2204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:27:10.229867 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:27:10.229881 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:27:10.229910 (+ 29us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:27:10.230152 (+ 242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:27:10.230843 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:27:10.233207 (+ 2364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:27:10.233802 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:27:10.233856 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:27:10.233866 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0810 15:27:10.234157 (+ 291us) server_negotiation.cc:299] Negotiation successful
0810 15:27:10.234206 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260810 15:27:10.234462 6558 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dee57d1553d649eabdacc997a5dc641e" candidate_uuid: "93a671093602410aac46d1251a80f930" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d9314531f284b10b6243cda433d3f85"
I20260810 15:27:10.234551 6558 raft_consensus.cc:3037] T dee57d1553d649eabdacc997a5dc641e P 2d9314531f284b10b6243cda433d3f85 [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:27:10.234820 6894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:27:10.222282 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.131:39571 (local address 127.18.68.129:46905)
0810 15:27:10.227545 (+ 5263us) negotiation.cc:107] Waiting for socket to connect
0810 15:27:10.227562 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 15:27:10.229764 (+ 2202us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:27:10.229973 (+ 209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:27:10.229974 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:27:10.229975 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:27:10.230045 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:27:10.230046 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:27:10.230962 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:27:10.230963 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:27:10.232947 (+ 1984us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:27:10.232951 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:27:10.233930 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:27:10.233931 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:27:10.234023 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:27:10.234027 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 15:27:10.234590 (+ 563us) client_negotiation.cc:240] Negotiation successful
0810 15:27:10.234674 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5228,"thread_start_us":120,"threads_started":1}
I20260810 15:27:10.235244 6765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dee57d1553d649eabdacc997a5dc641e" candidate_uuid: "93a671093602410aac46d1251a80f930" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1f8730565843cfa39e85deec982534"
I20260810 15:27:10.235385 6765 raft_consensus.cc:3037] T dee57d1553d649eabdacc997a5dc641e P bc1f8730565843cfa39e85deec982534 [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:27:10.235572 6558 raft_consensus.cc:2454] T dee57d1553d649eabdacc997a5dc641e P 2d9314531f284b10b6243cda433d3f85 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93a671093602410aac46d1251a80f930 in term 1.
I20260810 15:27:10.235760 6767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dee57d1553d649eabdacc997a5dc641e" candidate_uuid: "93a671093602410aac46d1251a80f930" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc1f8730565843cfa39e85deec982534" is_pre_election: true
I20260810 15:27:10.236339 6765 raft_consensus.cc:2454] T dee57d1553d649eabdacc997a5dc641e P bc1f8730565843cfa39e85deec982534 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93a671093602410aac46d1251a80f930 in term 1.
I20260810 15:27:10.236344 6212 leader_election.cc:302] T dee57d1553d649eabdacc997a5dc641e P 93a671093602410aac46d1251a80f930 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d9314531f284b10b6243cda433d3f85, 93a671093602410aac46d1251a80f930; no voters:
I20260810 15:27:10.236496 6892 raft_consensus.cc:2781] T dee57d1553d649eabdacc997a5dc641e P 93a671093602410aac46d1251a80f930 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 15:27:10.236690 6892 raft_consensus.cc:686] T dee57d1553d649eabdacc997a5dc641e P 93a671093602410aac46d1251a80f930 [term 1 LEADER]: Becoming Leader. State: Replica: 93a671093602410aac46d1251a80f930, State: Running, Role: LEADER
I20260810 15:27:10.236800 6892 consensus_queue.cc:237] T dee57d1553d649eabdacc997a5dc641e P 93a671093602410aac46d1251a80f930 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a671093602410aac46d1251a80f930" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 36559 } } peers { permanent_uuid: "bc1f8730565843cfa39e85deec982534" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 39571 } } peers { permanent_uuid: "2d9314531f284b10b6243cda433d3f85" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 36243 } }
I20260810 15:27:10.237725 6043 catalog_manager.cc:5495] T dee57d1553d649eabdacc997a5dc641e P 93a671093602410aac46d1251a80f930 reported cstate change: term changed from 0 to 1, leader changed from <none> to 93a671093602410aac46d1251a80f930 (127.18.68.129). New cstate: current_term: 1 leader_uuid: "93a671093602410aac46d1251a80f930" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93a671093602410aac46d1251a80f930" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 36559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc1f8730565843cfa39e85deec982534" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 39571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d9314531f284b10b6243cda433d3f85" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 36243 } health_report { overall_health: UNKNOWN } } }
Aug 10 15:27:10 dist-test-slave-2p8l krb5kdc[5206](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375629, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.190@KRBTEST.COM for HTTP/127.18.68.148@KRBTEST.COM
I20260810 15:27:10.250278 6864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:27:10.246761 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55434 (local address 127.18.68.129:36559)
0810 15:27:10.246817 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0810 15:27:10.246820 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 15:27:10.246832 (+ 12us) server_negotiation.cc:407] Connection header received
0810 15:27:10.246880 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:27:10.246881 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:27:10.246906 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:27:10.247004 (+ 98us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 15:27:10.247174 (+ 170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:27:10.247873 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:27:10.249033 (+ 1160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:27:10.249336 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:27:10.249405 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:27:10.249609 (+ 204us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 15:27:10.249765 (+ 156us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 15:27:10.249853 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0810 15:27:10.250143 (+ 290us) server_negotiation.cc:299] Negotiation successful
0810 15:27:10.250169 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260810 15:27:10.254967 6558 raft_consensus.cc:1261] T dee57d1553d649eabdacc997a5dc641e P 2d9314531f284b10b6243cda433d3f85 [term 1 FOLLOWER]: Refusing update from remote peer 93a671093602410aac46d1251a80f930: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 15:27:10.255801 6892 consensus_queue.cc:1035] T dee57d1553d649eabdacc997a5dc641e P 93a671093602410aac46d1251a80f930 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d9314531f284b10b6243cda433d3f85" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 36243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 15:27:10.255890 6765 raft_consensus.cc:1261] T dee57d1553d649eabdacc997a5dc641e P bc1f8730565843cfa39e85deec982534 [term 1 FOLLOWER]: Refusing update from remote peer 93a671093602410aac46d1251a80f930: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 15:27:10.256151 6892 consensus_queue.cc:1035] T dee57d1553d649eabdacc997a5dc641e P 93a671093602410aac46d1251a80f930 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc1f8730565843cfa39e85deec982534" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 39571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 15:27:10.262579 6400 tablet.cc:2369] T dee57d1553d649eabdacc997a5dc641e P 93a671093602410aac46d1251a80f930: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 15:27:10.266109 6899 mvcc.cc:205] Tried to move back new op lower bound from 7316994581521268736 to 7316994581450563584. Current Snapshot: MvccSnapshot[applied={T|T < 7316994581521268736}]
I20260810 15:27:10.266947 6900 mvcc.cc:205] Tried to move back new op lower bound from 7316994581521268736 to 7316994581450563584. Current Snapshot: MvccSnapshot[applied={T|T < 7316994581521268736}]
I20260810 15:27:10.270395 6902 mvcc.cc:205] Tried to move back new op lower bound from 7316994581521268736 to 7316994581450563584. Current Snapshot: MvccSnapshot[applied={T|T < 7316994581521268736}]
I20260810 15:27:10.271806 6044 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55052:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 15:27:10.271917 6044 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55052:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 15:27:10.272645 6044 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 49ef2b1815a44efda8cb7e407d16a389: Sending DeleteTablet for 3 replicas of tablet dee57d1553d649eabdacc997a5dc641e
I20260810 15:27:10.273322 6713 tablet_service.cc:1514] Processing DeleteTablet for tablet dee57d1553d649eabdacc997a5dc641e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 15:27:10 UTC) from {username='kudu', principal='kudu/127.18.68.190@KRBTEST.COM'} at 127.0.0.1:39626
I20260810 15:27:10.273768 6519 tablet_service.cc:1514] Processing DeleteTablet for tablet dee57d1553d649eabdacc997a5dc641e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 15:27:10 UTC) from {username='kudu', principal='kudu/127.18.68.190@KRBTEST.COM'} at 127.0.0.1:57200
I20260810 15:27:10.274190 6290 tablet_service.cc:1514] Processing DeleteTablet for tablet dee57d1553d649eabdacc997a5dc641e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 15:27:10 UTC) from {username='kudu', principal='kudu/127.18.68.190@KRBTEST.COM'} at 127.0.0.1:55420
I20260810 15:27:10.274761 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 6174
I20260810 15:27:10.277503 6910 tablet_replica.cc:330] T dee57d1553d649eabdacc997a5dc641e P bc1f8730565843cfa39e85deec982534: stopping tablet replica
I20260810 15:27:10.277640 6910 raft_consensus.cc:2229] T dee57d1553d649eabdacc997a5dc641e P bc1f8730565843cfa39e85deec982534 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 15:27:10.277752 6910 raft_consensus.cc:2258] T dee57d1553d649eabdacc997a5dc641e P bc1f8730565843cfa39e85deec982534 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 15:27:10.282644 6910 ts_tablet_manager.cc:1905] T dee57d1553d649eabdacc997a5dc641e P bc1f8730565843cfa39e85deec982534: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 15:27:10.285254 6910 ts_tablet_manager.cc:1918] T dee57d1553d649eabdacc997a5dc641e P bc1f8730565843cfa39e85deec982534: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 15:27:10.285444 6910 log.cc:1196] T dee57d1553d649eabdacc997a5dc641e P bc1f8730565843cfa39e85deec982534: Deleting WAL directory at /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/minicluster-data/ts-2/wal/wals/dee57d1553d649eabdacc997a5dc641e
I20260810 15:27:10.286577 6910 ts_tablet_manager.cc:1939] T dee57d1553d649eabdacc997a5dc641e P bc1f8730565843cfa39e85deec982534: Deleting consensus metadata
I20260810 15:27:10.287629 6014 catalog_manager.cc:4841] TS bc1f8730565843cfa39e85deec982534 (127.18.68.131:39571): tablet dee57d1553d649eabdacc997a5dc641e (table test-table [id=62ae7e8034794c65b6c274ab0a109328]) successfully deleted
I20260810 15:27:10.292311 6911 tablet_replica.cc:330] T dee57d1553d649eabdacc997a5dc641e P 2d9314531f284b10b6243cda433d3f85: stopping tablet replica
I20260810 15:27:10.296847 6911 raft_consensus.cc:2229] T dee57d1553d649eabdacc997a5dc641e P 2d9314531f284b10b6243cda433d3f85 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 15:27:10.297047 6911 raft_consensus.cc:2258] T dee57d1553d649eabdacc997a5dc641e P 2d9314531f284b10b6243cda433d3f85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 15:27:10.297645 6911 ts_tablet_manager.cc:1905] T dee57d1553d649eabdacc997a5dc641e P 2d9314531f284b10b6243cda433d3f85: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 15:27:10.299880 6911 ts_tablet_manager.cc:1918] T dee57d1553d649eabdacc997a5dc641e P 2d9314531f284b10b6243cda433d3f85: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 15:27:10.300033 6911 log.cc:1196] T dee57d1553d649eabdacc997a5dc641e P 2d9314531f284b10b6243cda433d3f85: Deleting WAL directory at /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786375520124696-18706-0/minicluster-data/ts-1/wal/wals/dee57d1553d649eabdacc997a5dc641e
I20260810 15:27:10.300338 6911 ts_tablet_manager.cc:1939] T dee57d1553d649eabdacc997a5dc641e P 2d9314531f284b10b6243cda433d3f85: Deleting consensus metadata
I20260810 15:27:10.300913 6013 catalog_manager.cc:4841] TS 2d9314531f284b10b6243cda433d3f85 (127.18.68.130:36243): tablet dee57d1553d649eabdacc997a5dc641e (table test-table [id=62ae7e8034794c65b6c274ab0a109328]) successfully deleted
W20260810 15:27:10.301366 6017 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.18.68.129:36559 (error 108)
I20260810 15:27:10.301997 6861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:27:10.301842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.129:36559 (local address 127.0.0.1:55450)
0810 15:27:10.301910 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0810 15:27:10.301959 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.129:36559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260810 15:27:10.302160 6017 catalog_manager.cc:4584] TS 93a671093602410aac46d1251a80f930 (127.18.68.129:36559): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet dee57d1553d649eabdacc997a5dc641e: Network error: Client connection negotiation failed: client connection to 127.18.68.129:36559: connect: Connection refused (error 111)
I20260810 15:27:10.302474 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 6408
I20260810 15:27:10.311833 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 6636
I20260810 15:27:10.354372 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 5985
I20260810 15:27:10.375554 18706 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260810 15:27:10.722848 18706 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260810 15:27:10.722949 18706 mini_ranger.cc:66] Stopping Ranger...
I20260810 15:27:11.078280 18706 mini_ranger.cc:68] Stopped Ranger
2026-08-10 15:27:11.078 UTC [5254] LOG: received smart shutdown request
2026-08-10 15:27:11.082 UTC [5254] LOG: background worker "logical replication launcher" (PID 5273) exited with exit code 1
2026-08-10 15:27:11.082 UTC [5260] LOG: shutting down
2026-08-10 15:27:11.267 UTC [5254] LOG: database system is shut down
2026-08-10T15:27:11Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (49345 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 15:27:11 dist-test-slave-2p8l krb5kdc[6927](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 15:27:11 dist-test-slave-2p8l krb5kdc[6927](info): set up 2 sockets
Aug 10 15:27:11 dist-test-slave-2p8l krb5kdc[6927](info): commencing operation
krb5kdc: starting...
W20260810 15:27:12.694409 18706 mini_kdc.cc:121] Time spent starting KDC: real 1.281s user 0.003s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/krb5kdc/test-user.keytab.
Aug 10 15:27:12 dist-test-slave-2p8l krb5kdc[6927](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375632, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T15:27:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T15:27:12Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.18.68.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.18.68.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.18.68.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/krb5kdc/rangeradmin_127.18.68.148@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.18.68.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/krb5kdc/rangeradmin_127.18.68.148@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.18.68.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.18.68.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.18.68.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/krb5kdc/rangerlookup_127.18.68.148@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.18.68.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/krb5kdc/rangerlookup_127.18.68.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.18.68.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.18.68.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.18.68.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/krb5kdc/HTTP_127.18.68.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.18.68.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/krb5kdc/HTTP_127.18.68.148@KRBTEST.COM.keytab.
I20260810 15:27:12.883020 18706 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskspH5IZ/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/postgres -l logfile start
2026-08-10 15:27:15.449 UTC [6989] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-10 15:27:15.449 UTC [6989] LOG: listening on IPv4 address "127.18.68.148", port 40955
2026-08-10 15:27:15.452 UTC [6989] LOG: listening on Unix socket "/tmp/.s.PGSQL.40955"
2026-08-10 15:27:15.475 UTC [6994] LOG: database system was shut down at 2026-08-10 15:27:13 UTC
2026-08-10 15:27:15.479 UTC [6989] LOG: database system is ready to accept connections
I20260810 15:27:16.704444 18706 mini_postgres.cc:96] Postgres bound to 40955
2026-08-10 15:27:16.711 UTC [7006] FATAL: database "slave" does not exist
127.18.68.148:40955 - accepting connections
I20260810 15:27:16.712386 18706 mini_ranger.cc:161] Starting Ranger...
I20260810 15:27:16.728286 18706 mini_ranger.cc:84] Created miniranger Postgres user
I20260810 15:27:17.242100 18706 mini_ranger.cc:87] Created ranger Postgres database
I20260810 15:27:17.242208 18706 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ranger-admin
2026-08-10 15:27:17,522 [I] DB FLAVOR :POSTGRES
2026-08-10 15:27:17,523 [I] --------- Verifying Ranger DB connection ---------
2026-08-10 15:27:17,523 [I] Checking connection..
2026-08-10 15:27:17,523 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskspH5IZ/build/release/bin/postgresql.jar:/tmp/dist-test-taskspH5IZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.68.148:40955/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-10 15:27:17,802 [I] Checking connection passed.
2026-08-10 15:27:17,802 [I] --------- Verifying version history table ---------
2026-08-10 15:27:17,802 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskspH5IZ/build/release/bin/postgresql.jar:/tmp/dist-test-taskspH5IZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.68.148:40955/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-10 15:27:18,053 [I] Table x_db_version_h does not exist in database ranger
2026-08-10 15:27:18,054 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskspH5IZ/build/release/bin/postgresql.jar:/tmp/dist-test-taskspH5IZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.68.148:40955/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-10 15:27:18,317 [I] Table x_db_version_h does not exist in database ranger
2026-08-10 15:27:18,317 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-10 15:27:18,317 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskspH5IZ/build/release/bin/postgresql.jar:/tmp/dist-test-taskspH5IZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.68.148:40955/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskspH5IZ/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-10 15:27:18.574 UTC [7104] WARNING: there is no transaction in progress
2026-08-10 15:27:18,582 [I] create_dbversion_catalog.sql file imported successfully
2026-08-10 15:27:18,582 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskspH5IZ/build/release/bin/postgresql.jar:/tmp/dist-test-taskspH5IZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.68.148:40955/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-10 15:27:18,843 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-10 15:27:18,843 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-10 15:27:18,844 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskspH5IZ/build/release/bin/postgresql.jar:/tmp/dist-test-taskspH5IZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.68.148:40955/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-10 15:27:19,120 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskspH5IZ/build/release/bin/postgresql.jar:/tmp/dist-test-taskspH5IZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.68.148:40955/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-10 15:27:19,403 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskspH5IZ/build/release/bin/postgresql.jar:/tmp/dist-test-taskspH5IZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.68.148:40955/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-2p8l.c.gcp-upstream.internal','N') ;"
2026-08-10 15:27:19,666 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskspH5IZ/build/release/bin/postgresql.jar:/tmp/dist-test-taskspH5IZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.68.148:40955/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-10 15:27:19,934 [I] Table x_portal_user does not exist in database ranger
2026-08-10 15:27:19,934 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskspH5IZ/build/release/bin/postgresql.jar:/tmp/dist-test-taskspH5IZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.68.148:40955/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-10 15:27:20,206 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-10 15:27:20,206 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskspH5IZ/build/release/bin/postgresql.jar:/tmp/dist-test-taskspH5IZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.68.148:40955/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-10 15:27:20,454 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskspH5IZ/build/release/bin/postgresql.jar:/tmp/dist-test-taskspH5IZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.68.148:40955/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-10 15:27:20,738 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-10 15:27:20,739 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskspH5IZ/build/release/bin/postgresql.jar:/tmp/dist-test-taskspH5IZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.68.148:40955/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskspH5IZ/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-10 15:27:21.787 UTC [7283] WARNING: there is no transaction in progress
2026-08-10 15:27:21.805 UTC [7283] WARNING: there is no transaction in progress
2026-08-10 15:27:21.824 UTC [7283] WARNING: there is no transaction in progress
2026-08-10 15:27:21.840 UTC [7283] WARNING: there is no transaction in progress
2026-08-10 15:27:21.858 UTC [7283] WARNING: there is no transaction in progress
2026-08-10 15:27:21.878 UTC [7283] WARNING: there is no transaction in progress
2026-08-10 15:27:21.939 UTC [7283] WARNING: there is no transaction in progress
2026-08-10 15:27:21.947 UTC [7283] WARNING: there is no transaction in progress
2026-08-10 15:27:21.964 UTC [7283] WARNING: there is no transaction in progress
2026-08-10 15:27:21.976 UTC [7283] WARNING: there is no transaction in progress
2026-08-10 15:27:21.988 UTC [7283] WARNING: there is no transaction in progress
2026-08-10 15:27:22.005 UTC [7283] WARNING: there is no transaction in progress
2026-08-10 15:27:22.016 UTC [7283] WARNING: there is no transaction in progress
2026-08-10 15:27:22.023 UTC [7283] WARNING: there is no transaction in progress
2026-08-10 15:27:22.031 UTC [7283] WARNING: there is no transaction in progress
2026-08-10 15:27:22.039 UTC [7283] WARNING: there is no transaction in progress
2026-08-10 15:27:22,754 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-10 15:27:22,755 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskspH5IZ/build/release/bin/postgresql.jar:/tmp/dist-test-taskspH5IZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.68.148:40955/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-10 15:27:23,023 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-10 15:27:23,024 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskspH5IZ/build/release/bin/postgresql.jar:/tmp/dist-test-taskspH5IZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.68.148:40955/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-10 15:27:23,297 [I] Table x_portal_user already exists in database 'ranger'
2026-08-10 15:27:23,298 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskspH5IZ/build/release/bin/postgresql.jar:/tmp/dist-test-taskspH5IZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.68.148:40955/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-10 15:27:23,578 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-10 15:27:23,579 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskspH5IZ/build/release/bin/postgresql.jar:/tmp/dist-test-taskspH5IZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.68.148:40955/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-10 15:27:23,859 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskspH5IZ/build/release/bin/postgresql.jar:/tmp/dist-test-taskspH5IZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.68.148:40955/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-10 15:27:24,134 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskspH5IZ/build/release/bin/postgresql.jar:/tmp/dist-test-taskspH5IZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.68.148:40955/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-2p8l.c.gcp-upstream.internal';"
2026-08-10 15:27:24,378 [I] CORE_DB_SCHEMA import status has been updated
2026-08-10 15:27:24,378 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskspH5IZ/build/release/bin/postgresql.jar:/tmp/dist-test-taskspH5IZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.68.148:40955/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-10 15:27:24,658 [I] DB_PATCHES have already been applied
I20260810 15:27:24.664134 18706 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ranger-admin:/tmp/dist-test-taskspH5IZ/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskspH5IZ/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskspH5IZ/build/release/bin/postgresql.jar:/tmp/dist-test-taskspH5IZ/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260810 15:27:24.664252 18706 mini_ranger.cc:193] Using host: 127.18.68.148
I20260810 15:27:24.668541 18706 mini_ranger.cc:227] Ranger admin URL: http://127.18.68.148:40199
Aug 10, 2026 3:27:24 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 10, 2026 3:27:24 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 10, 2026 3:27:25 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ranger-admin/ews/webapp
Aug 10, 2026 3:27:25 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 10, 2026 3:27:25 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 10, 2026 3:27:25 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ranger-admin/ews/webapp].
Aug 10, 2026 3:27:25 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260810 15:27:26.117306 18706 mini_ranger.cc:160] Time spent starting Ranger: real 9.405s user 0.006s sys 0.005s
Aug 10, 2026 3:27:46 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 10, 2026 3:27:46 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 10, 2026 3:27:46 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 10, 2026 3:27:46 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 10, 2026 3:27:46 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 10, 2026 3:27:46 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 10, 2026 3:27:46 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 10, 2026 3:27:46 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 10, 2026 3:27:46 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 10, 2026 3:27:46 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 10, 2026 3:27:46 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 10, 2026 3:27:46 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 10, 2026 3:27:46 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 10, 2026 3:27:46 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 10, 2026 3:27:46 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 10, 2026 3:27:46 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 10, 2026 3:27:46 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 10, 2026 3:27:47 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260810 15:27:48.510205 18706 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.18.68.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.18.68.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.18.68.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/krb5kdc/rangerkms_127.18.68.148@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.18.68.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/krb5kdc/rangerkms_127.18.68.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.18.68.148@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.18.68.148@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.18.68.148@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/krb5kdc/HTTP_127.18.68.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.18.68.148@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/krb5kdc/HTTP_127.18.68.148@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 10 15:27:48 dist-test-slave-2p8l krb5kdc[6927](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375668, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260810 15:27:48.596810 18706 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260810 15:27:48.607707 18706 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260810 15:27:49.452126 18706 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260810 15:27:49.452229 18706 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ranger-kms
I20260810 15:27:49.452248 18706 mini_ranger_kms.cc:227] Using postgres at 127.18.68.148:40955
2026-08-10 15:27:49,625 [I] DB FLAVOR :POSTGRES
2026-08-10 15:27:49,625 [I] --------- Verifying Ranger DB connection ---------
2026-08-10 15:27:49,625 [I] Checking connection
2026-08-10 15:27:49,625 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskspH5IZ/build/release/bin/postgresql.jar:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.68.148:40955/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-10 15:27:49,859 [I] connection success
2026-08-10 15:27:49,860 [I] --------- Verifying Ranger DB tables ---------
2026-08-10 15:27:49,860 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-10 15:27:49,860 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskspH5IZ/build/release/bin/postgresql.jar:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.68.148:40955/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-10 15:27:50,097 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-10 15:27:50,097 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-10 15:27:50,097 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-10 15:27:50,097 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskspH5IZ/build/release/bin/postgresql.jar:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.18.68.148:40955/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-10 15:27:50,394 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260810 15:27:50.846405 18706 mini_ranger_kms.cc:310] Created kms service
I20260810 15:27:51.067507 18706 mini_ranger_kms.cc:326] Created kudu user
I20260810 15:27:51.112579 18706 mini_ranger_kms.cc:343] Created rangerkms user
Aug 10 15:27:51 dist-test-slave-2p8l krb5kdc[6927](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375668, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.18.68.148@KRBTEST.COM
I20260810 15:27:51.540373 18706 mini_ranger_kms.cc:384] Added ranger policy
I20260810 15:27:51.540588 18706 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ranger-kms:/tmp/dist-test-taskspH5IZ/build/release/bin/postgresql.jar:/tmp/dist-test-taskspH5IZ/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskspH5IZ/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260810 15:27:51.540608 18706 mini_ranger_kms.cc:240] Using host: 127.18.68.148
I20260810 15:27:51.545477 18706 mini_ranger_kms.cc:276] Ranger KMS PID: 7620
I20260810 15:27:51.545575 18706 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.18.68.148:34695
Aug 10, 2026 3:27:52 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 10, 2026 3:27:52 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 10, 2026 3:27:52 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 10, 2026 3:27:52 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 10, 2026 3:27:53 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ranger-kms/ews/webapp].
Aug 10, 2026 3:27:53 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 10 15:27:53 dist-test-slave-2p8l krb5kdc[6927](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786375673, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.18.68.148@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 10 15:27:54 dist-test-slave-2p8l krb5kdc[6927](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375673, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.18.68.148@KRBTEST.COM for HTTP/127.18.68.148@KRBTEST.COM
I20260810 15:27:54.516063 18706 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.919s user 0.000s sys 0.156s
I20260810 15:27:54.516179 18706 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260810 15:27:54.516229 18706 mini_ranger_kms.cc:401] 127.18.68.148:34695/kms/v1/keys
Aug 10 15:27:54 dist-test-slave-2p8l krb5kdc[6927](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375673, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.18.68.148@KRBTEST.COM for HTTP/127.18.68.148@KRBTEST.COM
Aug 10 15:27:56 dist-test-slave-2p8l krb5kdc[6927](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375676, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.18.68.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.68.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.68.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab.
Entry for principal kudu/127.18.68.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab.
I20260810 15:27:57.028900 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.190:44559
--webserver_interface=127.18.68.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab
--principal=kudu/127.18.68.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:35705
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.68.190:44559
--ranger_config_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.18.68.148:34695/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:27:57.117544 7699 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:27:57.117753 7699 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:27:57.117776 7699 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:27:57.118968 7699 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 15:27:57.119015 7699 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:27:57.119035 7699 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:27:57.119048 7699 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 15:27:57.119061 7699 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 15:27:57.120635 7699 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:35705
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/master-0/wal
--ranger_kms_url=127.18.68.148:34695/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.18.68.190:44559
--ranger_config_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab
--principal=kudu/127.18.68.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.190:44559
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.68.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7699
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:27:57.120883 7699 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:27:57.121138 7699 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:27:57.126536 7710 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:27:57.126577 7716 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:27:57.126641 7699 server_base.cc:1034] running on GCE node
W20260810 15:27:57.126590 7712 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:27:57.126945 7699 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:27:57.127260 7699 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:27:57.128463 7699 hybrid_clock.cc:648] HybridClock initialized: now 1786375677128447 us; error 46 us; skew 500 ppm
Aug 10 15:27:57 dist-test-slave-2p8l krb5kdc[6927](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375677, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:27:57.131282 7699 init.cc:377] Logged in from keytab as kudu/127.18.68.190@KRBTEST.COM (short username kudu)
I20260810 15:27:57.131791 7699 webserver.cc:460] Webserver started at http://127.18.68.190:34365/ using document root <none> and password file <none>
I20260810 15:27:57.131979 7699 fs_manager.cc:359] Metadata directory not provided
I20260810 15:27:57.132016 7699 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:27:57.132112 7699 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 15:27:57 dist-test-slave-2p8l krb5kdc[6927](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375677, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.190@KRBTEST.COM for HTTP/127.18.68.148@KRBTEST.COM
I20260810 15:27:57.186295 7699 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/master-0/data/instance:
uuid: "fa92dc2f060e4387af739de8afa7714d"
format_stamp: "Formatted at 2026-08-10 15:27:57 on dist-test-slave-2p8l"
server_key: "f5a320e1f6bd798dedabbd5ef0457397"
server_key_iv: "de91c369767b0d56b4848a946218636a"
server_key_version: "kuduclusterkey@0"
I20260810 15:27:57.186803 7699 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/master-0/wal/instance:
uuid: "fa92dc2f060e4387af739de8afa7714d"
format_stamp: "Formatted at 2026-08-10 15:27:57 on dist-test-slave-2p8l"
server_key: "f5a320e1f6bd798dedabbd5ef0457397"
server_key_iv: "de91c369767b0d56b4848a946218636a"
server_key_version: "kuduclusterkey@0"
I20260810 15:27:57.188856 7699 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.001s
I20260810 15:27:57.201768 7729 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:27:57.202035 7699 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:27:57.202160 7699 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/master-0/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/master-0/wal
uuid: "fa92dc2f060e4387af739de8afa7714d"
format_stamp: "Formatted at 2026-08-10 15:27:57 on dist-test-slave-2p8l"
server_key: "f5a320e1f6bd798dedabbd5ef0457397"
server_key_iv: "de91c369767b0d56b4848a946218636a"
server_key_version: "kuduclusterkey@0"
I20260810 15:27:57.202270 7699 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:27:57.218571 7699 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:27:57.220736 7699 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:27:57.220908 7699 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:27:57.225225 7699 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.190:44559
I20260810 15:27:57.225270 7817 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.190:44559 every 8 connection(s)
I20260810 15:27:57.225631 7699 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
I20260810 15:27:57.226323 7820 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:27:57.228650 7820 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fa92dc2f060e4387af739de8afa7714d: Bootstrap starting.
I20260810 15:27:57.229274 7820 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fa92dc2f060e4387af739de8afa7714d: Neither blocks nor log segments found. Creating new log.
I20260810 15:27:57.229578 7820 log.cc:824] T 00000000000000000000000000000000 P fa92dc2f060e4387af739de8afa7714d: Log is configured to *not* fsync() on all Append() calls
I20260810 15:27:57.230391 7820 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fa92dc2f060e4387af739de8afa7714d: No bootstrap required, opened a new log
I20260810 15:27:57.232424 7820 raft_consensus.cc:348] T 00000000000000000000000000000000 P fa92dc2f060e4387af739de8afa7714d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa92dc2f060e4387af739de8afa7714d" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 44559 } }
I20260810 15:27:57.232597 7820 raft_consensus.cc:374] T 00000000000000000000000000000000 P fa92dc2f060e4387af739de8afa7714d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:27:57.232659 7820 raft_consensus.cc:729] T 00000000000000000000000000000000 P fa92dc2f060e4387af739de8afa7714d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa92dc2f060e4387af739de8afa7714d, State: Initialized, Role: FOLLOWER
I20260810 15:27:57.232813 7820 consensus_queue.cc:260] T 00000000000000000000000000000000 P fa92dc2f060e4387af739de8afa7714d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa92dc2f060e4387af739de8afa7714d" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 44559 } }
I20260810 15:27:57.232899 7820 raft_consensus.cc:388] T 00000000000000000000000000000000 P fa92dc2f060e4387af739de8afa7714d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 15:27:57.232942 7820 raft_consensus.cc:482] T 00000000000000000000000000000000 P fa92dc2f060e4387af739de8afa7714d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 15:27:57.232995 7820 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fa92dc2f060e4387af739de8afa7714d [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:27:57.233567 7820 raft_consensus.cc:504] T 00000000000000000000000000000000 P fa92dc2f060e4387af739de8afa7714d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa92dc2f060e4387af739de8afa7714d" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 44559 } }
I20260810 15:27:57.233700 7820 leader_election.cc:302] T 00000000000000000000000000000000 P fa92dc2f060e4387af739de8afa7714d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fa92dc2f060e4387af739de8afa7714d; no voters:
I20260810 15:27:57.233892 7820 leader_election.cc:288] T 00000000000000000000000000000000 P fa92dc2f060e4387af739de8afa7714d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 15:27:57.233928 7825 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fa92dc2f060e4387af739de8afa7714d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 15:27:57.234122 7825 raft_consensus.cc:686] T 00000000000000000000000000000000 P fa92dc2f060e4387af739de8afa7714d [term 1 LEADER]: Becoming Leader. State: Replica: fa92dc2f060e4387af739de8afa7714d, State: Running, Role: LEADER
I20260810 15:27:57.234180 7820 sys_catalog.cc:564] T 00000000000000000000000000000000 P fa92dc2f060e4387af739de8afa7714d [sys.catalog]: configured and running, proceeding with master startup.
I20260810 15:27:57.234292 7825 consensus_queue.cc:237] T 00000000000000000000000000000000 P fa92dc2f060e4387af739de8afa7714d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa92dc2f060e4387af739de8afa7714d" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 44559 } }
I20260810 15:27:57.234689 7827 sys_catalog.cc:455] T 00000000000000000000000000000000 P fa92dc2f060e4387af739de8afa7714d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fa92dc2f060e4387af739de8afa7714d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa92dc2f060e4387af739de8afa7714d" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 44559 } } }
I20260810 15:27:57.234730 7829 sys_catalog.cc:455] T 00000000000000000000000000000000 P fa92dc2f060e4387af739de8afa7714d [sys.catalog]: SysCatalogTable state changed. Reason: New leader fa92dc2f060e4387af739de8afa7714d. Latest consensus state: current_term: 1 leader_uuid: "fa92dc2f060e4387af739de8afa7714d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa92dc2f060e4387af739de8afa7714d" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 44559 } } }
I20260810 15:27:57.234896 7829 sys_catalog.cc:458] T 00000000000000000000000000000000 P fa92dc2f060e4387af739de8afa7714d [sys.catalog]: This master's current role is: LEADER
I20260810 15:27:57.235073 7827 sys_catalog.cc:458] T 00000000000000000000000000000000 P fa92dc2f060e4387af739de8afa7714d [sys.catalog]: This master's current role is: LEADER
I20260810 15:27:57.235263 7841 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 15:27:57.235688 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 7699
I20260810 15:27:57.235798 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/master-0/wal/instance
I20260810 15:27:57.235881 7841 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 15:27:57.235999 18706 external_mini_cluster.cc:1428] Setting key df890acbdc9753a7c7819774da6f59bd
I20260810 15:27:57.236209 7820 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260810 15:27:57.241971 7841 catalog_manager.cc:1347] Generated new cluster ID: 6b89554d113e412c957aa362cd431b8c
I20260810 15:27:57.242168 7841 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 10 15:27:57 dist-test-slave-2p8l krb5kdc[6927](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375676, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
I20260810 15:27:57.251444 7857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:27:57.236658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58578 (local address 127.18.68.190:44559)
0810 15:27:57.236858 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0810 15:27:57.236867 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 15:27:57.236914 (+ 47us) server_negotiation.cc:407] Connection header received
0810 15:27:57.237033 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:27:57.237042 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:27:57.237104 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:27:57.237257 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:27:57.237907 (+ 650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:27:57.242245 (+ 4338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:27:57.243440 (+ 1195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:27:57.244197 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:27:57.244346 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:27:57.247525 (+ 3179us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:27:57.247529 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:27:57.247529 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:27:57.247541 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:27:57.249388 (+ 1847us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:27:57.249771 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:27:57.249774 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:27:57.249774 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:27:57.249958 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:27:57.250186 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:27:57.250187 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:27:57.250187 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:27:57.250522 (+ 335us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:27:57.251015 (+ 493us) server_negotiation.cc:1035] Waiting for connection context
0810 15:27:57.251085 (+ 70us) server_negotiation.cc:299] Negotiation successful
0810 15:27:57.251217 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":85,"threads_started":1}
I20260810 15:27:57.262769 7841 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 15:27:57.263536 7841 catalog_manager.cc:1504] Loading token signing keys...
I20260810 15:27:57.270689 7841 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fa92dc2f060e4387af739de8afa7714d: Generated new TSK 0
I20260810 15:27:57.270897 7841 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.18.68.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.68.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.68.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.129.keytab.
Entry for principal kudu/127.18.68.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.129.keytab.
I20260810 15:27:57.999275 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.18.68.148:34695/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.68.129:0
--local_ip_for_outbound_sockets=127.18.68.129
--webserver_interface=127.18.68.129
--webserver_port=0
--tserver_master_addrs=127.18.68.190:44559
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.129.keytab
--principal=kudu/127.18.68.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:35705
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:27:58.124459 7893 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:27:58.124775 7893 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:27:58.124817 7893 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:27:58.126559 7893 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:27:58.126628 7893 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:27:58.126670 7893 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.68.129
I20260810 15:27:58.128907 7893 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:35705
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.18.68.148:34695/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.129.keytab
--principal=kudu/127.18.68.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.68.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.68.129
--webserver_port=0
--tserver_master_addrs=127.18.68.190:44559
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7893
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.68.129
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:27:58.129189 7893 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:27:58.129459 7893 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:27:58.135147 7901 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:27:58.135140 7904 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:27:58.135155 7906 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:27:58.135842 7893 server_base.cc:1034] running on GCE node
I20260810 15:27:58.136071 7893 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:27:58.136394 7893 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:27:58.137585 7893 hybrid_clock.cc:648] HybridClock initialized: now 1786375678137562 us; error 45 us; skew 500 ppm
Aug 10 15:27:58 dist-test-slave-2p8l krb5kdc[6927](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375678, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:27:58.140710 7893 init.cc:377] Logged in from keytab as kudu/127.18.68.129@KRBTEST.COM (short username kudu)
I20260810 15:27:58.141170 7893 webserver.cc:460] Webserver started at http://127.18.68.129:36837/ using document root <none> and password file <none>
I20260810 15:27:58.141417 7893 fs_manager.cc:359] Metadata directory not provided
I20260810 15:27:58.141489 7893 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:27:58.141639 7893 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 15:27:58 dist-test-slave-2p8l krb5kdc[6927](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375678, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.129@KRBTEST.COM for HTTP/127.18.68.148@KRBTEST.COM
I20260810 15:27:58.157215 7893 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ts-0/data/instance:
uuid: "d99843d5e4ae466f84a34ea4a4c3036a"
format_stamp: "Formatted at 2026-08-10 15:27:58 on dist-test-slave-2p8l"
server_key: "2789896189fab78abdbbb63f6fc016d0"
server_key_iv: "74521b091a2ffe6cb6fc69576eeee36c"
server_key_version: "kuduclusterkey@0"
I20260810 15:27:58.157840 7893 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ts-0/wal/instance:
uuid: "d99843d5e4ae466f84a34ea4a4c3036a"
format_stamp: "Formatted at 2026-08-10 15:27:58 on dist-test-slave-2p8l"
server_key: "2789896189fab78abdbbb63f6fc016d0"
server_key_iv: "74521b091a2ffe6cb6fc69576eeee36c"
server_key_version: "kuduclusterkey@0"
I20260810 15:27:58.160046 7893 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.002s
I20260810 15:27:58.178303 7917 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:27:58.178592 7893 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.001s sys 0.001s
I20260810 15:27:58.178702 7893 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ts-0/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ts-0/wal
uuid: "d99843d5e4ae466f84a34ea4a4c3036a"
format_stamp: "Formatted at 2026-08-10 15:27:58 on dist-test-slave-2p8l"
server_key: "2789896189fab78abdbbb63f6fc016d0"
server_key_iv: "74521b091a2ffe6cb6fc69576eeee36c"
server_key_version: "kuduclusterkey@0"
I20260810 15:27:58.178803 7893 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:27:58.200964 7893 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:27:58.203593 7893 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:27:58.203825 7893 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:27:58.204133 7893 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 15:27:58.204623 7893 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 15:27:58.204732 7893 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 15:27:58.204849 7893 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 15:27:58.204924 7893 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 15:27:58.212293 7893 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.129:41893
I20260810 15:27:58.212767 7893 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ts-0/data/info.pb
I20260810 15:27:58.213222 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 7893
I20260810 15:27:58.213330 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ts-0/wal/instance
I20260810 15:27:58.213537 18706 external_mini_cluster.cc:1428] Setting key 0da3a34ba3d09da097919c1545ea3cfa
I20260810 15:27:58.214210 8159 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.129:41893 every 8 connection(s)
Aug 10 15:27:58 dist-test-slave-2p8l krb5kdc[6927](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375678, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.129@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.18.68.130@KRBTEST.COM; defaulting to no policy
I20260810 15:27:58.226125 8165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:27:58.213946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.129:38943 (local address 127.18.68.190:44559)
0810 15:27:58.214833 (+ 887us) server_negotiation.cc:206] Beginning negotiation
0810 15:27:58.214835 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:27:58.215761 (+ 926us) server_negotiation.cc:407] Connection header received
0810 15:27:58.215791 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:27:58.215792 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:27:58.215807 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:27:58.215875 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:27:58.216693 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:27:58.217447 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:27:58.218935 (+ 1488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:27:58.219244 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:27:58.219291 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:27:58.221977 (+ 2686us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:27:58.221979 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:27:58.221979 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:27:58.221987 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:27:58.224366 (+ 2379us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:27:58.224906 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:27:58.224907 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:27:58.224907 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:27:58.224975 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:27:58.225298 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:27:58.225299 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:27:58.225299 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:27:58.225450 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:27:58.225494 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0810 15:27:58.225876 (+ 382us) server_negotiation.cc:299] Negotiation successful
0810 15:27:58.225975 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":852,"thread_start_us":81,"threads_started":1}
I20260810 15:27:58.226698 8162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:27:58.213572 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:44559 (local address 127.18.68.129:38943)
0810 15:27:58.214903 (+ 1331us) negotiation.cc:107] Waiting for socket to connect
0810 15:27:58.214952 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0810 15:27:58.215612 (+ 660us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:27:58.216005 (+ 393us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:27:58.216010 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:27:58.216294 (+ 284us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:27:58.216572 (+ 278us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:27:58.216579 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:27:58.217561 (+ 982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:27:58.217563 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:27:58.218833 (+ 1270us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:27:58.218836 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:27:58.219415 (+ 579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:27:58.219416 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:27:58.219555 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:27:58.220186 (+ 631us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:27:58.220196 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:27:58.221855 (+ 1659us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:27:58.224463 (+ 2608us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:27:58.224471 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:27:58.224474 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:27:58.224806 (+ 332us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:27:58.225052 (+ 246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:27:58.225053 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:27:58.225054 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:27:58.225203 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:27:58.225544 (+ 341us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:27:58.225550 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:27:58.225713 (+ 163us) client_negotiation.cc:769] Sending connection context
0810 15:27:58.226290 (+ 577us) client_negotiation.cc:240] Negotiation successful
0810 15:27:58.226464 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1284,"thread_start_us":86,"threads_started":1}
I20260810 15:27:58.227355 8160 heartbeater.cc:347] Connected to a master server at 127.18.68.190:44559
I20260810 15:27:58.227456 8160 heartbeater.cc:464] Registering TS with master...
I20260810 15:27:58.227649 8160 heartbeater.cc:511] Master 127.18.68.190:44559 requested a full tablet report, sending...
I20260810 15:27:58.228268 7755 ts_manager.cc:194] Registered new tserver with Master: d99843d5e4ae466f84a34ea4a4c3036a (127.18.68.129:41893)
I20260810 15:27:58.228960 7755 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.68.129@KRBTEST.COM'} at 127.18.68.129:38943
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.68.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.68.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.130.keytab.
Entry for principal kudu/127.18.68.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.130.keytab.
I20260810 15:27:58.248731 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.18.68.148:34695/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.68.130:0
--local_ip_for_outbound_sockets=127.18.68.130
--webserver_interface=127.18.68.130
--webserver_port=0
--tserver_master_addrs=127.18.68.190:44559
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.130.keytab
--principal=kudu/127.18.68.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:35705
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:27:58.368278 8172 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:27:58.368628 8172 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:27:58.368701 8172 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:27:58.370478 8172 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:27:58.370541 8172 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:27:58.370581 8172 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.68.130
I20260810 15:27:58.373330 8172 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:35705
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.18.68.148:34695/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.130.keytab
--principal=kudu/127.18.68.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.68.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.68.130
--webserver_port=0
--tserver_master_addrs=127.18.68.190:44559
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8172
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.68.130
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:27:58.373647 8172 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:27:58.374001 8172 file_cache.cc:493] Constructed file cache file cache with capacity 419430
Aug 10 15:27:58 dist-test-slave-2p8l krb5kdc[6927](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786375678, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260810 15:27:58.381717 8185 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:27:58.381783 8188 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:27:58.382083 8172 server_base.cc:1034] running on GCE node
W20260810 15:27:58.381914 8191 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:27:58.382539 8172 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:27:58.382871 8172 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:27:58.384068 8172 hybrid_clock.cc:648] HybridClock initialized: now 1786375678384034 us; error 44 us; skew 500 ppm
Aug 10 15:27:58 dist-test-slave-2p8l krb5kdc[6927](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375678, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:27:58.387686 8172 init.cc:377] Logged in from keytab as kudu/127.18.68.130@KRBTEST.COM (short username kudu)
I20260810 15:27:58.388283 8172 webserver.cc:460] Webserver started at http://127.18.68.130:42801/ using document root <none> and password file <none>
I20260810 15:27:58.388595 8172 fs_manager.cc:359] Metadata directory not provided
I20260810 15:27:58.388664 8172 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:27:58.388851 8172 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 15:27:58 dist-test-slave-2p8l krb5kdc[6927](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375678, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.130@KRBTEST.COM for HTTP/127.18.68.148@KRBTEST.COM
I20260810 15:27:58.404038 8172 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ts-1/data/instance:
uuid: "6af51e44f4a94394914bda860b78270f"
format_stamp: "Formatted at 2026-08-10 15:27:58 on dist-test-slave-2p8l"
server_key: "c6e9baea5a2bbd7bab5b905aa091fc8c"
server_key_iv: "f95df84d8fe1a4ceb0c9ebc3f17032c4"
server_key_version: "kuduclusterkey@0"
I20260810 15:27:58.404671 8172 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ts-1/wal/instance:
uuid: "6af51e44f4a94394914bda860b78270f"
format_stamp: "Formatted at 2026-08-10 15:27:58 on dist-test-slave-2p8l"
server_key: "c6e9baea5a2bbd7bab5b905aa091fc8c"
server_key_iv: "f95df84d8fe1a4ceb0c9ebc3f17032c4"
server_key_version: "kuduclusterkey@0"
I20260810 15:27:58.410506 8172 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.001s sys 0.001s
I20260810 15:27:58.427466 8204 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:27:58.427832 8172 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.000s sys 0.002s
I20260810 15:27:58.427938 8172 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ts-1/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ts-1/wal
uuid: "6af51e44f4a94394914bda860b78270f"
format_stamp: "Formatted at 2026-08-10 15:27:58 on dist-test-slave-2p8l"
server_key: "c6e9baea5a2bbd7bab5b905aa091fc8c"
server_key_iv: "f95df84d8fe1a4ceb0c9ebc3f17032c4"
server_key_version: "kuduclusterkey@0"
I20260810 15:27:58.428032 8172 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:27:58.440619 8172 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:27:58.443293 8172 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:27:58.443454 8172 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:27:58.443768 8172 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 15:27:58.444170 8172 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 15:27:58.444227 8172 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 15:27:58.444258 8172 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 15:27:58.444286 8172 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 15:27:58.452404 8172 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.130:33379
I20260810 15:27:58.452898 8172 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ts-1/data/info.pb
I20260810 15:27:58.455988 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 8172
I20260810 15:27:58.456161 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ts-1/wal/instance
I20260810 15:27:58.456396 18706 external_mini_cluster.cc:1428] Setting key ecc390c0700197518171ba708abbd6a6
I20260810 15:27:58.458248 8411 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.130:33379 every 8 connection(s)
Aug 10 15:27:58 dist-test-slave-2p8l krb5kdc[6927](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375678, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.130@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.18.68.131@KRBTEST.COM; defaulting to no policy
I20260810 15:27:58.471065 8165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:27:58.458831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.130:35553 (local address 127.18.68.190:44559)
0810 15:27:58.458883 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0810 15:27:58.458885 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:27:58.459209 (+ 324us) server_negotiation.cc:407] Connection header received
0810 15:27:58.459948 (+ 739us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:27:58.459950 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:27:58.459972 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:27:58.460071 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:27:58.460684 (+ 613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:27:58.461554 (+ 870us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:27:58.463143 (+ 1589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:27:58.463552 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:27:58.463643 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:27:58.466990 (+ 3347us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:27:58.466992 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:27:58.466992 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:27:58.467002 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:27:58.469106 (+ 2104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:27:58.469681 (+ 575us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:27:58.469688 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:27:58.469688 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:27:58.469747 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:27:58.470117 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:27:58.470118 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:27:58.470118 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:27:58.470261 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:27:58.470355 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0810 15:27:58.470848 (+ 493us) server_negotiation.cc:299] Negotiation successful
0810 15:27:58.470960 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260810 15:27:58.471290 8415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:27:58.458845 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:44559 (local address 127.18.68.130:35553)
0810 15:27:58.459028 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0810 15:27:58.459083 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0810 15:27:58.459786 (+ 703us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:27:58.460155 (+ 369us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:27:58.460159 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:27:58.460363 (+ 204us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:27:58.460571 (+ 208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:27:58.460575 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:27:58.461680 (+ 1105us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:27:58.461682 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:27:58.463044 (+ 1362us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:27:58.463047 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:27:58.463746 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:27:58.463748 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:27:58.463923 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:27:58.464752 (+ 829us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:27:58.464764 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:27:58.466857 (+ 2093us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:27:58.469214 (+ 2357us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:27:58.469224 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:27:58.469227 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:27:58.469575 (+ 348us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:27:58.469838 (+ 263us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:27:58.469839 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:27:58.469840 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:27:58.469985 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:27:58.470345 (+ 360us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:27:58.470354 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:27:58.470641 (+ 287us) client_negotiation.cc:769] Sending connection context
0810 15:27:58.470806 (+ 165us) client_negotiation.cc:240] Negotiation successful
0810 15:27:58.470988 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":94,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.68.131@KRBTEST.COM" created.
I20260810 15:27:58.472097 8413 heartbeater.cc:347] Connected to a master server at 127.18.68.190:44559
I20260810 15:27:58.472214 8413 heartbeater.cc:464] Registering TS with master...
I20260810 15:27:58.472456 8413 heartbeater.cc:511] Master 127.18.68.190:44559 requested a full tablet report, sending...
I20260810 15:27:58.472898 7755 ts_manager.cc:194] Registered new tserver with Master: 6af51e44f4a94394914bda860b78270f (127.18.68.130:33379)
I20260810 15:27:58.473467 7755 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.68.130@KRBTEST.COM'} at 127.18.68.130:35553
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.68.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.131.keytab.
Entry for principal kudu/127.18.68.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.131.keytab.
I20260810 15:27:58.489780 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.18.68.148:34695/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.68.131:0
--local_ip_for_outbound_sockets=127.18.68.131
--webserver_interface=127.18.68.131
--webserver_port=0
--tserver_master_addrs=127.18.68.190:44559
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.131.keytab
--principal=kudu/127.18.68.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:35705
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:27:58.584393 8422 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:27:58.584635 8422 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:27:58.584683 8422 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:27:58.586328 8422 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:27:58.586447 8422 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:27:58.586522 8422 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.68.131
I20260810 15:27:58.588203 8422 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:35705
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.18.68.148:34695/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.131.keytab
--principal=kudu/127.18.68.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.68.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.68.131
--webserver_port=0
--tserver_master_addrs=127.18.68.190:44559
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8422
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.68.131
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:27:58.588500 8422 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:27:58.588773 8422 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:27:58.594935 8437 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:27:58.595064 8422 server_base.cc:1034] running on GCE node
W20260810 15:27:58.595293 8435 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:27:58.595468 8432 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:27:58.595774 8422 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:27:58.596086 8422 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:27:58.597291 8422 hybrid_clock.cc:648] HybridClock initialized: now 1786375678597269 us; error 39 us; skew 500 ppm
Aug 10 15:27:58 dist-test-slave-2p8l krb5kdc[6927](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375678, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:27:58.600222 8422 init.cc:377] Logged in from keytab as kudu/127.18.68.131@KRBTEST.COM (short username kudu)
I20260810 15:27:58.600835 8422 webserver.cc:460] Webserver started at http://127.18.68.131:36131/ using document root <none> and password file <none>
I20260810 15:27:58.601092 8422 fs_manager.cc:359] Metadata directory not provided
I20260810 15:27:58.601183 8422 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:27:58.601352 8422 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 15:27:58 dist-test-slave-2p8l krb5kdc[6927](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375678, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.131@KRBTEST.COM for HTTP/127.18.68.148@KRBTEST.COM
I20260810 15:27:58.615263 8422 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ts-2/data/instance:
uuid: "01caec6efdb1479ab708a9a149e685c3"
format_stamp: "Formatted at 2026-08-10 15:27:58 on dist-test-slave-2p8l"
server_key: "dc3421d8c95bab78deef01dd9d21256a"
server_key_iv: "0df6eb59176f9834766cef3b1e9d075f"
server_key_version: "kuduclusterkey@0"
I20260810 15:27:58.615851 8422 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ts-2/wal/instance:
uuid: "01caec6efdb1479ab708a9a149e685c3"
format_stamp: "Formatted at 2026-08-10 15:27:58 on dist-test-slave-2p8l"
server_key: "dc3421d8c95bab78deef01dd9d21256a"
server_key_iv: "0df6eb59176f9834766cef3b1e9d075f"
server_key_version: "kuduclusterkey@0"
I20260810 15:27:58.617887 8422 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.002s
I20260810 15:27:58.632707 8444 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:27:58.632925 8422 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.001s
I20260810 15:27:58.633045 8422 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ts-2/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ts-2/wal
uuid: "01caec6efdb1479ab708a9a149e685c3"
format_stamp: "Formatted at 2026-08-10 15:27:58 on dist-test-slave-2p8l"
server_key: "dc3421d8c95bab78deef01dd9d21256a"
server_key_iv: "0df6eb59176f9834766cef3b1e9d075f"
server_key_version: "kuduclusterkey@0"
I20260810 15:27:58.633158 8422 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:27:58.664729 8422 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:27:58.667114 8422 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:27:58.667282 8422 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:27:58.667555 8422 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 15:27:58.667974 8422 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 15:27:58.668035 8422 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 15:27:58.668069 8422 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 15:27:58.668092 8422 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 15:27:58.676860 8422 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.131:44465
I20260810 15:27:58.676939 8654 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.131:44465 every 8 connection(s)
I20260810 15:27:58.677367 8422 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ts-2/data/info.pb
I20260810 15:27:58.678185 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 8422
I20260810 15:27:58.678323 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ts-2/wal/instance
I20260810 15:27:58.678566 18706 external_mini_cluster.cc:1428] Setting key f61e0bf2e3718152f4c52bf7b70b0f40
Aug 10 15:27:58 dist-test-slave-2p8l krb5kdc[6927](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375678, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.131@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
I20260810 15:27:58.687837 8165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:27:58.678326 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.131:56843 (local address 127.18.68.190:44559)
0810 15:27:58.678399 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0810 15:27:58.678402 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 15:27:58.678665 (+ 263us) server_negotiation.cc:407] Connection header received
0810 15:27:58.679425 (+ 760us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:27:58.679426 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:27:58.679438 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:27:58.679491 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:27:58.680100 (+ 609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:27:58.680888 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:27:58.681878 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:27:58.682235 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:27:58.682320 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:27:58.684519 (+ 2199us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:27:58.684521 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:27:58.684521 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:27:58.684531 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:27:58.686331 (+ 1800us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:27:58.686824 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:27:58.686826 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:27:58.686826 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:27:58.686894 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:27:58.687180 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:27:58.687181 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:27:58.687182 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:27:58.687327 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:27:58.687398 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0810 15:27:58.687654 (+ 256us) server_negotiation.cc:299] Negotiation successful
0810 15:27:58.687740 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260810 15:27:58.687959 8657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:27:58.678336 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:44559 (local address 127.18.68.131:56843)
0810 15:27:58.678529 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0810 15:27:58.678572 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0810 15:27:58.679322 (+ 750us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:27:58.679564 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:27:58.679569 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:27:58.679807 (+ 238us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:27:58.680006 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:27:58.680010 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:27:58.680989 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:27:58.680990 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:27:58.681784 (+ 794us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:27:58.681787 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:27:58.682336 (+ 549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:27:58.682337 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:27:58.682441 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:27:58.683025 (+ 584us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:27:58.683034 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:27:58.684412 (+ 1378us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:27:58.686431 (+ 2019us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:27:58.686438 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:27:58.686440 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:27:58.686739 (+ 299us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:27:58.686985 (+ 246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:27:58.686986 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:27:58.686986 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:27:58.687099 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:27:58.687397 (+ 298us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:27:58.687403 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:27:58.687523 (+ 120us) client_negotiation.cc:769] Sending connection context
0810 15:27:58.687610 (+ 87us) client_negotiation.cc:240] Negotiation successful
0810 15:27:58.687740 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":109,"threads_started":1}
I20260810 15:27:58.688536 8655 heartbeater.cc:347] Connected to a master server at 127.18.68.190:44559
I20260810 15:27:58.688695 8655 heartbeater.cc:464] Registering TS with master...
I20260810 15:27:58.688905 8655 heartbeater.cc:511] Master 127.18.68.190:44559 requested a full tablet report, sending...
I20260810 15:27:58.689352 7755 ts_manager.cc:194] Registered new tserver with Master: 01caec6efdb1479ab708a9a149e685c3 (127.18.68.131:44465)
I20260810 15:27:58.689872 7755 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.68.131@KRBTEST.COM'} at 127.18.68.131:56843
I20260810 15:27:58.690721 18706 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 15:27:58.691326 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 7893
I20260810 15:27:58.708885 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 8172
I20260810 15:27:58.727276 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 8422
I20260810 15:27:58.737138 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 7699
I20260810 15:27:58.754477 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.190:44559
--webserver_interface=127.18.68.190
--webserver_port=34365
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab
--principal=kudu/127.18.68.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:35705
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.68.190:44559
--ranger_config_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.18.68.148:34695/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.18.68.148:34695/kms with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:27:58.838582 8658 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:27:58.838850 8658 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:27:58.838887 8658 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:27:58.840065 8658 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 15:27:58.840147 8658 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:27:58.840170 8658 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:27:58.840191 8658 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 15:27:58.840224 8658 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 15:27:58.841938 8658 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:35705
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.18.68.148:34695/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.18.68.190:44559
--ranger_config_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab
--principal=kudu/127.18.68.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.190:44559
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.68.190
--webserver_port=34365
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8658
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:27:58.842265 8658 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:27:58.842507 8658 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:27:58.847738 8667 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:27:58.847707 8669 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:27:58.847810 8658 server_base.cc:1034] running on GCE node
W20260810 15:27:58.847707 8666 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:27:58.848367 8658 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:27:58.848739 8658 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:27:58.849938 8658 hybrid_clock.cc:648] HybridClock initialized: now 1786375678849921 us; error 36 us; skew 500 ppm
Aug 10 15:27:58 dist-test-slave-2p8l krb5kdc[6927](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375678, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:27:58.852752 8658 init.cc:377] Logged in from keytab as kudu/127.18.68.190@KRBTEST.COM (short username kudu)
I20260810 15:27:58.853197 8658 webserver.cc:460] Webserver started at http://127.18.68.190:34365/ using document root <none> and password file <none>
I20260810 15:27:58.853446 8658 fs_manager.cc:359] Metadata directory not provided
I20260810 15:27:58.853502 8658 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 10 15:27:58 dist-test-slave-2p8l krb5kdc[6927](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375678, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.190@KRBTEST.COM for HTTP/127.18.68.148@KRBTEST.COM
I20260810 15:27:58.937105 8658 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:27:58.937922 8682 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:27:58.938138 8658 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:27:58.938261 8658 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/master-0/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/master-0/wal
uuid: "fa92dc2f060e4387af739de8afa7714d"
format_stamp: "Formatted at 2026-08-10 15:27:57 on dist-test-slave-2p8l"
server_key: "f5a320e1f6bd798dedabbd5ef0457397"
server_key_iv: "de91c369767b0d56b4848a946218636a"
server_key_version: "kuduclusterkey@0"
I20260810 15:27:58.938639 8658 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:27:58.958212 8658 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:27:58.959936 8658 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:27:58.960103 8658 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:27:58.964524 8658 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.190:44559
I20260810 15:27:58.964570 8766 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.190:44559 every 8 connection(s)
I20260810 15:27:58.964943 8658 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
I20260810 15:27:58.966243 8767 sys_catalog.cc:263] Verifying existing consensus state
I20260810 15:27:58.966931 8767 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fa92dc2f060e4387af739de8afa7714d: Bootstrap starting.
I20260810 15:27:58.971786 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 8658
I20260810 15:27:58.972080 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.18.68.148:34695/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.68.129:41893
--local_ip_for_outbound_sockets=127.18.68.129
--tserver_master_addrs=127.18.68.190:44559
--webserver_port=36837
--webserver_interface=127.18.68.129
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.129.keytab
--principal=kudu/127.18.68.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:35705
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.18.68.148:34695/kms with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 15:27:58.975502 8767 log.cc:824] T 00000000000000000000000000000000 P fa92dc2f060e4387af739de8afa7714d: Log is configured to *not* fsync() on all Append() calls
I20260810 15:27:58.977243 8767 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fa92dc2f060e4387af739de8afa7714d: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 15:27:58.977540 8767 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fa92dc2f060e4387af739de8afa7714d: Bootstrap complete.
I20260810 15:27:58.980116 8767 raft_consensus.cc:348] T 00000000000000000000000000000000 P fa92dc2f060e4387af739de8afa7714d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa92dc2f060e4387af739de8afa7714d" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 44559 } }
I20260810 15:27:58.980381 8767 raft_consensus.cc:729] T 00000000000000000000000000000000 P fa92dc2f060e4387af739de8afa7714d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa92dc2f060e4387af739de8afa7714d, State: Initialized, Role: FOLLOWER
I20260810 15:27:58.980594 8767 consensus_queue.cc:260] T 00000000000000000000000000000000 P fa92dc2f060e4387af739de8afa7714d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa92dc2f060e4387af739de8afa7714d" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 44559 } }
I20260810 15:27:58.980697 8767 raft_consensus.cc:388] T 00000000000000000000000000000000 P fa92dc2f060e4387af739de8afa7714d [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 15:27:58.980753 8767 raft_consensus.cc:482] T 00000000000000000000000000000000 P fa92dc2f060e4387af739de8afa7714d [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 15:27:58.980800 8767 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fa92dc2f060e4387af739de8afa7714d [term 1 FOLLOWER]: Advancing to term 2
I20260810 15:27:58.981789 8767 raft_consensus.cc:504] T 00000000000000000000000000000000 P fa92dc2f060e4387af739de8afa7714d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa92dc2f060e4387af739de8afa7714d" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 44559 } }
I20260810 15:27:58.981911 8767 leader_election.cc:302] T 00000000000000000000000000000000 P fa92dc2f060e4387af739de8afa7714d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fa92dc2f060e4387af739de8afa7714d; no voters:
I20260810 15:27:58.982136 8767 leader_election.cc:288] T 00000000000000000000000000000000 P fa92dc2f060e4387af739de8afa7714d [CANDIDATE]: Term 2 election: Requested vote from peers
I20260810 15:27:58.982205 8774 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fa92dc2f060e4387af739de8afa7714d [term 2 FOLLOWER]: Leader election won for term 2
I20260810 15:27:58.982359 8774 raft_consensus.cc:686] T 00000000000000000000000000000000 P fa92dc2f060e4387af739de8afa7714d [term 2 LEADER]: Becoming Leader. State: Replica: fa92dc2f060e4387af739de8afa7714d, State: Running, Role: LEADER
I20260810 15:27:58.982421 8767 sys_catalog.cc:564] T 00000000000000000000000000000000 P fa92dc2f060e4387af739de8afa7714d [sys.catalog]: configured and running, proceeding with master startup.
I20260810 15:27:58.982493 8774 consensus_queue.cc:237] T 00000000000000000000000000000000 P fa92dc2f060e4387af739de8afa7714d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa92dc2f060e4387af739de8afa7714d" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 44559 } }
I20260810 15:27:58.982796 8774 sys_catalog.cc:455] T 00000000000000000000000000000000 P fa92dc2f060e4387af739de8afa7714d [sys.catalog]: SysCatalogTable state changed. Reason: New leader fa92dc2f060e4387af739de8afa7714d. Latest consensus state: current_term: 2 leader_uuid: "fa92dc2f060e4387af739de8afa7714d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa92dc2f060e4387af739de8afa7714d" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 44559 } } }
I20260810 15:27:58.982868 8774 sys_catalog.cc:458] T 00000000000000000000000000000000 P fa92dc2f060e4387af739de8afa7714d [sys.catalog]: This master's current role is: LEADER
I20260810 15:27:58.982996 8775 sys_catalog.cc:455] T 00000000000000000000000000000000 P fa92dc2f060e4387af739de8afa7714d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "fa92dc2f060e4387af739de8afa7714d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa92dc2f060e4387af739de8afa7714d" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 44559 } } }
I20260810 15:27:58.983047 8775 sys_catalog.cc:458] T 00000000000000000000000000000000 P fa92dc2f060e4387af739de8afa7714d [sys.catalog]: This master's current role is: LEADER
I20260810 15:27:58.983130 8783 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 15:27:58.983583 8783 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 15:27:58.983724 8783 catalog_manager.cc:1259] Loaded cluster ID: 6b89554d113e412c957aa362cd431b8c
I20260810 15:27:58.983762 8783 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 15:27:58.983999 8767 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260810 15:27:58.987579 8783 catalog_manager.cc:1504] Loading token signing keys...
I20260810 15:27:58.988142 8783 catalog_manager.cc:5879] T 00000000000000000000000000000000 P fa92dc2f060e4387af739de8afa7714d: Loaded TSK: 0
I20260810 15:27:58.988423 8783 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260810 15:27:59.088670 8771 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:27:59.088960 8771 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:27:59.089004 8771 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:27:59.090724 8771 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:27:59.090785 8771 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:27:59.090826 8771 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.68.129
I20260810 15:27:59.092936 8771 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:35705
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.18.68.148:34695/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.129.keytab
--principal=kudu/127.18.68.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.68.129:41893
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.68.129
--webserver_port=36837
--tserver_master_addrs=127.18.68.190:44559
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8771
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.68.129
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:27:59.093194 8771 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:27:59.093473 8771 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:27:59.100734 8831 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:27:59.100736 8828 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:27:59.101228 8771 server_base.cc:1034] running on GCE node
W20260810 15:27:59.101400 8826 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:27:59.101681 8771 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:27:59.101977 8771 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:27:59.103189 8771 hybrid_clock.cc:648] HybridClock initialized: now 1786375679103155 us; error 52 us; skew 500 ppm
Aug 10 15:27:59 dist-test-slave-2p8l krb5kdc[6927](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375679, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:27:59.106745 8771 init.cc:377] Logged in from keytab as kudu/127.18.68.129@KRBTEST.COM (short username kudu)
I20260810 15:27:59.107367 8771 webserver.cc:460] Webserver started at http://127.18.68.129:36837/ using document root <none> and password file <none>
I20260810 15:27:59.107751 8771 fs_manager.cc:359] Metadata directory not provided
I20260810 15:27:59.107908 8771 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 10 15:27:59 dist-test-slave-2p8l krb5kdc[6927](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375679, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.129@KRBTEST.COM for HTTP/127.18.68.148@KRBTEST.COM
I20260810 15:27:59.127075 8771 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:27:59.133944 8844 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:27:59.134256 8771 fs_manager.cc:725] Time spent opening block manager: real 0.007s user 0.001s sys 0.000s
I20260810 15:27:59.134348 8771 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ts-0/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ts-0/wal
uuid: "d99843d5e4ae466f84a34ea4a4c3036a"
format_stamp: "Formatted at 2026-08-10 15:27:58 on dist-test-slave-2p8l"
server_key: "2789896189fab78abdbbb63f6fc016d0"
server_key_iv: "74521b091a2ffe6cb6fc69576eeee36c"
server_key_version: "kuduclusterkey@0"
I20260810 15:27:59.134842 8771 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:27:59.172149 8771 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:27:59.174688 8771 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:27:59.174844 8771 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:27:59.175107 8771 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 15:27:59.175453 8771 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 15:27:59.175498 8771 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 15:27:59.175529 8771 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 15:27:59.175549 8771 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 15:27:59.183122 8771 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.129:41893
I20260810 15:27:59.183308 9056 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.129:41893 every 8 connection(s)
I20260810 15:27:59.183557 8771 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ts-0/data/info.pb
I20260810 15:27:59.192502 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 8771
I20260810 15:27:59.192830 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.18.68.148:34695/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.68.130:33379
--local_ip_for_outbound_sockets=127.18.68.130
--tserver_master_addrs=127.18.68.190:44559
--webserver_port=42801
--webserver_interface=127.18.68.130
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.130.keytab
--principal=kudu/127.18.68.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:35705
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.18.68.148:34695/kms with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 15:27:59 dist-test-slave-2p8l krb5kdc[6927](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375679, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.129@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
I20260810 15:27:59.200973 9061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:27:59.184586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.129:54775 (local address 127.18.68.190:44559)
0810 15:27:59.186182 (+ 1596us) server_negotiation.cc:206] Beginning negotiation
0810 15:27:59.186190 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 15:27:59.186216 (+ 26us) server_negotiation.cc:407] Connection header received
0810 15:27:59.186327 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:27:59.186332 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:27:59.186372 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:27:59.186516 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:27:59.187098 (+ 582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:27:59.187949 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:27:59.188992 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:27:59.189400 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:27:59.189523 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:27:59.196396 (+ 6873us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:27:59.196400 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:27:59.196400 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:27:59.196412 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:27:59.198736 (+ 2324us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:27:59.199286 (+ 550us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:27:59.199290 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:27:59.199290 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:27:59.199423 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:27:59.199772 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:27:59.199773 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:27:59.199774 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:27:59.200108 (+ 334us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:27:59.200175 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0810 15:27:59.200615 (+ 440us) server_negotiation.cc:299] Negotiation successful
0810 15:27:59.200751 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1545,"thread_start_us":108,"threads_started":1}
I20260810 15:27:59.201610 9060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:27:59.184479 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:44559 (local address 127.18.68.129:54775)
0810 15:27:59.184680 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0810 15:27:59.184722 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0810 15:27:59.185195 (+ 473us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:27:59.186556 (+ 1361us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:27:59.186560 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:27:59.186791 (+ 231us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:27:59.186977 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:27:59.186982 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:27:59.188063 (+ 1081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:27:59.188064 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:27:59.188883 (+ 819us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:27:59.188886 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:27:59.189519 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:27:59.189520 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:27:59.189643 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:27:59.191910 (+ 2267us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:27:59.191920 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:27:59.196256 (+ 4336us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:27:59.198843 (+ 2587us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:27:59.198850 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:27:59.198852 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:27:59.199169 (+ 317us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:27:59.199524 (+ 355us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:27:59.199525 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:27:59.199525 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:27:59.199669 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:27:59.200234 (+ 565us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:27:59.200240 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:27:59.200399 (+ 159us) client_negotiation.cc:769] Sending connection context
0810 15:27:59.201223 (+ 824us) client_negotiation.cc:240] Negotiation successful
0810 15:27:59.201392 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":127,"threads_started":1}
I20260810 15:27:59.202522 9057 heartbeater.cc:347] Connected to a master server at 127.18.68.190:44559
I20260810 15:27:59.202620 9057 heartbeater.cc:464] Registering TS with master...
I20260810 15:27:59.202805 9057 heartbeater.cc:511] Master 127.18.68.190:44559 requested a full tablet report, sending...
W20260810 15:27:59.203706 9057 heartbeater.cc:644] Failed to heartbeat to 127.18.68.190:44559 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260810 15:27:59.203781 9057 heartbeater.cc:464] Registering TS with master...
I20260810 15:27:59.203850 9057 heartbeater.cc:511] Master 127.18.68.190:44559 requested a full tablet report, sending...
I20260810 15:27:59.204231 9057 heartbeater.cc:464] Registering TS with master...
I20260810 15:27:59.204309 9057 heartbeater.cc:511] Master 127.18.68.190:44559 requested a full tablet report, sending...
W20260810 15:27:59.204670 9057 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260810 15:27:59.309197 9063 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:27:59.309401 9063 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:27:59.309424 9063 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:27:59.310657 9063 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:27:59.310703 9063 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:27:59.310729 9063 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.68.130
I20260810 15:27:59.312285 9063 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:35705
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.18.68.148:34695/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.130.keytab
--principal=kudu/127.18.68.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.68.130:33379
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.68.130
--webserver_port=42801
--tserver_master_addrs=127.18.68.190:44559
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9063
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.68.130
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:27:59.312602 9063 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:27:59.312870 9063 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:27:59.318996 9071 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:27:59.318988 9073 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:27:59.319960 9063 server_base.cc:1034] running on GCE node
W20260810 15:27:59.322191 9075 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:27:59.322535 9063 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:27:59.322901 9063 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:27:59.324108 9063 hybrid_clock.cc:648] HybridClock initialized: now 1786375679324087 us; error 38 us; skew 500 ppm
Aug 10 15:27:59 dist-test-slave-2p8l krb5kdc[6927](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375679, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:27:59.327569 9063 init.cc:377] Logged in from keytab as kudu/127.18.68.130@KRBTEST.COM (short username kudu)
I20260810 15:27:59.328229 9063 webserver.cc:460] Webserver started at http://127.18.68.130:42801/ using document root <none> and password file <none>
I20260810 15:27:59.328495 9063 fs_manager.cc:359] Metadata directory not provided
I20260810 15:27:59.328594 9063 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 10 15:27:59 dist-test-slave-2p8l krb5kdc[6927](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375679, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.130@KRBTEST.COM for HTTP/127.18.68.148@KRBTEST.COM
I20260810 15:27:59.347412 9063 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260810 15:27:59.348731 9090 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:27:59.348989 9063 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 15:27:59.349139 9063 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ts-1/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ts-1/wal
uuid: "6af51e44f4a94394914bda860b78270f"
format_stamp: "Formatted at 2026-08-10 15:27:58 on dist-test-slave-2p8l"
server_key: "c6e9baea5a2bbd7bab5b905aa091fc8c"
server_key_iv: "f95df84d8fe1a4ceb0c9ebc3f17032c4"
server_key_version: "kuduclusterkey@0"
I20260810 15:27:59.349717 9063 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:27:59.364650 9063 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:27:59.367048 9063 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:27:59.367223 9063 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:27:59.367525 9063 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 15:27:59.367949 9063 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 15:27:59.368003 9063 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 15:27:59.368038 9063 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 15:27:59.368063 9063 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 15:27:59.376406 9063 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.130:33379
I20260810 15:27:59.376583 9297 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.130:33379 every 8 connection(s)
I20260810 15:27:59.376928 9063 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ts-1/data/info.pb
I20260810 15:27:59.384032 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 9063
I20260810 15:27:59.384390 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.18.68.148:34695/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.68.131:44465
--local_ip_for_outbound_sockets=127.18.68.131
--tserver_master_addrs=127.18.68.190:44559
--webserver_port=36131
--webserver_interface=127.18.68.131
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.131.keytab
--principal=kudu/127.18.68.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:35705
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.18.68.148:34695/kms with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 15:27:59 dist-test-slave-2p8l krb5kdc[6927](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375679, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.130@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
I20260810 15:27:59.389714 9061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:27:59.377779 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.130:58431 (local address 127.18.68.190:44559)
0810 15:27:59.377845 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0810 15:27:59.377847 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:27:59.378152 (+ 305us) server_negotiation.cc:407] Connection header received
0810 15:27:59.380718 (+ 2566us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:27:59.380720 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:27:59.380736 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:27:59.380792 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:27:59.381390 (+ 598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:27:59.381901 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:27:59.383104 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:27:59.383317 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:27:59.383406 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:27:59.386337 (+ 2931us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:27:59.386339 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:27:59.386339 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:27:59.386348 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:27:59.387874 (+ 1526us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:27:59.388444 (+ 570us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:27:59.388446 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:27:59.388446 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:27:59.388523 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:27:59.388876 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:27:59.388878 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:27:59.388878 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:27:59.389029 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:27:59.389115 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0810 15:27:59.389492 (+ 377us) server_negotiation.cc:299] Negotiation successful
0810 15:27:59.389601 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260810 15:27:59.389926 9300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:27:59.377781 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:44559 (local address 127.18.68.130:58431)
0810 15:27:59.377965 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0810 15:27:59.378014 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0810 15:27:59.380577 (+ 2563us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:27:59.380875 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:27:59.380879 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:27:59.381066 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:27:59.381275 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:27:59.381280 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:27:59.382008 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:27:59.382009 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:27:59.382991 (+ 982us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:27:59.382994 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:27:59.383498 (+ 504us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:27:59.383499 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:27:59.383668 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:27:59.384366 (+ 698us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:27:59.384387 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:27:59.386205 (+ 1818us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:27:59.387984 (+ 1779us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:27:59.387992 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:27:59.387995 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:27:59.388326 (+ 331us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:27:59.388609 (+ 283us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:27:59.388610 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:27:59.388610 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:27:59.388772 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:27:59.389115 (+ 343us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:27:59.389123 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:27:59.389300 (+ 177us) client_negotiation.cc:769] Sending connection context
0810 15:27:59.389421 (+ 121us) client_negotiation.cc:240] Negotiation successful
0810 15:27:59.389630 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":103,"threads_started":1}
I20260810 15:27:59.390625 9298 heartbeater.cc:347] Connected to a master server at 127.18.68.190:44559
I20260810 15:27:59.390766 9298 heartbeater.cc:464] Registering TS with master...
I20260810 15:27:59.390983 9298 heartbeater.cc:511] Master 127.18.68.190:44559 requested a full tablet report, sending...
W20260810 15:27:59.391819 9298 heartbeater.cc:644] Failed to heartbeat to 127.18.68.190:44559 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260810 15:27:59.391902 9298 heartbeater.cc:464] Registering TS with master...
I20260810 15:27:59.391978 9298 heartbeater.cc:511] Master 127.18.68.190:44559 requested a full tablet report, sending...
I20260810 15:27:59.392342 9298 heartbeater.cc:464] Registering TS with master...
I20260810 15:27:59.392431 9298 heartbeater.cc:511] Master 127.18.68.190:44559 requested a full tablet report, sending...
W20260810 15:27:59.392827 9298 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260810 15:27:59.489248 9301 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:27:59.489526 9301 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:27:59.489565 9301 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:27:59.491253 9301 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:27:59.491318 9301 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:27:59.491358 9301 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.68.131
I20260810 15:27:59.493577 9301 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:35705
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.18.68.148:34695/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.131.keytab
--principal=kudu/127.18.68.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.68.131:44465
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.68.131
--webserver_port=36131
--tserver_master_addrs=127.18.68.190:44559
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9301
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.68.131
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:27:59.493821 9301 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:27:59.494131 9301 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:27:59.500765 9316 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:27:59.500769 9314 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:27:59.501120 9301 server_base.cc:1034] running on GCE node
W20260810 15:27:59.501055 9320 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:27:59.501466 9301 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:27:59.501809 9301 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:27:59.502970 9301 hybrid_clock.cc:648] HybridClock initialized: now 1786375679502938 us; error 52 us; skew 500 ppm
Aug 10 15:27:59 dist-test-slave-2p8l krb5kdc[6927](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375679, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:27:59.505647 9301 init.cc:377] Logged in from keytab as kudu/127.18.68.131@KRBTEST.COM (short username kudu)
I20260810 15:27:59.506196 9301 webserver.cc:460] Webserver started at http://127.18.68.131:36131/ using document root <none> and password file <none>
I20260810 15:27:59.506438 9301 fs_manager.cc:359] Metadata directory not provided
I20260810 15:27:59.506498 9301 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 10 15:27:59 dist-test-slave-2p8l krb5kdc[6927](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375679, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.131@KRBTEST.COM for HTTP/127.18.68.148@KRBTEST.COM
I20260810 15:27:59.521096 9301 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.001s sys 0.000s
I20260810 15:27:59.522154 9333 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:27:59.522382 9301 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:27:59.522482 9301 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ts-2/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ts-2/wal
uuid: "01caec6efdb1479ab708a9a149e685c3"
format_stamp: "Formatted at 2026-08-10 15:27:58 on dist-test-slave-2p8l"
server_key: "dc3421d8c95bab78deef01dd9d21256a"
server_key_iv: "0df6eb59176f9834766cef3b1e9d075f"
server_key_version: "kuduclusterkey@0"
I20260810 15:27:59.522869 9301 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:27:59.538234 9301 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:27:59.540323 9301 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:27:59.540495 9301 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:27:59.540827 9301 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 15:27:59.541247 9301 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 15:27:59.541304 9301 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 15:27:59.541347 9301 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 15:27:59.541375 9301 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 15:27:59.549559 9301 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.131:44465
I20260810 15:27:59.549662 9520 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.131:44465 every 8 connection(s)
I20260810 15:27:59.550030 9301 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ts-2/data/info.pb
I20260810 15:27:59.555022 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 9301
Aug 10 15:27:59 dist-test-slave-2p8l krb5kdc[6927](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375679, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.131@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
I20260810 15:27:59.561604 9061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:27:59.550937 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.131:42413 (local address 127.18.68.190:44559)
0810 15:27:59.551023 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0810 15:27:59.551026 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 15:27:59.551252 (+ 226us) server_negotiation.cc:407] Connection header received
0810 15:27:59.551768 (+ 516us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:27:59.551769 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:27:59.551783 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:27:59.551837 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:27:59.552430 (+ 593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:27:59.553107 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:27:59.554434 (+ 1327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:27:59.554753 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:27:59.554837 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:27:59.557998 (+ 3161us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:27:59.557999 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:27:59.558000 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:27:59.558009 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:27:59.559807 (+ 1798us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:27:59.560349 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:27:59.560350 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:27:59.560351 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:27:59.560416 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:27:59.560834 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:27:59.560836 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:27:59.560836 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:27:59.560973 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:27:59.561035 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0810 15:27:59.561422 (+ 387us) server_negotiation.cc:299] Negotiation successful
0810 15:27:59.561506 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260810 15:27:59.561828 9525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:27:59.550906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:44559 (local address 127.18.68.131:42413)
0810 15:27:59.551096 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0810 15:27:59.551149 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0810 15:27:59.551655 (+ 506us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:27:59.551922 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:27:59.551926 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:27:59.552131 (+ 205us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:27:59.552328 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:27:59.552333 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:27:59.553225 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:27:59.553226 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:27:59.554338 (+ 1112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:27:59.554341 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:27:59.555342 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:27:59.555343 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:27:59.555696 (+ 353us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:27:59.556338 (+ 642us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:27:59.556348 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:27:59.557883 (+ 1535us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:27:59.559909 (+ 2026us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:27:59.559918 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:27:59.559921 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:27:59.560254 (+ 333us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:27:59.560492 (+ 238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:27:59.560492 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:27:59.560493 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:27:59.560737 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:27:59.561062 (+ 325us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:27:59.561068 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:27:59.561258 (+ 190us) client_negotiation.cc:769] Sending connection context
0810 15:27:59.561397 (+ 139us) client_negotiation.cc:240] Negotiation successful
0810 15:27:59.561567 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":115,"threads_started":1}
I20260810 15:27:59.562398 9521 heartbeater.cc:347] Connected to a master server at 127.18.68.190:44559
I20260810 15:27:59.562508 9521 heartbeater.cc:464] Registering TS with master...
I20260810 15:27:59.562738 9521 heartbeater.cc:511] Master 127.18.68.190:44559 requested a full tablet report, sending...
W20260810 15:27:59.563511 9521 heartbeater.cc:644] Failed to heartbeat to 127.18.68.190:44559 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260810 15:27:59.563656 9521 heartbeater.cc:464] Registering TS with master...
I20260810 15:27:59.563725 9521 heartbeater.cc:511] Master 127.18.68.190:44559 requested a full tablet report, sending...
I20260810 15:27:59.564064 9521 heartbeater.cc:464] Registering TS with master...
I20260810 15:27:59.564189 9521 heartbeater.cc:511] Master 127.18.68.190:44559 requested a full tablet report, sending...
W20260810 15:27:59.564548 9521 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260810 15:27:59.568310 9526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:27:59.555479 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58592 (local address 127.18.68.190:44559)
0810 15:27:59.555926 (+ 447us) server_negotiation.cc:206] Beginning negotiation
0810 15:27:59.555928 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:27:59.556070 (+ 142us) server_negotiation.cc:407] Connection header received
0810 15:27:59.556162 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:27:59.556163 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:27:59.556176 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:27:59.556243 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:27:59.558286 (+ 2043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:27:59.561189 (+ 2903us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:27:59.562947 (+ 1758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:27:59.563300 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:27:59.563362 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:27:59.564922 (+ 1560us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:27:59.564923 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:27:59.564924 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:27:59.564931 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:27:59.566857 (+ 1926us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:27:59.567284 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:27:59.567285 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:27:59.567286 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:27:59.567418 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:27:59.567710 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:27:59.567711 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:27:59.567711 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:27:59.567851 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:27:59.568030 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0810 15:27:59.568112 (+ 82us) server_negotiation.cc:299] Negotiation successful
0810 15:27:59.568205 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":427,"thread_start_us":71,"threads_started":1}
Aug 10 15:28:00 dist-test-slave-2p8l krb5kdc[6927](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786375680, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:28:00.204844 9057 heartbeater.cc:464] Registering TS with master...
I20260810 15:28:00.205006 9057 heartbeater.cc:511] Master 127.18.68.190:44559 requested a full tablet report, sending...
I20260810 15:28:00.205406 8707 ts_manager.cc:194] Registered new tserver with Master: d99843d5e4ae466f84a34ea4a4c3036a (127.18.68.129:41893)
I20260810 15:28:00.206429 8707 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.68.129@KRBTEST.COM'} at 127.18.68.129:54775
I20260810 15:28:00.392990 9298 heartbeater.cc:464] Registering TS with master...
I20260810 15:28:00.393146 9298 heartbeater.cc:511] Master 127.18.68.190:44559 requested a full tablet report, sending...
I20260810 15:28:00.393410 8707 ts_manager.cc:194] Registered new tserver with Master: 6af51e44f4a94394914bda860b78270f (127.18.68.130:33379)
I20260810 15:28:00.393923 8707 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.68.130@KRBTEST.COM'} at 127.18.68.130:58431
Aug 10 15:28:00 dist-test-slave-2p8l krb5kdc[6927](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375680, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.190@KRBTEST.COM for HTTP/127.18.68.148@KRBTEST.COM
I20260810 15:28:00.564731 9521 heartbeater.cc:464] Registering TS with master...
I20260810 15:28:00.564899 9521 heartbeater.cc:511] Master 127.18.68.190:44559 requested a full tablet report, sending...
I20260810 15:28:00.565189 8707 ts_manager.cc:194] Registered new tserver with Master: 01caec6efdb1479ab708a9a149e685c3 (127.18.68.131:44465)
I20260810 15:28:00.565689 8707 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.68.131@KRBTEST.COM'} at 127.18.68.131:42413
I20260810 15:28:00.574875 18706 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 15:28:00.593796 9559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:00.580122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58608 (local address 127.18.68.190:44559)
0810 15:28:00.580359 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0810 15:28:00.580362 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 15:28:00.580502 (+ 140us) server_negotiation.cc:407] Connection header received
0810 15:28:00.580646 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:28:00.580648 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:28:00.580662 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:28:00.580717 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:28:00.581611 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:00.582562 (+ 951us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:00.583766 (+ 1204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:00.584096 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:00.584152 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:00.589979 (+ 5827us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:28:00.589981 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:28:00.589982 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:28:00.589992 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:28:00.592230 (+ 2238us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:28:00.592742 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:28:00.592744 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:28:00.592745 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:28:00.592818 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:28:00.593057 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:28:00.593058 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:28:00.593058 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:28:00.593215 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:28:00.593297 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0810 15:28:00.593573 (+ 276us) server_negotiation.cc:299] Negotiation successful
0810 15:28:00.593682 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":209,"thread_start_us":70,"threads_started":1}
I20260810 15:28:00.596608 8707 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58608:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 15:28:00.599395 8707 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 15:28:00.617652 9581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:00.603062 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.130:33379 (local address 127.0.0.1:40282)
0810 15:28:00.604487 (+ 1425us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:00.604498 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 15:28:00.604575 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:28:00.606079 (+ 1504us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:28:00.606081 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:28:00.606083 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:28:00.606143 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:28:00.606145 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:28:00.611327 (+ 5182us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:28:00.611329 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:28:00.612893 (+ 1564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:28:00.612897 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:28:00.617235 (+ 4338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:28:00.617237 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:28:00.617354 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:00.617373 (+ 19us) client_negotiation.cc:769] Sending connection context
0810 15:28:00.617458 (+ 85us) client_negotiation.cc:240] Negotiation successful
0810 15:28:00.617534 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1404,"thread_start_us":87,"threads_started":1}
I20260810 15:28:00.621155 9578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:00.602786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.131:44465 (local address 127.0.0.1:45078)
0810 15:28:00.604079 (+ 1293us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:00.604089 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 15:28:00.604130 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:28:00.604678 (+ 548us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:28:00.604682 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:28:00.604685 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:28:00.604765 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:28:00.604766 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:28:00.613095 (+ 8329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:28:00.613097 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:28:00.614730 (+ 1633us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:28:00.614734 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:28:00.620897 (+ 6163us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:28:00.620899 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:28:00.620970 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:00.620974 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 15:28:00.621010 (+ 36us) client_negotiation.cc:240] Negotiation successful
0810 15:28:00.621059 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1277,"mutex_wait_us":5,"spinlock_wait_cycles":768,"thread_start_us":96,"threads_started":1}
I20260810 15:28:00.621636 9579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:00.602895 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45078 (local address 127.18.68.131:44465)
0810 15:28:00.604286 (+ 1391us) server_negotiation.cc:206] Beginning negotiation
0810 15:28:00.604291 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 15:28:00.604303 (+ 12us) server_negotiation.cc:407] Connection header received
0810 15:28:00.604342 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:28:00.604345 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:28:00.604363 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:28:00.604850 (+ 487us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:28:00.604941 (+ 91us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:00.609399 (+ 4458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:00.614856 (+ 5457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:00.615780 (+ 924us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:00.621327 (+ 5547us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:00.621441 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0810 15:28:00.621476 (+ 35us) server_negotiation.cc:299] Negotiation successful
0810 15:28:00.621537 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1345,"thread_start_us":59,"threads_started":1}
I20260810 15:28:00.621949 9582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:00.603188 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40282 (local address 127.18.68.130:33379)
0810 15:28:00.605802 (+ 2614us) server_negotiation.cc:206] Beginning negotiation
0810 15:28:00.605807 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 15:28:00.605819 (+ 12us) server_negotiation.cc:407] Connection header received
0810 15:28:00.605855 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:28:00.605857 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:28:00.605873 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:28:00.605954 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:28:00.606484 (+ 530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:00.611211 (+ 4727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:00.615911 (+ 4700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:00.616798 (+ 887us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:00.616874 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:00.616939 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0810 15:28:00.621799 (+ 4860us) server_negotiation.cc:299] Negotiation successful
0810 15:28:00.621862 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2572,"thread_start_us":64,"threads_started":1}
I20260810 15:28:00.622393 9577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:00.602785 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.129:41893 (local address 127.0.0.1:53546)
0810 15:28:00.603846 (+ 1061us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:00.603891 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0810 15:28:00.603959 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:28:00.607694 (+ 3735us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:28:00.607695 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:28:00.607698 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:28:00.608278 (+ 580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:28:00.608281 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:28:00.617928 (+ 9647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:28:00.617929 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:28:00.619252 (+ 1323us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:28:00.619256 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:28:00.622138 (+ 2882us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:28:00.622139 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:28:00.622233 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:00.622238 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 15:28:00.622274 (+ 36us) client_negotiation.cc:240] Negotiation successful
0810 15:28:00.622321 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1025,"thread_start_us":96,"threads_started":1}
I20260810 15:28:00.622594 9391 tablet_service.cc:1467] Processing CreateTablet for tablet d78a677898154cc08e33a43ac5cdaa17 (DEFAULT_TABLE table=test-table [id=2c1aa8bffa6e407cb0055678a9d8fc79]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 15:28:00.622851 9583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:00.603294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53546 (local address 127.18.68.129:41893)
0810 15:28:00.606296 (+ 3002us) server_negotiation.cc:206] Beginning negotiation
0810 15:28:00.606302 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 15:28:00.606315 (+ 13us) server_negotiation.cc:407] Connection header received
0810 15:28:00.606355 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:28:00.606357 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:28:00.606375 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:28:00.608407 (+ 2032us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:28:00.608570 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:00.617128 (+ 8558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:00.619798 (+ 2670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:00.620726 (+ 928us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:00.622602 (+ 1876us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:00.622684 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0810 15:28:00.622716 (+ 32us) server_negotiation.cc:299] Negotiation successful
0810 15:28:00.622767 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2949,"thread_start_us":80,"threads_started":1}
I20260810 15:28:00.622759 9179 tablet_service.cc:1467] Processing CreateTablet for tablet d78a677898154cc08e33a43ac5cdaa17 (DEFAULT_TABLE table=test-table [id=2c1aa8bffa6e407cb0055678a9d8fc79]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 15:28:00.623031 9391 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d78a677898154cc08e33a43ac5cdaa17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:28:00.623183 9179 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d78a677898154cc08e33a43ac5cdaa17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:28:00.623498 8934 tablet_service.cc:1467] Processing CreateTablet for tablet d78a677898154cc08e33a43ac5cdaa17 (DEFAULT_TABLE table=test-table [id=2c1aa8bffa6e407cb0055678a9d8fc79]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 15:28:00.623824 8934 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d78a677898154cc08e33a43ac5cdaa17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:28:00.629225 9586 tablet_bootstrap.cc:492] T d78a677898154cc08e33a43ac5cdaa17 P 6af51e44f4a94394914bda860b78270f: Bootstrap starting.
I20260810 15:28:00.630040 9586 tablet_bootstrap.cc:654] T d78a677898154cc08e33a43ac5cdaa17 P 6af51e44f4a94394914bda860b78270f: Neither blocks nor log segments found. Creating new log.
I20260810 15:28:00.630426 9586 log.cc:824] T d78a677898154cc08e33a43ac5cdaa17 P 6af51e44f4a94394914bda860b78270f: Log is configured to *not* fsync() on all Append() calls
I20260810 15:28:00.630870 9585 tablet_bootstrap.cc:492] T d78a677898154cc08e33a43ac5cdaa17 P d99843d5e4ae466f84a34ea4a4c3036a: Bootstrap starting.
I20260810 15:28:00.631670 9584 tablet_bootstrap.cc:492] T d78a677898154cc08e33a43ac5cdaa17 P 01caec6efdb1479ab708a9a149e685c3: Bootstrap starting.
I20260810 15:28:00.631974 9585 tablet_bootstrap.cc:654] T d78a677898154cc08e33a43ac5cdaa17 P d99843d5e4ae466f84a34ea4a4c3036a: Neither blocks nor log segments found. Creating new log.
I20260810 15:28:00.632302 9585 log.cc:824] T d78a677898154cc08e33a43ac5cdaa17 P d99843d5e4ae466f84a34ea4a4c3036a: Log is configured to *not* fsync() on all Append() calls
I20260810 15:28:00.632365 9584 tablet_bootstrap.cc:654] T d78a677898154cc08e33a43ac5cdaa17 P 01caec6efdb1479ab708a9a149e685c3: Neither blocks nor log segments found. Creating new log.
I20260810 15:28:00.632671 9584 log.cc:824] T d78a677898154cc08e33a43ac5cdaa17 P 01caec6efdb1479ab708a9a149e685c3: Log is configured to *not* fsync() on all Append() calls
I20260810 15:28:00.633198 9586 tablet_bootstrap.cc:492] T d78a677898154cc08e33a43ac5cdaa17 P 6af51e44f4a94394914bda860b78270f: No bootstrap required, opened a new log
I20260810 15:28:00.633278 9586 ts_tablet_manager.cc:1397] T d78a677898154cc08e33a43ac5cdaa17 P 6af51e44f4a94394914bda860b78270f: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.002s
I20260810 15:28:00.633479 9584 tablet_bootstrap.cc:492] T d78a677898154cc08e33a43ac5cdaa17 P 01caec6efdb1479ab708a9a149e685c3: No bootstrap required, opened a new log
I20260810 15:28:00.633554 9584 ts_tablet_manager.cc:1397] T d78a677898154cc08e33a43ac5cdaa17 P 01caec6efdb1479ab708a9a149e685c3: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 15:28:00.636018 9586 raft_consensus.cc:348] T d78a677898154cc08e33a43ac5cdaa17 P 6af51e44f4a94394914bda860b78270f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d99843d5e4ae466f84a34ea4a4c3036a" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 41893 } } peers { permanent_uuid: "01caec6efdb1479ab708a9a149e685c3" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 44465 } } peers { permanent_uuid: "6af51e44f4a94394914bda860b78270f" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 33379 } }
I20260810 15:28:00.636019 9584 raft_consensus.cc:348] T d78a677898154cc08e33a43ac5cdaa17 P 01caec6efdb1479ab708a9a149e685c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d99843d5e4ae466f84a34ea4a4c3036a" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 41893 } } peers { permanent_uuid: "01caec6efdb1479ab708a9a149e685c3" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 44465 } } peers { permanent_uuid: "6af51e44f4a94394914bda860b78270f" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 33379 } }
I20260810 15:28:00.636211 9586 raft_consensus.cc:374] T d78a677898154cc08e33a43ac5cdaa17 P 6af51e44f4a94394914bda860b78270f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:28:00.636211 9584 raft_consensus.cc:374] T d78a677898154cc08e33a43ac5cdaa17 P 01caec6efdb1479ab708a9a149e685c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:28:00.636255 9584 raft_consensus.cc:729] T d78a677898154cc08e33a43ac5cdaa17 P 01caec6efdb1479ab708a9a149e685c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01caec6efdb1479ab708a9a149e685c3, State: Initialized, Role: FOLLOWER
I20260810 15:28:00.636255 9586 raft_consensus.cc:729] T d78a677898154cc08e33a43ac5cdaa17 P 6af51e44f4a94394914bda860b78270f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6af51e44f4a94394914bda860b78270f, State: Initialized, Role: FOLLOWER
I20260810 15:28:00.636371 9586 consensus_queue.cc:260] T d78a677898154cc08e33a43ac5cdaa17 P 6af51e44f4a94394914bda860b78270f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d99843d5e4ae466f84a34ea4a4c3036a" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 41893 } } peers { permanent_uuid: "01caec6efdb1479ab708a9a149e685c3" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 44465 } } peers { permanent_uuid: "6af51e44f4a94394914bda860b78270f" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 33379 } }
I20260810 15:28:00.636373 9584 consensus_queue.cc:260] T d78a677898154cc08e33a43ac5cdaa17 P 01caec6efdb1479ab708a9a149e685c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d99843d5e4ae466f84a34ea4a4c3036a" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 41893 } } peers { permanent_uuid: "01caec6efdb1479ab708a9a149e685c3" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 44465 } } peers { permanent_uuid: "6af51e44f4a94394914bda860b78270f" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 33379 } }
I20260810 15:28:00.636668 9584 ts_tablet_manager.cc:1428] T d78a677898154cc08e33a43ac5cdaa17 P 01caec6efdb1479ab708a9a149e685c3: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 15:28:00.636668 9586 ts_tablet_manager.cc:1428] T d78a677898154cc08e33a43ac5cdaa17 P 6af51e44f4a94394914bda860b78270f: Time spent starting tablet: real 0.003s user 0.003s sys 0.001s
I20260810 15:28:00.636838 9298 heartbeater.cc:503] Master 127.18.68.190:44559 was elected leader, sending a full tablet report...
I20260810 15:28:00.636824 9521 heartbeater.cc:503] Master 127.18.68.190:44559 was elected leader, sending a full tablet report...
I20260810 15:28:00.637431 9585 tablet_bootstrap.cc:492] T d78a677898154cc08e33a43ac5cdaa17 P d99843d5e4ae466f84a34ea4a4c3036a: No bootstrap required, opened a new log
I20260810 15:28:00.637506 9585 ts_tablet_manager.cc:1397] T d78a677898154cc08e33a43ac5cdaa17 P d99843d5e4ae466f84a34ea4a4c3036a: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.000s
I20260810 15:28:00.640084 9585 raft_consensus.cc:348] T d78a677898154cc08e33a43ac5cdaa17 P d99843d5e4ae466f84a34ea4a4c3036a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d99843d5e4ae466f84a34ea4a4c3036a" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 41893 } } peers { permanent_uuid: "01caec6efdb1479ab708a9a149e685c3" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 44465 } } peers { permanent_uuid: "6af51e44f4a94394914bda860b78270f" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 33379 } }
I20260810 15:28:00.640260 9585 raft_consensus.cc:374] T d78a677898154cc08e33a43ac5cdaa17 P d99843d5e4ae466f84a34ea4a4c3036a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:28:00.640307 9585 raft_consensus.cc:729] T d78a677898154cc08e33a43ac5cdaa17 P d99843d5e4ae466f84a34ea4a4c3036a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d99843d5e4ae466f84a34ea4a4c3036a, State: Initialized, Role: FOLLOWER
I20260810 15:28:00.640424 9585 consensus_queue.cc:260] T d78a677898154cc08e33a43ac5cdaa17 P d99843d5e4ae466f84a34ea4a4c3036a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d99843d5e4ae466f84a34ea4a4c3036a" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 41893 } } peers { permanent_uuid: "01caec6efdb1479ab708a9a149e685c3" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 44465 } } peers { permanent_uuid: "6af51e44f4a94394914bda860b78270f" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 33379 } }
I20260810 15:28:00.640731 9585 ts_tablet_manager.cc:1428] T d78a677898154cc08e33a43ac5cdaa17 P d99843d5e4ae466f84a34ea4a4c3036a: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 15:28:00.640754 9057 heartbeater.cc:503] Master 127.18.68.190:44559 was elected leader, sending a full tablet report...
W20260810 15:28:00.687774 9059 tablet.cc:2369] T d78a677898154cc08e33a43ac5cdaa17 P d99843d5e4ae466f84a34ea4a4c3036a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 15:28:00.716203 9591 raft_consensus.cc:482] T d78a677898154cc08e33a43ac5cdaa17 P 6af51e44f4a94394914bda860b78270f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 15:28:00.716367 9591 raft_consensus.cc:504] T d78a677898154cc08e33a43ac5cdaa17 P 6af51e44f4a94394914bda860b78270f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d99843d5e4ae466f84a34ea4a4c3036a" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 41893 } } peers { permanent_uuid: "01caec6efdb1479ab708a9a149e685c3" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 44465 } } peers { permanent_uuid: "6af51e44f4a94394914bda860b78270f" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 33379 } }
I20260810 15:28:00.716794 9591 leader_election.cc:288] T d78a677898154cc08e33a43ac5cdaa17 P 6af51e44f4a94394914bda860b78270f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d99843d5e4ae466f84a34ea4a4c3036a (127.18.68.129:41893), 01caec6efdb1479ab708a9a149e685c3 (127.18.68.131:44465)
I20260810 15:28:00.721827 9583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:00.717324 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.130:60255 (local address 127.18.68.129:41893)
0810 15:28:00.717378 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0810 15:28:00.717380 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:28:00.717669 (+ 289us) server_negotiation.cc:407] Connection header received
0810 15:28:00.717779 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:28:00.717781 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:28:00.717791 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:28:00.717822 (+ 31us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:28:00.718123 (+ 301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:00.718858 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:00.720783 (+ 1925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:00.721369 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:00.721425 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:00.721435 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0810 15:28:00.721700 (+ 265us) server_negotiation.cc:299] Negotiation successful
0810 15:28:00.721751 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260810 15:28:00.722127 9597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:00.717078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.129:41893 (local address 127.18.68.130:60255)
0810 15:28:00.717599 (+ 521us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:00.717610 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 15:28:00.717700 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:28:00.717897 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:28:00.717897 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:28:00.717899 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:28:00.717986 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:28:00.717989 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:28:00.719384 (+ 1395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:28:00.719384 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:28:00.720666 (+ 1282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:28:00.720671 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:28:00.721525 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:28:00.721526 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:28:00.721601 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:00.721606 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 15:28:00.721938 (+ 332us) client_negotiation.cc:240] Negotiation successful
0810 15:28:00.721999 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":503,"thread_start_us":127,"threads_started":1}
I20260810 15:28:00.722503 8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d78a677898154cc08e33a43ac5cdaa17" candidate_uuid: "6af51e44f4a94394914bda860b78270f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d99843d5e4ae466f84a34ea4a4c3036a" is_pre_election: true
I20260810 15:28:00.722704 8967 raft_consensus.cc:2454] T d78a677898154cc08e33a43ac5cdaa17 P d99843d5e4ae466f84a34ea4a4c3036a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6af51e44f4a94394914bda860b78270f in term 0.
I20260810 15:28:00.722956 9094 leader_election.cc:302] T d78a677898154cc08e33a43ac5cdaa17 P 6af51e44f4a94394914bda860b78270f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6af51e44f4a94394914bda860b78270f, d99843d5e4ae466f84a34ea4a4c3036a; no voters:
I20260810 15:28:00.723090 9591 raft_consensus.cc:2781] T d78a677898154cc08e33a43ac5cdaa17 P 6af51e44f4a94394914bda860b78270f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 15:28:00.723132 9591 raft_consensus.cc:482] T d78a677898154cc08e33a43ac5cdaa17 P 6af51e44f4a94394914bda860b78270f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 15:28:00.723153 9591 raft_consensus.cc:3037] T d78a677898154cc08e33a43ac5cdaa17 P 6af51e44f4a94394914bda860b78270f [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:28:00.724121 9591 raft_consensus.cc:504] T d78a677898154cc08e33a43ac5cdaa17 P 6af51e44f4a94394914bda860b78270f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d99843d5e4ae466f84a34ea4a4c3036a" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 41893 } } peers { permanent_uuid: "01caec6efdb1479ab708a9a149e685c3" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 44465 } } peers { permanent_uuid: "6af51e44f4a94394914bda860b78270f" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 33379 } }
I20260810 15:28:00.724251 9591 leader_election.cc:288] T d78a677898154cc08e33a43ac5cdaa17 P 6af51e44f4a94394914bda860b78270f [CANDIDATE]: Term 1 election: Requested vote from peers d99843d5e4ae466f84a34ea4a4c3036a (127.18.68.129:41893), 01caec6efdb1479ab708a9a149e685c3 (127.18.68.131:44465)
I20260810 15:28:00.724845 8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d78a677898154cc08e33a43ac5cdaa17" candidate_uuid: "6af51e44f4a94394914bda860b78270f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d99843d5e4ae466f84a34ea4a4c3036a"
I20260810 15:28:00.724925 8967 raft_consensus.cc:3037] T d78a677898154cc08e33a43ac5cdaa17 P d99843d5e4ae466f84a34ea4a4c3036a [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:28:00.725644 9579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:00.717513 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.130:51697 (local address 127.18.68.131:44465)
0810 15:28:00.717572 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0810 15:28:00.717574 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:28:00.722455 (+ 4881us) server_negotiation.cc:407] Connection header received
0810 15:28:00.722568 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:28:00.722569 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:28:00.722581 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:28:00.722613 (+ 32us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:28:00.722790 (+ 177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:00.723455 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:00.724712 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:00.725255 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:00.725307 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:00.725315 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0810 15:28:00.725513 (+ 198us) server_negotiation.cc:299] Negotiation successful
0810 15:28:00.725556 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260810 15:28:00.725848 9597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:00.717427 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.131:44465 (local address 127.18.68.130:51697)
0810 15:28:00.722397 (+ 4970us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:00.722410 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 15:28:00.722486 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:28:00.722681 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:28:00.722681 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:28:00.722683 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:28:00.722713 (+ 30us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:28:00.722715 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:28:00.723563 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:28:00.723564 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:28:00.724612 (+ 1048us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:28:00.724615 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:28:00.725375 (+ 760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:28:00.725376 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:28:00.725431 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:00.725433 (+ 2us) client_negotiation.cc:769] Sending connection context
0810 15:28:00.725711 (+ 278us) client_negotiation.cc:240] Negotiation successful
0810 15:28:00.725759 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4956,"thread_start_us":101,"threads_started":1}
I20260810 15:28:00.725878 8967 raft_consensus.cc:2454] T d78a677898154cc08e33a43ac5cdaa17 P d99843d5e4ae466f84a34ea4a4c3036a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6af51e44f4a94394914bda860b78270f in term 1.
I20260810 15:28:00.726253 9428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d78a677898154cc08e33a43ac5cdaa17" candidate_uuid: "6af51e44f4a94394914bda860b78270f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01caec6efdb1479ab708a9a149e685c3" is_pre_election: true
I20260810 15:28:00.726410 9428 raft_consensus.cc:2454] T d78a677898154cc08e33a43ac5cdaa17 P 01caec6efdb1479ab708a9a149e685c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6af51e44f4a94394914bda860b78270f in term 0.
I20260810 15:28:00.726527 9452 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d78a677898154cc08e33a43ac5cdaa17" candidate_uuid: "6af51e44f4a94394914bda860b78270f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01caec6efdb1479ab708a9a149e685c3"
I20260810 15:28:00.726601 9452 raft_consensus.cc:3037] T d78a677898154cc08e33a43ac5cdaa17 P 01caec6efdb1479ab708a9a149e685c3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:28:00.727447 9452 raft_consensus.cc:2454] T d78a677898154cc08e33a43ac5cdaa17 P 01caec6efdb1479ab708a9a149e685c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6af51e44f4a94394914bda860b78270f in term 1.
I20260810 15:28:00.727747 9095 leader_election.cc:302] T d78a677898154cc08e33a43ac5cdaa17 P 6af51e44f4a94394914bda860b78270f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01caec6efdb1479ab708a9a149e685c3, 6af51e44f4a94394914bda860b78270f; no voters:
I20260810 15:28:00.728036 9591 raft_consensus.cc:2781] T d78a677898154cc08e33a43ac5cdaa17 P 6af51e44f4a94394914bda860b78270f [term 1 FOLLOWER]: Leader election won for term 1
I20260810 15:28:00.728219 9591 raft_consensus.cc:686] T d78a677898154cc08e33a43ac5cdaa17 P 6af51e44f4a94394914bda860b78270f [term 1 LEADER]: Becoming Leader. State: Replica: 6af51e44f4a94394914bda860b78270f, State: Running, Role: LEADER
I20260810 15:28:00.728328 9591 consensus_queue.cc:237] T d78a677898154cc08e33a43ac5cdaa17 P 6af51e44f4a94394914bda860b78270f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d99843d5e4ae466f84a34ea4a4c3036a" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 41893 } } peers { permanent_uuid: "01caec6efdb1479ab708a9a149e685c3" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 44465 } } peers { permanent_uuid: "6af51e44f4a94394914bda860b78270f" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 33379 } }
I20260810 15:28:00.729206 8706 catalog_manager.cc:5495] T d78a677898154cc08e33a43ac5cdaa17 P 6af51e44f4a94394914bda860b78270f reported cstate change: term changed from 0 to 1, leader changed from <none> to 6af51e44f4a94394914bda860b78270f (127.18.68.130). New cstate: current_term: 1 leader_uuid: "6af51e44f4a94394914bda860b78270f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d99843d5e4ae466f84a34ea4a4c3036a" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 41893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01caec6efdb1479ab708a9a149e685c3" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 44465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6af51e44f4a94394914bda860b78270f" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 33379 } health_report { overall_health: HEALTHY } } }
I20260810 15:28:00.754182 9582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:00.750507 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40294 (local address 127.18.68.130:33379)
0810 15:28:00.750598 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0810 15:28:00.750601 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 15:28:00.750615 (+ 14us) server_negotiation.cc:407] Connection header received
0810 15:28:00.750664 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:28:00.750666 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:28:00.750690 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:28:00.750775 (+ 85us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 15:28:00.750983 (+ 208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:00.751815 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:00.753012 (+ 1197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:00.753322 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:00.753409 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:00.753649 (+ 240us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 15:28:00.753796 (+ 147us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 15:28:00.753889 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0810 15:28:00.754050 (+ 161us) server_negotiation.cc:299] Negotiation successful
0810 15:28:00.754101 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260810 15:28:00.757032 9452 raft_consensus.cc:1261] T d78a677898154cc08e33a43ac5cdaa17 P 01caec6efdb1479ab708a9a149e685c3 [term 1 FOLLOWER]: Refusing update from remote peer 6af51e44f4a94394914bda860b78270f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 15:28:00.757473 9591 consensus_queue.cc:1035] T d78a677898154cc08e33a43ac5cdaa17 P 6af51e44f4a94394914bda860b78270f [LEADER]: Connected to new peer: Peer: permanent_uuid: "01caec6efdb1479ab708a9a149e685c3" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 44465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 15:28:00.757982 8967 raft_consensus.cc:1261] T d78a677898154cc08e33a43ac5cdaa17 P d99843d5e4ae466f84a34ea4a4c3036a [term 1 FOLLOWER]: Refusing update from remote peer 6af51e44f4a94394914bda860b78270f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 15:28:00.758536 9599 consensus_queue.cc:1035] T d78a677898154cc08e33a43ac5cdaa17 P 6af51e44f4a94394914bda860b78270f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d99843d5e4ae466f84a34ea4a4c3036a" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 41893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 15:28:00.762388 9605 mvcc.cc:205] Tried to move back new op lower bound from 7316994788377128960 to 7316994788263743488. Current Snapshot: MvccSnapshot[applied={T|T < 7316994788377128960}]
I20260810 15:28:00.763659 9607 mvcc.cc:205] Tried to move back new op lower bound from 7316994788377128960 to 7316994788263743488. Current Snapshot: MvccSnapshot[applied={T|T < 7316994788377128960}]
I20260810 15:28:00.766390 9610 mvcc.cc:205] Tried to move back new op lower bound from 7316994788377128960 to 7316994788263743488. Current Snapshot: MvccSnapshot[applied={T|T < 7316994788377128960}]
I20260810 15:28:00.769059 8707 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58608:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 15:28:00.769170 8707 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58608:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 15:28:00.769981 8707 catalog_manager.cc:5782] T 00000000000000000000000000000000 P fa92dc2f060e4387af739de8afa7714d: Sending DeleteTablet for 3 replicas of tablet d78a677898154cc08e33a43ac5cdaa17
I20260810 15:28:00.770586 9179 tablet_service.cc:1514] Processing DeleteTablet for tablet d78a677898154cc08e33a43ac5cdaa17 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 15:28:00 UTC) from {username='kudu', principal='kudu/127.18.68.190@KRBTEST.COM'} at 127.0.0.1:40282
I20260810 15:28:00.770664 8934 tablet_service.cc:1514] Processing DeleteTablet for tablet d78a677898154cc08e33a43ac5cdaa17 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 15:28:00 UTC) from {username='kudu', principal='kudu/127.18.68.190@KRBTEST.COM'} at 127.0.0.1:53546
I20260810 15:28:00.770952 9391 tablet_service.cc:1514] Processing DeleteTablet for tablet d78a677898154cc08e33a43ac5cdaa17 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 15:28:00 UTC) from {username='kudu', principal='kudu/127.18.68.190@KRBTEST.COM'} at 127.0.0.1:45078
I20260810 15:28:00.773887 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 8771
I20260810 15:28:00.782230 9621 tablet_replica.cc:330] T d78a677898154cc08e33a43ac5cdaa17 P 01caec6efdb1479ab708a9a149e685c3: stopping tablet replica
I20260810 15:28:00.782409 9621 raft_consensus.cc:2229] T d78a677898154cc08e33a43ac5cdaa17 P 01caec6efdb1479ab708a9a149e685c3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 15:28:00.782505 9621 raft_consensus.cc:2258] T d78a677898154cc08e33a43ac5cdaa17 P 01caec6efdb1479ab708a9a149e685c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 15:28:00.782701 9619 tablet_replica.cc:330] T d78a677898154cc08e33a43ac5cdaa17 P 6af51e44f4a94394914bda860b78270f: stopping tablet replica
I20260810 15:28:00.782827 9619 raft_consensus.cc:2229] T d78a677898154cc08e33a43ac5cdaa17 P 6af51e44f4a94394914bda860b78270f [term 1 LEADER]: Raft consensus shutting down.
I20260810 15:28:00.782994 9619 raft_consensus.cc:2258] T d78a677898154cc08e33a43ac5cdaa17 P 6af51e44f4a94394914bda860b78270f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 15:28:00.783596 9619 ts_tablet_manager.cc:1905] T d78a677898154cc08e33a43ac5cdaa17 P 6af51e44f4a94394914bda860b78270f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 15:28:00.785912 9619 ts_tablet_manager.cc:1918] T d78a677898154cc08e33a43ac5cdaa17 P 6af51e44f4a94394914bda860b78270f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 15:28:00.786001 9619 log.cc:1196] T d78a677898154cc08e33a43ac5cdaa17 P 6af51e44f4a94394914bda860b78270f: Deleting WAL directory at /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ts-1/wal/wals/d78a677898154cc08e33a43ac5cdaa17
I20260810 15:28:00.786346 9619 ts_tablet_manager.cc:1939] T d78a677898154cc08e33a43ac5cdaa17 P 6af51e44f4a94394914bda860b78270f: Deleting consensus metadata
I20260810 15:28:00.788116 8687 catalog_manager.cc:4841] TS 6af51e44f4a94394914bda860b78270f (127.18.68.130:33379): tablet d78a677898154cc08e33a43ac5cdaa17 (table test-table [id=2c1aa8bffa6e407cb0055678a9d8fc79]) successfully deleted
W20260810 15:28:00.797449 8687 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.18.68.129:41893 (error 108)
I20260810 15:28:00.798776 9577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:00.798601 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.129:41893 (local address 127.0.0.1:53560)
0810 15:28:00.798664 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:00.798730 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.129:41893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260810 15:28:00.798787 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 9063
I20260810 15:28:00.821092 9621 ts_tablet_manager.cc:1905] T d78a677898154cc08e33a43ac5cdaa17 P 01caec6efdb1479ab708a9a149e685c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 15:28:00.823880 9621 ts_tablet_manager.cc:1918] T d78a677898154cc08e33a43ac5cdaa17 P 01caec6efdb1479ab708a9a149e685c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 15:28:00.823992 9621 log.cc:1196] T d78a677898154cc08e33a43ac5cdaa17 P 01caec6efdb1479ab708a9a149e685c3: Deleting WAL directory at /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786375520124696-18706-0/minicluster-data/ts-2/wal/wals/d78a677898154cc08e33a43ac5cdaa17
I20260810 15:28:00.824416 9621 ts_tablet_manager.cc:1939] T d78a677898154cc08e33a43ac5cdaa17 P 01caec6efdb1479ab708a9a149e685c3: Deleting consensus metadata
I20260810 15:28:00.825488 8688 catalog_manager.cc:4841] TS 01caec6efdb1479ab708a9a149e685c3 (127.18.68.131:44465): tablet d78a677898154cc08e33a43ac5cdaa17 (table test-table [id=2c1aa8bffa6e407cb0055678a9d8fc79]) successfully deleted
W20260810 15:28:00.825719 8687 catalog_manager.cc:4584] TS d99843d5e4ae466f84a34ea4a4c3036a (127.18.68.129:41893): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d78a677898154cc08e33a43ac5cdaa17: Network error: Client connection negotiation failed: client connection to 127.18.68.129:41893: connect: Connection refused (error 111)
I20260810 15:28:00.835866 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 9301
I20260810 15:28:00.850356 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 8658
I20260810 15:28:00.863731 18706 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260810 15:28:01.212337 18706 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260810 15:28:01.212438 18706 mini_ranger.cc:66] Stopping Ranger...
I20260810 15:28:01.557847 18706 mini_ranger.cc:68] Stopped Ranger
2026-08-10 15:28:01.558 UTC [6989] LOG: received smart shutdown request
2026-08-10 15:28:01.562 UTC [6989] LOG: background worker "logical replication launcher" (PID 7004) exited with exit code 1
2026-08-10 15:28:01.563 UTC [6995] LOG: shutting down
2026-08-10 15:28:01.744 UTC [6989] LOG: database system is shut down
2026-08-10T15:28:01Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (50475 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786375520124696-18706-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 15:28:01 dist-test-slave-2p8l krb5kdc[9642](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 15:28:01 dist-test-slave-2p8l krb5kdc[9642](info): set up 2 sockets
Aug 10 15:28:01 dist-test-slave-2p8l krb5kdc[9642](info): commencing operation
krb5kdc: starting...
W20260810 15:28:03.174510 18706 mini_kdc.cc:121] Time spent starting KDC: real 1.286s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786375520124696-18706-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786375520124696-18706-0/krb5kdc/test-user.keytab.
Aug 10 15:28:03 dist-test-slave-2p8l krb5kdc[9642](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375683, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T15:28:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T15:28:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.68.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.68.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.68.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab.
Entry for principal kudu/127.18.68.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab.
I20260810 15:28:03.310389 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786375520124696-18706-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786375520124696-18706-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786375520124696-18706-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.190:41395
--webserver_interface=127.18.68.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab
--principal=kudu/127.18.68.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:34867
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.68.190:41395,127.18.68.189:38753,127.18.68.188:44519
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:28:03.397161 9665 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:28:03.397403 9665 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:28:03.397428 9665 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:28:03.398681 9665 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 15:28:03.398736 9665 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:28:03.398752 9665 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:28:03.398765 9665 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 15:28:03.398777 9665 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 15:28:03.400367 9665 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:34867
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786375520124696-18706-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786375520124696-18706-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.68.190:41395,127.18.68.189:38753,127.18.68.188:44519
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab
--principal=kudu/127.18.68.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.190:41395
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.68.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9665
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786375520124696-18706-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:28:03.400594 9665 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:28:03.400794 9665 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:28:03.405966 9673 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:28:03.405985 9675 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:28:03.405966 9678 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:28:03.406356 9665 server_base.cc:1034] running on GCE node
I20260810 15:28:03.406668 9665 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:28:03.406972 9665 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:28:03.408154 9665 hybrid_clock.cc:648] HybridClock initialized: now 1786375683408148 us; error 37 us; skew 500 ppm
Aug 10 15:28:03 dist-test-slave-2p8l krb5kdc[9642](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375683, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:28:03.411639 9665 init.cc:377] Logged in from keytab as kudu/127.18.68.190@KRBTEST.COM (short username kudu)
I20260810 15:28:03.412299 9665 webserver.cc:460] Webserver started at http://127.18.68.190:42167/ using document root <none> and password file <none>
I20260810 15:28:03.412638 9665 fs_manager.cc:359] Metadata directory not provided
I20260810 15:28:03.412752 9665 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:28:03.412956 9665 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:28:03.414654 9665 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786375520124696-18706-0/minicluster-data/master-0/data/instance:
uuid: "b12ab7b24f7549d5871e2bfcd0e1a4b2"
format_stamp: "Formatted at 2026-08-10 15:28:03 on dist-test-slave-2p8l"
server_key: "d5e3d6bf8ffdac3cbcfe08ad8be629d0"
server_key_iv: "c8656da031eb3ecead9be7888fba562b"
server_key_version: "encryptionkey@0"
I20260810 15:28:03.415117 9665 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786375520124696-18706-0/minicluster-data/master-0/wal/instance:
uuid: "b12ab7b24f7549d5871e2bfcd0e1a4b2"
format_stamp: "Formatted at 2026-08-10 15:28:03 on dist-test-slave-2p8l"
server_key: "d5e3d6bf8ffdac3cbcfe08ad8be629d0"
server_key_iv: "c8656da031eb3ecead9be7888fba562b"
server_key_version: "encryptionkey@0"
I20260810 15:28:03.417392 9665 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260810 15:28:03.419576 9688 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:28:03.419895 9665 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:28:03.420022 9665 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786375520124696-18706-0/minicluster-data/master-0/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786375520124696-18706-0/minicluster-data/master-0/wal
uuid: "b12ab7b24f7549d5871e2bfcd0e1a4b2"
format_stamp: "Formatted at 2026-08-10 15:28:03 on dist-test-slave-2p8l"
server_key: "d5e3d6bf8ffdac3cbcfe08ad8be629d0"
server_key_iv: "c8656da031eb3ecead9be7888fba562b"
server_key_version: "encryptionkey@0"
I20260810 15:28:03.420137 9665 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786375520124696-18706-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786375520124696-18706-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786375520124696-18706-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:28:03.447299 9665 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:28:03.452414 9665 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:28:03.452806 9665 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:28:03.459690 9665 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.190:41395
I20260810 15:28:03.459714 9783 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.190:41395 every 8 connection(s)
I20260810 15:28:03.460495 9665 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
I20260810 15:28:03.461511 9785 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:28:03.463258 9785 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.68.190" port: 41395 } has no permanent_uuid. Determining permanent_uuid...
I20260810 15:28:03.466938 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 9665
I20260810 15:28:03.467073 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786375520124696-18706-0/minicluster-data/master-0/wal/instance
I20260810 15:28:03.467272 18706 external_mini_cluster.cc:1428] Setting key ffc9fc95a5d7861696d42287a1cc03fa
Aug 10 15:28:03 dist-test-slave-2p8l krb5kdc[9642](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375683, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.190@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
I20260810 15:28:03.475371 9787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:03.464030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:41395 (local address 127.0.0.1:59918)
0810 15:28:03.464226 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:03.464293 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0810 15:28:03.464955 (+ 662us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:28:03.465297 (+ 342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:28:03.465300 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:28:03.465581 (+ 281us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:28:03.465743 (+ 162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:28:03.465747 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:28:03.466835 (+ 1088us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:28:03.466837 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:28:03.467992 (+ 1155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:28:03.467995 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:28:03.468583 (+ 588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:28:03.468584 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:28:03.468672 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:03.469286 (+ 614us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:28:03.469294 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:28:03.470954 (+ 1660us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:28:03.473293 (+ 2339us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:28:03.473300 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:28:03.473302 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:28:03.473530 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:28:03.473841 (+ 311us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:28:03.473842 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:28:03.473842 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:28:03.473931 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:28:03.474790 (+ 859us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:28:03.474797 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:28:03.474866 (+ 69us) client_negotiation.cc:769] Sending connection context
0810 15:28:03.474955 (+ 89us) client_negotiation.cc:240] Negotiation successful
0810 15:28:03.475150 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":89,"threads_started":1}
I20260810 15:28:03.475376 9789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:03.464061 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59918 (local address 127.18.68.190:41395)
0810 15:28:03.465099 (+ 1038us) server_negotiation.cc:206] Beginning negotiation
0810 15:28:03.465103 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 15:28:03.465114 (+ 11us) server_negotiation.cc:407] Connection header received
0810 15:28:03.465174 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:28:03.465176 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:28:03.465191 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:28:03.465254 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:28:03.465843 (+ 589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:03.466740 (+ 897us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:03.468078 (+ 1338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:03.468485 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:03.468571 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:03.471058 (+ 2487us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:28:03.471066 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:28:03.471067 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:28:03.471075 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:28:03.473181 (+ 2106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:28:03.473627 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:28:03.473631 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:28:03.473632 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:28:03.473761 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:28:03.474007 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:28:03.474008 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:28:03.474009 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:28:03.474704 (+ 695us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:28:03.474805 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0810 15:28:03.475019 (+ 214us) server_negotiation.cc:299] Negotiation successful
0810 15:28:03.475200 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":63,"server-negotiator.queue_time_us":1016,"thread_start_us":75,"threads_started":1}
I20260810 15:28:03.476310 9785 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.68.189" port: 38753 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.18.68.189@KRBTEST.COM; defaulting to no policy
I20260810 15:28:03.476745 9787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:03.476579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.189:38753 (local address 127.0.0.1:60358)
0810 15:28:03.476678 (+ 99us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:03.476723 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.189:38753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
W20260810 15:28:03.476898 9691 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.18.68.189:38753: connect: Connection refused (error 111)
I20260810 15:28:03.477474 9787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:03.477351 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.189:38753 (local address 127.0.0.1:60374)
0810 15:28:03.477415 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:03.477444 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.189:38753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260810 15:28:03.477607 9785 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.68.189:38753: Network error: Client connection negotiation failed: client connection to 127.18.68.189:38753: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.68.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.68.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.189.keytab.
Entry for principal kudu/127.18.68.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.189.keytab.
I20260810 15:28:03.497870 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786375520124696-18706-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786375520124696-18706-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786375520124696-18706-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786375520124696-18706-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.189:38753
--webserver_interface=127.18.68.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.189.keytab
--principal=kudu/127.18.68.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:34867
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.68.190:41395,127.18.68.189:38753,127.18.68.188:44519
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 15:28:03.526803 9785 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.68.189" port: 38753 } attempt: 1
I20260810 15:28:03.527347 9787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:03.527189 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.189:38753 (local address 127.0.0.1:60384)
0810 15:28:03.527268 (+ 79us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:03.527310 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.189:38753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260810 15:28:03.527772 9787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:03.527662 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.189:38753 (local address 127.0.0.1:60392)
0810 15:28:03.527718 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:03.527751 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.189:38753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260810 15:28:03.527870 9785 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.68.189:38753: Network error: Client connection negotiation failed: client connection to 127.18.68.189:38753: connect: Connection refused (error 111)
W20260810 15:28:03.590976 9794 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:28:03.591235 9794 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:28:03.591274 9794 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:28:03.592445 9794 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 15:28:03.592516 9794 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:28:03.592540 9794 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:28:03.592568 9794 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 15:28:03.592612 9794 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 15:28:03.594377 9794 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:34867
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786375520124696-18706-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786375520124696-18706-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.18.68.190:41395,127.18.68.189:38753,127.18.68.188:44519
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.189.keytab
--principal=kudu/127.18.68.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.189:38753
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786375520124696-18706-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.18.68.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9794
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786375520124696-18706-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:28:03.594681 9794 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:28:03.594931 9794 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 15:28:03.596087 9785 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.68.189" port: 38753 } attempt: 2
I20260810 15:28:03.596588 9787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:03.596443 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.189:38753 (local address 127.0.0.1:60406)
0810 15:28:03.596514 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:03.596558 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.189:38753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260810 15:28:03.597016 9787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:03.596923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.189:38753 (local address 127.0.0.1:60418)
0810 15:28:03.596972 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:03.596999 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.189:38753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260810 15:28:03.597149 9785 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.68.189:38753: Network error: Client connection negotiation failed: client connection to 127.18.68.189:38753: connect: Connection refused (error 111)
W20260810 15:28:03.600669 9803 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:28:03.600821 9794 server_base.cc:1034] running on GCE node
W20260810 15:28:03.600732 9801 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:28:03.600679 9800 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:28:03.601202 9794 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:28:03.601537 9794 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:28:03.602730 9794 hybrid_clock.cc:648] HybridClock initialized: now 1786375683602728 us; error 47 us; skew 500 ppm
Aug 10 15:28:03 dist-test-slave-2p8l krb5kdc[9642](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375683, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:28:03.605438 9794 init.cc:377] Logged in from keytab as kudu/127.18.68.189@KRBTEST.COM (short username kudu)
I20260810 15:28:03.605985 9794 webserver.cc:460] Webserver started at http://127.18.68.189:36999/ using document root <none> and password file <none>
I20260810 15:28:03.606278 9794 fs_manager.cc:359] Metadata directory not provided
I20260810 15:28:03.606354 9794 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:28:03.606518 9794 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:28:03.607712 9794 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786375520124696-18706-0/minicluster-data/master-1/data/instance:
uuid: "666d95c9c1ed437e8b287786c25b4fc1"
format_stamp: "Formatted at 2026-08-10 15:28:03 on dist-test-slave-2p8l"
server_key: "c37d4d8ba902c318f1cdf588f317e553"
server_key_iv: "e958d81e9a95869977cd134cfe695e32"
server_key_version: "encryptionkey@0"
I20260810 15:28:03.608095 9794 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786375520124696-18706-0/minicluster-data/master-1/wal/instance:
uuid: "666d95c9c1ed437e8b287786c25b4fc1"
format_stamp: "Formatted at 2026-08-10 15:28:03 on dist-test-slave-2p8l"
server_key: "c37d4d8ba902c318f1cdf588f317e553"
server_key_iv: "e958d81e9a95869977cd134cfe695e32"
server_key_version: "encryptionkey@0"
I20260810 15:28:03.609582 9794 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 15:28:03.610466 9815 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:28:03.610716 9794 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260810 15:28:03.610829 9794 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786375520124696-18706-0/minicluster-data/master-1/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786375520124696-18706-0/minicluster-data/master-1/wal
uuid: "666d95c9c1ed437e8b287786c25b4fc1"
format_stamp: "Formatted at 2026-08-10 15:28:03 on dist-test-slave-2p8l"
server_key: "c37d4d8ba902c318f1cdf588f317e553"
server_key_iv: "e958d81e9a95869977cd134cfe695e32"
server_key_version: "encryptionkey@0"
I20260810 15:28:03.610915 9794 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786375520124696-18706-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786375520124696-18706-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786375520124696-18706-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:28:03.623646 9794 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:28:03.626279 9794 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:28:03.626459 9794 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:28:03.630801 9794 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.189:38753
I20260810 15:28:03.630890 9896 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.189:38753 every 8 connection(s)
I20260810 15:28:03.631278 9794 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786375520124696-18706-0/minicluster-data/master-1/data/info.pb
I20260810 15:28:03.632191 9897 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:28:03.633874 9897 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.68.190" port: 41395 } has no permanent_uuid. Determining permanent_uuid...
I20260810 15:28:03.634285 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 9794
I20260810 15:28:03.634403 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786375520124696-18706-0/minicluster-data/master-1/wal/instance
I20260810 15:28:03.634608 18706 external_mini_cluster.cc:1428] Setting key e95767a18328e932dbe7dfa2d93dcf79
Aug 10 15:28:03 dist-test-slave-2p8l krb5kdc[9642](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375683, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.189@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.18.68.188@KRBTEST.COM; defaulting to no policy
I20260810 15:28:03.644068 9789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:03.634728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59928 (local address 127.18.68.190:41395)
0810 15:28:03.634793 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0810 15:28:03.634796 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 15:28:03.635053 (+ 257us) server_negotiation.cc:407] Connection header received
0810 15:28:03.635525 (+ 472us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:28:03.635527 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:28:03.635544 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:28:03.635631 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:28:03.636351 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:03.636885 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:03.638226 (+ 1341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:03.638588 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:03.638670 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:03.640908 (+ 2238us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:28:03.640910 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:28:03.640911 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:28:03.640921 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:28:03.642627 (+ 1706us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:28:03.643035 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:28:03.643036 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:28:03.643037 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:28:03.643103 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:28:03.643359 (+ 256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:28:03.643360 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:28:03.643360 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:28:03.643511 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:28:03.643587 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0810 15:28:03.643849 (+ 262us) server_negotiation.cc:299] Negotiation successful
0810 15:28:03.643948 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260810 15:28:03.644196 9901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:03.634727 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:41395 (local address 127.0.0.1:59928)
0810 15:28:03.634906 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:03.634949 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0810 15:28:03.635427 (+ 478us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:28:03.635689 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:28:03.635692 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:28:03.635957 (+ 265us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:28:03.636163 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:28:03.636168 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:28:03.636990 (+ 822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:28:03.636992 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:28:03.638127 (+ 1135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:28:03.638136 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:28:03.638713 (+ 577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:28:03.638714 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:28:03.638822 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:03.639399 (+ 577us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:28:03.639408 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:28:03.640804 (+ 1396us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:28:03.642714 (+ 1910us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:28:03.642721 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:28:03.642723 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:28:03.642952 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:28:03.643189 (+ 237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:28:03.643189 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:28:03.643190 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:28:03.643288 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:28:03.643581 (+ 293us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:28:03.643585 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:28:03.643709 (+ 124us) client_negotiation.cc:769] Sending connection context
0810 15:28:03.643792 (+ 83us) client_negotiation.cc:240] Negotiation successful
0810 15:28:03.643984 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":102,"threads_started":1}
I20260810 15:28:03.644748 9897 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.68.189" port: 38753 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.68.188@KRBTEST.COM" created.
Aug 10 15:28:03 dist-test-slave-2p8l krb5kdc[9642](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375683, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.189@KRBTEST.COM for kudu/127.18.68.189@KRBTEST.COM
I20260810 15:28:03.653422 9901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:03.645070 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.189:38753 (local address 127.0.0.1:60424)
0810 15:28:03.645136 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:03.645146 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 15:28:03.645193 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:28:03.645454 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:28:03.645455 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:28:03.645606 (+ 151us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:28:03.645660 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:28:03.645661 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:28:03.646717 (+ 1056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:28:03.646718 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:28:03.647408 (+ 690us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:28:03.647411 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:28:03.647871 (+ 460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:28:03.647872 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:28:03.647959 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:03.648384 (+ 425us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:28:03.648390 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:28:03.649991 (+ 1601us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:28:03.652209 (+ 2218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:28:03.652210 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:28:03.652211 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:28:03.652386 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:28:03.652678 (+ 292us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:28:03.652679 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:28:03.652679 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:28:03.652739 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:28:03.653145 (+ 406us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:28:03.653146 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:28:03.653188 (+ 42us) client_negotiation.cc:769] Sending connection context
0810 15:28:03.653251 (+ 63us) client_negotiation.cc:240] Negotiation successful
0810 15:28:03.653349 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49}
I20260810 15:28:03.653604 9905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:03.645149 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60424 (local address 127.18.68.189:38753)
0810 15:28:03.645323 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0810 15:28:03.645327 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 15:28:03.645344 (+ 17us) server_negotiation.cc:407] Connection header received
0810 15:28:03.645361 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:28:03.645362 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:28:03.645372 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:28:03.645454 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:28:03.645745 (+ 291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:03.646558 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:03.647492 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:03.647791 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:03.647849 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:03.650102 (+ 2253us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:28:03.650111 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:28:03.650111 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:28:03.650119 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:28:03.652099 (+ 1980us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:28:03.652485 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:28:03.652489 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:28:03.652490 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:28:03.652573 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:28:03.652811 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:28:03.652812 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:28:03.652812 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:28:03.653038 (+ 226us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:28:03.653138 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0810 15:28:03.653318 (+ 180us) server_negotiation.cc:299] Negotiation successful
0810 15:28:03.653444 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":148,"thread_start_us":99,"threads_started":1}
I20260810 15:28:03.654251 9897 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.68.188" port: 44519 } has no permanent_uuid. Determining permanent_uuid...
I20260810 15:28:03.654660 9901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:03.654510 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.188:44519 (local address 127.0.0.1:58500)
0810 15:28:03.654564 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:03.654625 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.188:44519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260810 15:28:03.654871 9824 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.18.68.188:44519: connect: Connection refused (error 111)
I20260810 15:28:03.655432 9901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:03.655316 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.188:44519 (local address 127.0.0.1:58504)
0810 15:28:03.655370 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:03.655405 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.188:44519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260810 15:28:03.655615 9897 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.68.188:44519: Network error: Client connection negotiation failed: client connection to 127.18.68.188:44519: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.68.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.188.keytab.
Entry for principal kudu/127.18.68.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.188.keytab.
I20260810 15:28:03.665732 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786375520124696-18706-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786375520124696-18706-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786375520124696-18706-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786375520124696-18706-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.188:44519
--webserver_interface=127.18.68.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.188.keytab
--principal=kudu/127.18.68.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:34867
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.68.190:41395,127.18.68.189:38753,127.18.68.188:44519
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 15:28:03.688333 9785 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.68.189" port: 38753 } attempt: 3
Aug 10 15:28:03 dist-test-slave-2p8l krb5kdc[9642](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375683, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.190@KRBTEST.COM for kudu/127.18.68.189@KRBTEST.COM
I20260810 15:28:03.696025 9787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:03.688741 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.189:38753 (local address 127.0.0.1:60434)
0810 15:28:03.688810 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:03.688823 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 15:28:03.688899 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:28:03.689053 (+ 154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:28:03.689055 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:28:03.689233 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:28:03.689300 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:28:03.689302 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:28:03.690026 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:28:03.690027 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:28:03.690625 (+ 598us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:28:03.690628 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:28:03.691024 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:28:03.691025 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:28:03.691109 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:03.691615 (+ 506us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:28:03.691620 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:28:03.693035 (+ 1415us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:28:03.695003 (+ 1968us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:28:03.695004 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:28:03.695004 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:28:03.695188 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:28:03.695419 (+ 231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:28:03.695420 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:28:03.695420 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:28:03.695476 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:28:03.695767 (+ 291us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:28:03.695768 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:28:03.695810 (+ 42us) client_negotiation.cc:769] Sending connection context
0810 15:28:03.695867 (+ 57us) client_negotiation.cc:240] Negotiation successful
0810 15:28:03.695950 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42}
I20260810 15:28:03.696125 9905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:03.688840 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60434 (local address 127.18.68.189:38753)
0810 15:28:03.688912 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0810 15:28:03.688914 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:28:03.688927 (+ 13us) server_negotiation.cc:407] Connection header received
0810 15:28:03.688960 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:28:03.688961 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:28:03.688973 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:28:03.689048 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:28:03.689391 (+ 343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:03.689925 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:03.690729 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:03.690946 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:03.691026 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:03.693135 (+ 2109us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:28:03.693137 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:28:03.693137 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:28:03.693147 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:28:03.694897 (+ 1750us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:28:03.695269 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:28:03.695270 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:28:03.695271 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:28:03.695342 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:28:03.695538 (+ 196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:28:03.695539 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:28:03.695540 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:28:03.695693 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:28:03.695771 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0810 15:28:03.695910 (+ 139us) server_negotiation.cc:299] Negotiation successful
0810 15:28:03.696012 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260810 15:28:03.696565 9785 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.68.188" port: 44519 } has no permanent_uuid. Determining permanent_uuid...
I20260810 15:28:03.697024 9787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:03.696889 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.188:44519 (local address 127.0.0.1:58512)
0810 15:28:03.696959 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:03.696989 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.188:44519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260810 15:28:03.697415 9787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:03.697327 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.188:44519 (local address 127.0.0.1:58524)
0810 15:28:03.697372 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:03.697398 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.188:44519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260810 15:28:03.697552 9785 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.68.188:44519: Network error: Client connection negotiation failed: client connection to 127.18.68.188:44519: connect: Connection refused (error 111)
I20260810 15:28:03.704867 9897 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.68.188" port: 44519 } attempt: 1
I20260810 15:28:03.705410 9901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:03.705255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.188:44519 (local address 127.0.0.1:58530)
0810 15:28:03.705320 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:03.705368 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.188:44519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260810 15:28:03.705888 9901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:03.705767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.188:44519 (local address 127.0.0.1:58544)
0810 15:28:03.705823 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:03.705858 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.188:44519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260810 15:28:03.706014 9897 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.68.188:44519: Network error: Client connection negotiation failed: client connection to 127.18.68.188:44519: connect: Connection refused (error 111)
I20260810 15:28:03.728721 9785 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.68.188" port: 44519 } attempt: 1
I20260810 15:28:03.729240 9787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:03.729078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.188:44519 (local address 127.0.0.1:58554)
0810 15:28:03.729149 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:03.729200 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.188:44519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260810 15:28:03.729647 9787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:03.729551 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.188:44519 (local address 127.0.0.1:58570)
0810 15:28:03.729597 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:03.729626 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.188:44519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260810 15:28:03.729830 9785 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.68.188:44519: Network error: Client connection negotiation failed: client connection to 127.18.68.188:44519: connect: Connection refused (error 111)
W20260810 15:28:03.752910 9911 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:28:03.753123 9911 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:28:03.753146 9911 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:28:03.754328 9911 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 15:28:03.754370 9911 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:28:03.754385 9911 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:28:03.754397 9911 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 15:28:03.754410 9911 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 15:28:03.755991 9911 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:34867
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786375520124696-18706-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786375520124696-18706-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.18.68.190:41395,127.18.68.189:38753,127.18.68.188:44519
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.188.keytab
--principal=kudu/127.18.68.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.188:44519
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786375520124696-18706-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.18.68.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9911
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786375520124696-18706-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:28:03.756278 9911 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:28:03.756521 9911 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:28:03.761714 9924 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:28:03.761720 9921 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:28:03.761741 9920 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:28:03.762327 9911 server_base.cc:1034] running on GCE node
I20260810 15:28:03.762593 9911 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:28:03.762878 9911 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:28:03.764073 9911 hybrid_clock.cc:648] HybridClock initialized: now 1786375683764071 us; error 45 us; skew 500 ppm
Aug 10 15:28:03 dist-test-slave-2p8l krb5kdc[9642](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375683, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:28:03.766938 9911 init.cc:377] Logged in from keytab as kudu/127.18.68.188@KRBTEST.COM (short username kudu)
I20260810 15:28:03.767517 9911 webserver.cc:460] Webserver started at http://127.18.68.188:43555/ using document root <none> and password file <none>
I20260810 15:28:03.767804 9911 fs_manager.cc:359] Metadata directory not provided
I20260810 15:28:03.767884 9911 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:28:03.768054 9911 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:28:03.769326 9911 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786375520124696-18706-0/minicluster-data/master-2/data/instance:
uuid: "ef0292fe828e4d9cbbc31ed5342f51e6"
format_stamp: "Formatted at 2026-08-10 15:28:03 on dist-test-slave-2p8l"
server_key: "ae66bd5534e6f988a870f102ea447dd3"
server_key_iv: "6a08e67a2c0fb7b1ff661af32033fbde"
server_key_version: "encryptionkey@0"
I20260810 15:28:03.769778 9911 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786375520124696-18706-0/minicluster-data/master-2/wal/instance:
uuid: "ef0292fe828e4d9cbbc31ed5342f51e6"
format_stamp: "Formatted at 2026-08-10 15:28:03 on dist-test-slave-2p8l"
server_key: "ae66bd5534e6f988a870f102ea447dd3"
server_key_iv: "6a08e67a2c0fb7b1ff661af32033fbde"
server_key_version: "encryptionkey@0"
I20260810 15:28:03.771416 9911 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.004s
I20260810 15:28:03.772310 9937 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:28:03.772531 9911 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 15:28:03.772691 9911 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786375520124696-18706-0/minicluster-data/master-2/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786375520124696-18706-0/minicluster-data/master-2/wal
uuid: "ef0292fe828e4d9cbbc31ed5342f51e6"
format_stamp: "Formatted at 2026-08-10 15:28:03 on dist-test-slave-2p8l"
server_key: "ae66bd5534e6f988a870f102ea447dd3"
server_key_iv: "6a08e67a2c0fb7b1ff661af32033fbde"
server_key_version: "encryptionkey@0"
I20260810 15:28:03.772784 9911 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786375520124696-18706-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786375520124696-18706-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786375520124696-18706-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:28:03.774207 9897 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.68.188" port: 44519 } attempt: 2
I20260810 15:28:03.774727 9901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:03.774539 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.188:44519 (local address 127.0.0.1:58576)
0810 15:28:03.774651 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:03.774696 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.188:44519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":86}
I20260810 15:28:03.775092 9901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:03.774976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.188:44519 (local address 127.0.0.1:58580)
0810 15:28:03.775027 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:03.775063 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.188:44519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260810 15:28:03.775192 9897 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.68.188:44519: Network error: Client connection negotiation failed: client connection to 127.18.68.188:44519: connect: Connection refused (error 111)
I20260810 15:28:03.805013 9785 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.68.188" port: 44519 } attempt: 2
I20260810 15:28:03.805827 9787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:03.805634 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.188:44519 (local address 127.0.0.1:58584)
0810 15:28:03.805735 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:03.805789 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.188:44519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260810 15:28:03.806376 9787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:03.806260 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.188:44519 (local address 127.0.0.1:58594)
0810 15:28:03.806318 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:03.806352 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.188:44519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260810 15:28:03.806517 9785 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.68.188:44519: Network error: Client connection negotiation failed: client connection to 127.18.68.188:44519: connect: Connection refused (error 111)
I20260810 15:28:03.816771 9911 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:28:03.819041 9911 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:28:03.819213 9911 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:28:03.823446 9911 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.188:44519
I20260810 15:28:03.823499 10030 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.188:44519 every 8 connection(s)
I20260810 15:28:03.823881 9911 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786375520124696-18706-0/minicluster-data/master-2/data/info.pb
I20260810 15:28:03.824826 10031 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:28:03.826656 10031 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.68.190" port: 41395 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 15:28:03 dist-test-slave-2p8l krb5kdc[9642](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375683, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.188@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
I20260810 15:28:03.832405 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 9911
I20260810 15:28:03.832527 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786375520124696-18706-0/minicluster-data/master-2/wal/instance
I20260810 15:28:03.832753 18706 external_mini_cluster.cc:1428] Setting key 844c977f1eccd3a2825adb28c06e57f9
I20260810 15:28:03.837383 9789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:03.827461 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59938 (local address 127.18.68.190:41395)
0810 15:28:03.827541 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0810 15:28:03.827543 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:28:03.827739 (+ 196us) server_negotiation.cc:407] Connection header received
0810 15:28:03.828224 (+ 485us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:28:03.828225 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:28:03.828235 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:28:03.828298 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:28:03.828920 (+ 622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:03.829396 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:03.830452 (+ 1056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:03.830633 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:03.830717 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:03.833131 (+ 2414us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:28:03.833132 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:28:03.833133 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:28:03.833142 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:28:03.835127 (+ 1985us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:28:03.835558 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:28:03.835559 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:28:03.835560 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:28:03.835627 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:28:03.836556 (+ 929us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:28:03.836557 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:28:03.836558 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:28:03.836708 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:28:03.836786 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0810 15:28:03.837173 (+ 387us) server_negotiation.cc:299] Negotiation successful
0810 15:28:03.837270 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260810 15:28:03.837527 10033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:03.827404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:41395 (local address 127.0.0.1:59938)
0810 15:28:03.827610 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:03.827650 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0810 15:28:03.828097 (+ 447us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:28:03.828376 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:28:03.828379 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:28:03.828644 (+ 265us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:28:03.828844 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:28:03.828848 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:28:03.829481 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:28:03.829482 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:28:03.830375 (+ 893us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:28:03.830378 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:28:03.830739 (+ 361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:28:03.830740 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:28:03.830840 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:03.831339 (+ 499us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:28:03.831347 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:28:03.832992 (+ 1645us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:28:03.835223 (+ 2231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:28:03.835230 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:28:03.835231 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:28:03.835458 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:28:03.836375 (+ 917us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:28:03.836375 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:28:03.836376 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:28:03.836487 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:28:03.836782 (+ 295us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:28:03.836787 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:28:03.836979 (+ 192us) client_negotiation.cc:769] Sending connection context
0810 15:28:03.837107 (+ 128us) client_negotiation.cc:240] Negotiation successful
0810 15:28:03.837261 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":107,"threads_started":1}
I20260810 15:28:03.838238 10031 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.68.189" port: 38753 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 15:28:03 dist-test-slave-2p8l krb5kdc[9642](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375683, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.68.188@KRBTEST.COM
Aug 10 15:28:03 dist-test-slave-2p8l krb5kdc[9642](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375683, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.188@KRBTEST.COM for kudu/127.18.68.189@KRBTEST.COM
I20260810 15:28:03.843098 10035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:03.833191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58610 (local address 127.18.68.188:44519)
0810 15:28:03.833398 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0810 15:28:03.833404 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 15:28:03.833453 (+ 49us) server_negotiation.cc:407] Connection header received
0810 15:28:03.833476 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:28:03.833479 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:28:03.833492 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:28:03.833584 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:28:03.834526 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:03.835633 (+ 1107us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:03.836360 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:03.836781 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:03.836858 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:03.839801 (+ 2943us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:28:03.839812 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:28:03.839812 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:28:03.839820 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:28:03.841813 (+ 1993us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:28:03.842239 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:28:03.842243 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:28:03.842243 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:28:03.842293 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:28:03.842514 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:28:03.842515 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:28:03.842515 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:28:03.842632 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:28:03.842780 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0810 15:28:03.842882 (+ 102us) server_negotiation.cc:299] Negotiation successful
0810 15:28:03.842968 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":162,"thread_start_us":117,"threads_started":1}
I20260810 15:28:03.845793 9905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:03.838639 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60444 (local address 127.18.68.189:38753)
0810 15:28:03.838717 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0810 15:28:03.838720 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 15:28:03.838729 (+ 9us) server_negotiation.cc:407] Connection header received
0810 15:28:03.838754 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:28:03.838755 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:28:03.838766 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:28:03.838826 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:28:03.839093 (+ 267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:03.839833 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:03.840737 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:03.841006 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:03.841069 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:03.843106 (+ 2037us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:28:03.843107 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:28:03.843107 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:28:03.843116 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:28:03.844642 (+ 1526us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:28:03.845017 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:28:03.845018 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:28:03.845019 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:28:03.845075 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:28:03.845290 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:28:03.845291 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:28:03.845291 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:28:03.845402 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:28:03.845476 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0810 15:28:03.845632 (+ 156us) server_negotiation.cc:299] Negotiation successful
0810 15:28:03.845704 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260810 15:28:03.845794 10033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:03.838554 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.189:38753 (local address 127.0.0.1:60444)
0810 15:28:03.838596 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:03.838608 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 15:28:03.838651 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:28:03.838839 (+ 188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:28:03.838840 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:28:03.838955 (+ 115us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:28:03.839001 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:28:03.839003 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:28:03.840092 (+ 1089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:28:03.840093 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:28:03.840671 (+ 578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:28:03.840673 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:28:03.841084 (+ 411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:28:03.841085 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:28:03.841163 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:03.841477 (+ 314us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:28:03.841483 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:28:03.843025 (+ 1542us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:28:03.844753 (+ 1728us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:28:03.844754 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:28:03.844755 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:28:03.844928 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:28:03.845152 (+ 224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:28:03.845153 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:28:03.845153 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:28:03.845212 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:28:03.845470 (+ 258us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:28:03.845471 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:28:03.845514 (+ 43us) client_negotiation.cc:769] Sending connection context
0810 15:28:03.845606 (+ 92us) client_negotiation.cc:240] Negotiation successful
0810 15:28:03.845700 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":23}
I20260810 15:28:03.846161 10031 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.68.188" port: 44519 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 15:28:03 dist-test-slave-2p8l krb5kdc[9642](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375683, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
Aug 10 15:28:03 dist-test-slave-2p8l krb5kdc[9642](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375683, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.188@KRBTEST.COM for kudu/127.18.68.188@KRBTEST.COM
I20260810 15:28:03.851316 9789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:03.844025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59950 (local address 127.18.68.190:41395)
0810 15:28:03.844085 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0810 15:28:03.844087 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:28:03.844095 (+ 8us) server_negotiation.cc:407] Connection header received
0810 15:28:03.844120 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:28:03.844121 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:28:03.844130 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:28:03.844180 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:28:03.844669 (+ 489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:03.845115 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:03.845771 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:03.846098 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:03.846159 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:03.848298 (+ 2139us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:28:03.848300 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:28:03.848300 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:28:03.848308 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:28:03.850055 (+ 1747us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:28:03.850461 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:28:03.850462 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:28:03.850463 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:28:03.850527 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:28:03.850740 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:28:03.850741 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:28:03.850741 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:28:03.850896 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:28:03.851095 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0810 15:28:03.851141 (+ 46us) server_negotiation.cc:299] Negotiation successful
0810 15:28:03.851211 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260810 15:28:03.852869 10033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:03.846443 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.188:44519 (local address 127.0.0.1:58612)
0810 15:28:03.846473 (+ 30us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:03.846482 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 15:28:03.846520 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:28:03.846642 (+ 122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:28:03.846642 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:28:03.846779 (+ 137us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:28:03.846803 (+ 24us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:28:03.846804 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:28:03.847436 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:28:03.847437 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:28:03.847929 (+ 492us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:28:03.847930 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:28:03.848275 (+ 345us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:28:03.848276 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:28:03.848324 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:03.848710 (+ 386us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:28:03.848716 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:28:03.849817 (+ 1101us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:28:03.851609 (+ 1792us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:28:03.851610 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:28:03.851610 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:28:03.851854 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:28:03.852233 (+ 379us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:28:03.852234 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:28:03.852235 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:28:03.852298 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:28:03.852535 (+ 237us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:28:03.852535 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:28:03.852572 (+ 37us) client_negotiation.cc:769] Sending connection context
0810 15:28:03.852641 (+ 69us) client_negotiation.cc:240] Negotiation successful
0810 15:28:03.852743 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16}
I20260810 15:28:03.852917 10035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:03.846479 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58612 (local address 127.18.68.188:44519)
0810 15:28:03.846511 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0810 15:28:03.846513 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:28:03.846521 (+ 8us) server_negotiation.cc:407] Connection header received
0810 15:28:03.846577 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:28:03.846578 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:28:03.846587 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:28:03.846638 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:28:03.846879 (+ 241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:03.847355 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:03.847992 (+ 637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:03.848191 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:03.848265 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:03.849903 (+ 1638us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:28:03.849904 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:28:03.849904 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:28:03.849912 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:28:03.851527 (+ 1615us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:28:03.851915 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:28:03.851916 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:28:03.851916 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:28:03.852148 (+ 232us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:28:03.852361 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:28:03.852362 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:28:03.852362 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:28:03.852468 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:28:03.852542 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0810 15:28:03.852665 (+ 123us) server_negotiation.cc:299] Negotiation successful
0810 15:28:03.852792 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":62,"server-negotiator.queue_time_us":18}
I20260810 15:28:03.854859 10031 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ef0292fe828e4d9cbbc31ed5342f51e6: Bootstrap starting.
I20260810 15:28:03.855721 10031 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ef0292fe828e4d9cbbc31ed5342f51e6: Neither blocks nor log segments found. Creating new log.
I20260810 15:28:03.855965 10031 log.cc:824] T 00000000000000000000000000000000 P ef0292fe828e4d9cbbc31ed5342f51e6: Log is configured to *not* fsync() on all Append() calls
Aug 10 15:28:03 dist-test-slave-2p8l krb5kdc[9642](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375683, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.68.189@KRBTEST.COM
I20260810 15:28:03.856824 10031 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ef0292fe828e4d9cbbc31ed5342f51e6: No bootstrap required, opened a new log
I20260810 15:28:03.858843 10031 raft_consensus.cc:348] T 00000000000000000000000000000000 P ef0292fe828e4d9cbbc31ed5342f51e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b12ab7b24f7549d5871e2bfcd0e1a4b2" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 41395 } } peers { permanent_uuid: "666d95c9c1ed437e8b287786c25b4fc1" member_type: VOTER last_known_addr { host: "127.18.68.189" port: 38753 } } peers { permanent_uuid: "ef0292fe828e4d9cbbc31ed5342f51e6" member_type: VOTER last_known_addr { host: "127.18.68.188" port: 44519 } }
I20260810 15:28:03.859019 10031 raft_consensus.cc:374] T 00000000000000000000000000000000 P ef0292fe828e4d9cbbc31ed5342f51e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:28:03.859098 10031 raft_consensus.cc:729] T 00000000000000000000000000000000 P ef0292fe828e4d9cbbc31ed5342f51e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0292fe828e4d9cbbc31ed5342f51e6, State: Initialized, Role: FOLLOWER
I20260810 15:28:03.859263 10031 consensus_queue.cc:260] T 00000000000000000000000000000000 P ef0292fe828e4d9cbbc31ed5342f51e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b12ab7b24f7549d5871e2bfcd0e1a4b2" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 41395 } } peers { permanent_uuid: "666d95c9c1ed437e8b287786c25b4fc1" member_type: VOTER last_known_addr { host: "127.18.68.189" port: 38753 } } peers { permanent_uuid: "ef0292fe828e4d9cbbc31ed5342f51e6" member_type: VOTER last_known_addr { host: "127.18.68.188" port: 44519 } }
I20260810 15:28:03.859586 10040 sys_catalog.cc:455] T 00000000000000000000000000000000 P ef0292fe828e4d9cbbc31ed5342f51e6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b12ab7b24f7549d5871e2bfcd0e1a4b2" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 41395 } } peers { permanent_uuid: "666d95c9c1ed437e8b287786c25b4fc1" member_type: VOTER last_known_addr { host: "127.18.68.189" port: 38753 } } peers { permanent_uuid: "ef0292fe828e4d9cbbc31ed5342f51e6" member_type: VOTER last_known_addr { host: "127.18.68.188" port: 44519 } } }
I20260810 15:28:03.859651 10031 sys_catalog.cc:564] T 00000000000000000000000000000000 P ef0292fe828e4d9cbbc31ed5342f51e6 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 15:28:03.859673 10040 sys_catalog.cc:458] T 00000000000000000000000000000000 P ef0292fe828e4d9cbbc31ed5342f51e6 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 15:28:03.860044 9905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:03.852114 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60446 (local address 127.18.68.189:38753)
0810 15:28:03.852174 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0810 15:28:03.852176 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:28:03.852248 (+ 72us) server_negotiation.cc:407] Connection header received
0810 15:28:03.852329 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:28:03.852330 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:28:03.852339 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:28:03.852383 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:28:03.852872 (+ 489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:03.853473 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:03.854258 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:03.854454 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:03.854536 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:03.856996 (+ 2460us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:28:03.856998 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:28:03.856998 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:28:03.857005 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:28:03.858634 (+ 1629us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:28:03.859051 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:28:03.859052 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:28:03.859053 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:28:03.859161 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:28:03.859418 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:28:03.859419 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:28:03.859420 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:28:03.859563 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:28:03.859799 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0810 15:28:03.859842 (+ 43us) server_negotiation.cc:299] Negotiation successful
0810 15:28:03.859927 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
W20260810 15:28:03.861667 10060 catalog_manager.cc:1558] T 00000000000000000000000000000000 P ef0292fe828e4d9cbbc31ed5342f51e6: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 15:28:03.861817 10060 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 15:28:03.862035 18706 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 15:28:03.862181 9911 master_runner.cc:186] Error getting master registration for 127.18.68.190:41395: OK, instance_id { permanent_uuid: "b12ab7b24f7549d5871e2bfcd0e1a4b2" instance_seqno: 1786375683457688 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260810 15:28:03.865201 9911 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260810 15:28:03.866339 9897 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.68.188" port: 44519 } attempt: 3
Aug 10 15:28:03 dist-test-slave-2p8l krb5kdc[9642](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375683, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.189@KRBTEST.COM for kudu/127.18.68.188@KRBTEST.COM
I20260810 15:28:03.873099 9789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:03.863614 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59964 (local address 127.18.68.190:41395)
0810 15:28:03.863664 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0810 15:28:03.863666 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:28:03.863785 (+ 119us) server_negotiation.cc:407] Connection header received
0810 15:28:03.863901 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:28:03.863902 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:28:03.863913 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:28:03.863950 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:28:03.864856 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:03.865724 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:03.867144 (+ 1420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:03.867454 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:03.867532 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:03.869145 (+ 1613us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:28:03.869147 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:28:03.869147 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:28:03.869155 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:28:03.870949 (+ 1794us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:28:03.871958 (+ 1009us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:28:03.871960 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:28:03.871960 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:28:03.872017 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:28:03.872228 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:28:03.872229 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:28:03.872230 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:28:03.872472 (+ 242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:28:03.872598 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0810 15:28:03.872921 (+ 323us) server_negotiation.cc:299] Negotiation successful
0810 15:28:03.872998 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260810 15:28:03.874156 9905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:03.863842 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60458 (local address 127.18.68.189:38753)
0810 15:28:03.863883 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0810 15:28:03.863885 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:28:03.864975 (+ 1090us) server_negotiation.cc:407] Connection header received
0810 15:28:03.865077 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:28:03.865078 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:28:03.865088 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:28:03.865143 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:28:03.866231 (+ 1088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:03.866997 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:03.868435 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:03.868745 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:03.868787 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:03.870495 (+ 1708us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:28:03.870497 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:28:03.870497 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:28:03.870505 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:28:03.872264 (+ 1759us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:28:03.872674 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:28:03.872676 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:28:03.872676 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:28:03.872734 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:28:03.873184 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:28:03.873186 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:28:03.873186 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:28:03.873328 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:28:03.873420 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0810 15:28:03.873917 (+ 497us) server_negotiation.cc:299] Negotiation successful
0810 15:28:03.873998 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260810 15:28:03.875810 10035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:03.867241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58618 (local address 127.18.68.188:44519)
0810 15:28:03.867287 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0810 15:28:03.867289 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:28:03.867299 (+ 10us) server_negotiation.cc:407] Connection header received
0810 15:28:03.867369 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:28:03.867370 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:28:03.867380 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:28:03.867436 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:28:03.867813 (+ 377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:03.868571 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:03.869576 (+ 1005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:03.869967 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:03.870091 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:03.872697 (+ 2606us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:28:03.872698 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:28:03.872698 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:28:03.872706 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:28:03.874448 (+ 1742us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:28:03.874970 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:28:03.874971 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:28:03.874972 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:28:03.875032 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:28:03.875264 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:28:03.875265 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:28:03.875265 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:28:03.875409 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:28:03.875491 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0810 15:28:03.875646 (+ 155us) server_negotiation.cc:299] Negotiation successful
0810 15:28:03.875721 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260810 15:28:03.875811 9901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:03.867199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.188:44519 (local address 127.0.0.1:58618)
0810 15:28:03.867252 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:03.867263 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 15:28:03.867304 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:28:03.867481 (+ 177us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:28:03.867482 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:28:03.867678 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:28:03.867717 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:28:03.867719 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:28:03.868668 (+ 949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:28:03.868669 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:28:03.869479 (+ 810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:28:03.869483 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:28:03.870076 (+ 593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:28:03.870078 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:28:03.870140 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:03.871069 (+ 929us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:28:03.871076 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:28:03.872610 (+ 1534us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:28:03.874674 (+ 2064us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:28:03.874674 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:28:03.874675 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:28:03.874889 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:28:03.875113 (+ 224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:28:03.875114 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:28:03.875115 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:28:03.875174 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:28:03.875485 (+ 311us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:28:03.875486 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:28:03.875531 (+ 45us) client_negotiation.cc:769] Sending connection context
0810 15:28:03.875622 (+ 91us) client_negotiation.cc:240] Negotiation successful
0810 15:28:03.875718 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260810 15:28:03.877172 9897 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 666d95c9c1ed437e8b287786c25b4fc1: Bootstrap starting.
I20260810 15:28:03.877925 9897 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 666d95c9c1ed437e8b287786c25b4fc1: Neither blocks nor log segments found. Creating new log.
I20260810 15:28:03.878345 9897 log.cc:824] T 00000000000000000000000000000000 P 666d95c9c1ed437e8b287786c25b4fc1: Log is configured to *not* fsync() on all Append() calls
I20260810 15:28:03.879325 9897 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 666d95c9c1ed437e8b287786c25b4fc1: No bootstrap required, opened a new log
I20260810 15:28:03.881170 9897 raft_consensus.cc:348] T 00000000000000000000000000000000 P 666d95c9c1ed437e8b287786c25b4fc1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b12ab7b24f7549d5871e2bfcd0e1a4b2" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 41395 } } peers { permanent_uuid: "666d95c9c1ed437e8b287786c25b4fc1" member_type: VOTER last_known_addr { host: "127.18.68.189" port: 38753 } } peers { permanent_uuid: "ef0292fe828e4d9cbbc31ed5342f51e6" member_type: VOTER last_known_addr { host: "127.18.68.188" port: 44519 } }
I20260810 15:28:03.881330 9897 raft_consensus.cc:374] T 00000000000000000000000000000000 P 666d95c9c1ed437e8b287786c25b4fc1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:28:03.881379 9897 raft_consensus.cc:729] T 00000000000000000000000000000000 P 666d95c9c1ed437e8b287786c25b4fc1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 666d95c9c1ed437e8b287786c25b4fc1, State: Initialized, Role: FOLLOWER
I20260810 15:28:03.881512 9897 consensus_queue.cc:260] T 00000000000000000000000000000000 P 666d95c9c1ed437e8b287786c25b4fc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b12ab7b24f7549d5871e2bfcd0e1a4b2" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 41395 } } peers { permanent_uuid: "666d95c9c1ed437e8b287786c25b4fc1" member_type: VOTER last_known_addr { host: "127.18.68.189" port: 38753 } } peers { permanent_uuid: "ef0292fe828e4d9cbbc31ed5342f51e6" member_type: VOTER last_known_addr { host: "127.18.68.188" port: 44519 } }
I20260810 15:28:03.881843 10079 sys_catalog.cc:455] T 00000000000000000000000000000000 P 666d95c9c1ed437e8b287786c25b4fc1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b12ab7b24f7549d5871e2bfcd0e1a4b2" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 41395 } } peers { permanent_uuid: "666d95c9c1ed437e8b287786c25b4fc1" member_type: VOTER last_known_addr { host: "127.18.68.189" port: 38753 } } peers { permanent_uuid: "ef0292fe828e4d9cbbc31ed5342f51e6" member_type: VOTER last_known_addr { host: "127.18.68.188" port: 44519 } } }
I20260810 15:28:03.881898 9897 sys_catalog.cc:564] T 00000000000000000000000000000000 P 666d95c9c1ed437e8b287786c25b4fc1 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 15:28:03.881928 10079 sys_catalog.cc:458] T 00000000000000000000000000000000 P 666d95c9c1ed437e8b287786c25b4fc1 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 15:28:03.882612 10076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:03.868323 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58626 (local address 127.18.68.188:44519)
0810 15:28:03.869183 (+ 860us) server_negotiation.cc:206] Beginning negotiation
0810 15:28:03.869185 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:28:03.869314 (+ 129us) server_negotiation.cc:407] Connection header received
0810 15:28:03.870777 (+ 1463us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:28:03.870778 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:28:03.870789 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:28:03.870871 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:28:03.873103 (+ 2232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:03.875848 (+ 2745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:03.877304 (+ 1456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:03.877640 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:03.877712 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:03.879246 (+ 1534us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:28:03.879247 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:28:03.879248 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:28:03.879255 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:28:03.880932 (+ 1677us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:28:03.881342 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:28:03.881343 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:28:03.881344 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:28:03.881403 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:28:03.881626 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:28:03.881627 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:28:03.881628 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:28:03.881777 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:28:03.881877 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0810 15:28:03.882340 (+ 463us) server_negotiation.cc:299] Negotiation successful
0810 15:28:03.882433 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":836,"thread_start_us":100,"threads_started":1}
W20260810 15:28:03.884121 10100 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 666d95c9c1ed437e8b287786c25b4fc1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 15:28:03.884186 10100 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 15:28:03.885143 9794 master_runner.cc:186] Error getting master registration for 127.18.68.190:41395: OK, instance_id { permanent_uuid: "b12ab7b24f7549d5871e2bfcd0e1a4b2" instance_seqno: 1786375683457688 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260810 15:28:03.888091 9794 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260810 15:28:03.890825 10079 raft_consensus.cc:482] T 00000000000000000000000000000000 P 666d95c9c1ed437e8b287786c25b4fc1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 15:28:03.890928 10079 raft_consensus.cc:504] T 00000000000000000000000000000000 P 666d95c9c1ed437e8b287786c25b4fc1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b12ab7b24f7549d5871e2bfcd0e1a4b2" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 41395 } } peers { permanent_uuid: "666d95c9c1ed437e8b287786c25b4fc1" member_type: VOTER last_known_addr { host: "127.18.68.189" port: 38753 } } peers { permanent_uuid: "ef0292fe828e4d9cbbc31ed5342f51e6" member_type: VOTER last_known_addr { host: "127.18.68.188" port: 44519 } }
I20260810 15:28:03.891196 10079 leader_election.cc:288] T 00000000000000000000000000000000 P 666d95c9c1ed437e8b287786c25b4fc1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b12ab7b24f7549d5871e2bfcd0e1a4b2 (127.18.68.190:41395), ef0292fe828e4d9cbbc31ed5342f51e6 (127.18.68.188:44519)
I20260810 15:28:03.891506 9983 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "666d95c9c1ed437e8b287786c25b4fc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0292fe828e4d9cbbc31ed5342f51e6" is_pre_election: true
I20260810 15:28:03.891656 9983 raft_consensus.cc:2454] T 00000000000000000000000000000000 P ef0292fe828e4d9cbbc31ed5342f51e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 666d95c9c1ed437e8b287786c25b4fc1 in term 0.
I20260810 15:28:03.891875 9824 leader_election.cc:302] T 00000000000000000000000000000000 P 666d95c9c1ed437e8b287786c25b4fc1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 666d95c9c1ed437e8b287786c25b4fc1, ef0292fe828e4d9cbbc31ed5342f51e6; no voters:
I20260810 15:28:03.891999 10079 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 666d95c9c1ed437e8b287786c25b4fc1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 15:28:03.892046 10079 raft_consensus.cc:482] T 00000000000000000000000000000000 P 666d95c9c1ed437e8b287786c25b4fc1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 15:28:03.892086 10079 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 666d95c9c1ed437e8b287786c25b4fc1 [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:28:03.893375 10079 raft_consensus.cc:504] T 00000000000000000000000000000000 P 666d95c9c1ed437e8b287786c25b4fc1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b12ab7b24f7549d5871e2bfcd0e1a4b2" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 41395 } } peers { permanent_uuid: "666d95c9c1ed437e8b287786c25b4fc1" member_type: VOTER last_known_addr { host: "127.18.68.189" port: 38753 } } peers { permanent_uuid: "ef0292fe828e4d9cbbc31ed5342f51e6" member_type: VOTER last_known_addr { host: "127.18.68.188" port: 44519 } }
I20260810 15:28:03.893507 10079 leader_election.cc:288] T 00000000000000000000000000000000 P 666d95c9c1ed437e8b287786c25b4fc1 [CANDIDATE]: Term 1 election: Requested vote from peers b12ab7b24f7549d5871e2bfcd0e1a4b2 (127.18.68.190:41395), ef0292fe828e4d9cbbc31ed5342f51e6 (127.18.68.188:44519)
I20260810 15:28:03.893793 9983 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "666d95c9c1ed437e8b287786c25b4fc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0292fe828e4d9cbbc31ed5342f51e6"
I20260810 15:28:03.893879 9983 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ef0292fe828e4d9cbbc31ed5342f51e6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:28:03.895241 9983 raft_consensus.cc:2454] T 00000000000000000000000000000000 P ef0292fe828e4d9cbbc31ed5342f51e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 666d95c9c1ed437e8b287786c25b4fc1 in term 1.
I20260810 15:28:03.895820 9824 leader_election.cc:302] T 00000000000000000000000000000000 P 666d95c9c1ed437e8b287786c25b4fc1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 666d95c9c1ed437e8b287786c25b4fc1, ef0292fe828e4d9cbbc31ed5342f51e6; no voters:
I20260810 15:28:03.896023 10079 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 666d95c9c1ed437e8b287786c25b4fc1 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 15:28:03.896207 10079 raft_consensus.cc:686] T 00000000000000000000000000000000 P 666d95c9c1ed437e8b287786c25b4fc1 [term 1 LEADER]: Becoming Leader. State: Replica: 666d95c9c1ed437e8b287786c25b4fc1, State: Running, Role: LEADER
I20260810 15:28:03.896297 10079 consensus_queue.cc:237] T 00000000000000000000000000000000 P 666d95c9c1ed437e8b287786c25b4fc1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b12ab7b24f7549d5871e2bfcd0e1a4b2" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 41395 } } peers { permanent_uuid: "666d95c9c1ed437e8b287786c25b4fc1" member_type: VOTER last_known_addr { host: "127.18.68.189" port: 38753 } } peers { permanent_uuid: "ef0292fe828e4d9cbbc31ed5342f51e6" member_type: VOTER last_known_addr { host: "127.18.68.188" port: 44519 } }
I20260810 15:28:03.896682 10079 sys_catalog.cc:455] T 00000000000000000000000000000000 P 666d95c9c1ed437e8b287786c25b4fc1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 666d95c9c1ed437e8b287786c25b4fc1. Latest consensus state: current_term: 1 leader_uuid: "666d95c9c1ed437e8b287786c25b4fc1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b12ab7b24f7549d5871e2bfcd0e1a4b2" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 41395 } } peers { permanent_uuid: "666d95c9c1ed437e8b287786c25b4fc1" member_type: VOTER last_known_addr { host: "127.18.68.189" port: 38753 } } peers { permanent_uuid: "ef0292fe828e4d9cbbc31ed5342f51e6" member_type: VOTER last_known_addr { host: "127.18.68.188" port: 44519 } } }
I20260810 15:28:03.896766 10079 sys_catalog.cc:458] T 00000000000000000000000000000000 P 666d95c9c1ed437e8b287786c25b4fc1 [sys.catalog]: This master's current role is: LEADER
I20260810 15:28:03.896970 10107 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 15:28:03.897187 10107 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 15:28:03.899375 9983 raft_consensus.cc:1261] T 00000000000000000000000000000000 P ef0292fe828e4d9cbbc31ed5342f51e6 [term 1 FOLLOWER]: Refusing update from remote peer 666d95c9c1ed437e8b287786c25b4fc1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 15:28:03.899663 10079 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 666d95c9c1ed437e8b287786c25b4fc1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0292fe828e4d9cbbc31ed5342f51e6" member_type: VOTER last_known_addr { host: "127.18.68.188" port: 44519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 15:28:03.901945 10040 sys_catalog.cc:455] T 00000000000000000000000000000000 P ef0292fe828e4d9cbbc31ed5342f51e6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 666d95c9c1ed437e8b287786c25b4fc1. Latest consensus state: current_term: 1 leader_uuid: "666d95c9c1ed437e8b287786c25b4fc1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b12ab7b24f7549d5871e2bfcd0e1a4b2" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 41395 } } peers { permanent_uuid: "666d95c9c1ed437e8b287786c25b4fc1" member_type: VOTER last_known_addr { host: "127.18.68.189" port: 38753 } } peers { permanent_uuid: "ef0292fe828e4d9cbbc31ed5342f51e6" member_type: VOTER last_known_addr { host: "127.18.68.188" port: 44519 } } }
I20260810 15:28:03.902027 10040 sys_catalog.cc:458] T 00000000000000000000000000000000 P ef0292fe828e4d9cbbc31ed5342f51e6 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 15:28:03.902377 10079 sys_catalog.cc:455] T 00000000000000000000000000000000 P 666d95c9c1ed437e8b287786c25b4fc1 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "666d95c9c1ed437e8b287786c25b4fc1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b12ab7b24f7549d5871e2bfcd0e1a4b2" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 41395 } } peers { permanent_uuid: "666d95c9c1ed437e8b287786c25b4fc1" member_type: VOTER last_known_addr { host: "127.18.68.189" port: 38753 } } peers { permanent_uuid: "ef0292fe828e4d9cbbc31ed5342f51e6" member_type: VOTER last_known_addr { host: "127.18.68.188" port: 44519 } } }
I20260810 15:28:03.902451 10079 sys_catalog.cc:458] T 00000000000000000000000000000000 P 666d95c9c1ed437e8b287786c25b4fc1 [sys.catalog]: This master's current role is: LEADER
I20260810 15:28:03.902470 10109 mvcc.cc:205] Tried to move back new op lower bound from 7316994801249320960 to 7316994801239859200. Current Snapshot: MvccSnapshot[applied={T|T < 7316994801249320960}]
I20260810 15:28:03.903245 10040 sys_catalog.cc:455] T 00000000000000000000000000000000 P ef0292fe828e4d9cbbc31ed5342f51e6 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "666d95c9c1ed437e8b287786c25b4fc1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b12ab7b24f7549d5871e2bfcd0e1a4b2" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 41395 } } peers { permanent_uuid: "666d95c9c1ed437e8b287786c25b4fc1" member_type: VOTER last_known_addr { host: "127.18.68.189" port: 38753 } } peers { permanent_uuid: "ef0292fe828e4d9cbbc31ed5342f51e6" member_type: VOTER last_known_addr { host: "127.18.68.188" port: 44519 } } }
I20260810 15:28:03.903357 10040 sys_catalog.cc:458] T 00000000000000000000000000000000 P ef0292fe828e4d9cbbc31ed5342f51e6 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 15:28:03.905635 9785 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.68.188" port: 44519 } attempt: 3
I20260810 15:28:03.906510 10107 catalog_manager.cc:1347] Generated new cluster ID: f2c6cd46d6304521b126da777619f297
I20260810 15:28:03.906559 10107 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 10 15:28:03 dist-test-slave-2p8l krb5kdc[9642](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375683, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.190@KRBTEST.COM for kudu/127.18.68.188@KRBTEST.COM
I20260810 15:28:03.915256 9787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:03.905904 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.188:44519 (local address 127.0.0.1:58636)
0810 15:28:03.905965 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:03.905976 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 15:28:03.906015 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:28:03.906264 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:28:03.906264 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:28:03.906456 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:28:03.906505 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:28:03.906507 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:28:03.908236 (+ 1729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:28:03.908237 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:28:03.909059 (+ 822us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:28:03.909062 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:28:03.909650 (+ 588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:28:03.909651 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:28:03.909722 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:03.910316 (+ 594us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:28:03.910321 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:28:03.911846 (+ 1525us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:28:03.913986 (+ 2140us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:28:03.913987 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:28:03.913987 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:28:03.914269 (+ 282us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:28:03.914546 (+ 277us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:28:03.914547 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:28:03.914548 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:28:03.914618 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:28:03.914926 (+ 308us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:28:03.914927 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:28:03.914982 (+ 55us) client_negotiation.cc:769] Sending connection context
0810 15:28:03.915055 (+ 73us) client_negotiation.cc:240] Negotiation successful
0810 15:28:03.915148 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42}
I20260810 15:28:03.916460 10076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:03.905958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58636 (local address 127.18.68.188:44519)
0810 15:28:03.906120 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0810 15:28:03.906122 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:28:03.906130 (+ 8us) server_negotiation.cc:407] Connection header received
0810 15:28:03.906151 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:28:03.906152 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:28:03.906163 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:28:03.906195 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:28:03.906588 (+ 393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:03.907411 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:03.909170 (+ 1759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:03.909518 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:03.909579 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:03.911962 (+ 2383us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:28:03.911963 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:28:03.911963 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:28:03.911983 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:28:03.913863 (+ 1880us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:28:03.914394 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:28:03.914395 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:28:03.914395 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:28:03.914465 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:28:03.914693 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:28:03.914694 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:28:03.914695 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:28:03.914832 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:28:03.914889 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0810 15:28:03.916227 (+ 1338us) server_negotiation.cc:299] Negotiation successful
0810 15:28:03.916339 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139}
I20260810 15:28:03.917937 9785 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b12ab7b24f7549d5871e2bfcd0e1a4b2: Bootstrap starting.
I20260810 15:28:03.918720 9785 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b12ab7b24f7549d5871e2bfcd0e1a4b2: Neither blocks nor log segments found. Creating new log.
I20260810 15:28:03.919029 9785 log.cc:824] T 00000000000000000000000000000000 P b12ab7b24f7549d5871e2bfcd0e1a4b2: Log is configured to *not* fsync() on all Append() calls
I20260810 15:28:03.919962 9785 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b12ab7b24f7549d5871e2bfcd0e1a4b2: No bootstrap required, opened a new log
I20260810 15:28:03.921990 9785 raft_consensus.cc:348] T 00000000000000000000000000000000 P b12ab7b24f7549d5871e2bfcd0e1a4b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b12ab7b24f7549d5871e2bfcd0e1a4b2" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 41395 } } peers { permanent_uuid: "666d95c9c1ed437e8b287786c25b4fc1" member_type: VOTER last_known_addr { host: "127.18.68.189" port: 38753 } } peers { permanent_uuid: "ef0292fe828e4d9cbbc31ed5342f51e6" member_type: VOTER last_known_addr { host: "127.18.68.188" port: 44519 } }
I20260810 15:28:03.922173 9785 raft_consensus.cc:374] T 00000000000000000000000000000000 P b12ab7b24f7549d5871e2bfcd0e1a4b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:28:03.922223 9785 raft_consensus.cc:729] T 00000000000000000000000000000000 P b12ab7b24f7549d5871e2bfcd0e1a4b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b12ab7b24f7549d5871e2bfcd0e1a4b2, State: Initialized, Role: FOLLOWER
I20260810 15:28:03.922345 9785 consensus_queue.cc:260] T 00000000000000000000000000000000 P b12ab7b24f7549d5871e2bfcd0e1a4b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b12ab7b24f7549d5871e2bfcd0e1a4b2" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 41395 } } peers { permanent_uuid: "666d95c9c1ed437e8b287786c25b4fc1" member_type: VOTER last_known_addr { host: "127.18.68.189" port: 38753 } } peers { permanent_uuid: "ef0292fe828e4d9cbbc31ed5342f51e6" member_type: VOTER last_known_addr { host: "127.18.68.188" port: 44519 } }
I20260810 15:28:03.922691 9785 sys_catalog.cc:564] T 00000000000000000000000000000000 P b12ab7b24f7549d5871e2bfcd0e1a4b2 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 15:28:03.922741 9720 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "666d95c9c1ed437e8b287786c25b4fc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b12ab7b24f7549d5871e2bfcd0e1a4b2" is_pre_election: true
I20260810 15:28:03.922881 9720 raft_consensus.cc:2454] T 00000000000000000000000000000000 P b12ab7b24f7549d5871e2bfcd0e1a4b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 666d95c9c1ed437e8b287786c25b4fc1 in term 0.
I20260810 15:28:03.923249 9730 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "666d95c9c1ed437e8b287786c25b4fc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b12ab7b24f7549d5871e2bfcd0e1a4b2"
I20260810 15:28:03.923349 9729 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b12ab7b24f7549d5871e2bfcd0e1a4b2 [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:28:03.924324 9729 raft_consensus.cc:1261] T 00000000000000000000000000000000 P b12ab7b24f7549d5871e2bfcd0e1a4b2 [term 1 FOLLOWER]: Refusing update from remote peer 666d95c9c1ed437e8b287786c25b4fc1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 15:28:03.924729 10117 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 666d95c9c1ed437e8b287786c25b4fc1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b12ab7b24f7549d5871e2bfcd0e1a4b2" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 41395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 15:28:03.926849 10122 sys_catalog.cc:455] T 00000000000000000000000000000000 P b12ab7b24f7549d5871e2bfcd0e1a4b2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "666d95c9c1ed437e8b287786c25b4fc1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b12ab7b24f7549d5871e2bfcd0e1a4b2" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 41395 } } peers { permanent_uuid: "666d95c9c1ed437e8b287786c25b4fc1" member_type: VOTER last_known_addr { host: "127.18.68.189" port: 38753 } } peers { permanent_uuid: "ef0292fe828e4d9cbbc31ed5342f51e6" member_type: VOTER last_known_addr { host: "127.18.68.188" port: 44519 } } }
I20260810 15:28:03.926971 10122 sys_catalog.cc:458] T 00000000000000000000000000000000 P b12ab7b24f7549d5871e2bfcd0e1a4b2 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 15:28:03.927031 10122 sys_catalog.cc:455] T 00000000000000000000000000000000 P b12ab7b24f7549d5871e2bfcd0e1a4b2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 666d95c9c1ed437e8b287786c25b4fc1. Latest consensus state: current_term: 1 leader_uuid: "666d95c9c1ed437e8b287786c25b4fc1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b12ab7b24f7549d5871e2bfcd0e1a4b2" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 41395 } } peers { permanent_uuid: "666d95c9c1ed437e8b287786c25b4fc1" member_type: VOTER last_known_addr { host: "127.18.68.189" port: 38753 } } peers { permanent_uuid: "ef0292fe828e4d9cbbc31ed5342f51e6" member_type: VOTER last_known_addr { host: "127.18.68.188" port: 44519 } } }
I20260810 15:28:03.927115 10122 sys_catalog.cc:458] T 00000000000000000000000000000000 P b12ab7b24f7549d5871e2bfcd0e1a4b2 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 15:28:03.927155 10122 sys_catalog.cc:455] T 00000000000000000000000000000000 P b12ab7b24f7549d5871e2bfcd0e1a4b2 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "666d95c9c1ed437e8b287786c25b4fc1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b12ab7b24f7549d5871e2bfcd0e1a4b2" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 41395 } } peers { permanent_uuid: "666d95c9c1ed437e8b287786c25b4fc1" member_type: VOTER last_known_addr { host: "127.18.68.189" port: 38753 } } peers { permanent_uuid: "ef0292fe828e4d9cbbc31ed5342f51e6" member_type: VOTER last_known_addr { host: "127.18.68.188" port: 44519 } } }
I20260810 15:28:03.927203 10122 sys_catalog.cc:458] T 00000000000000000000000000000000 P b12ab7b24f7549d5871e2bfcd0e1a4b2 [sys.catalog]: This master's current role is: FOLLOWER
W20260810 15:28:03.928172 10152 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b12ab7b24f7549d5871e2bfcd0e1a4b2: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 15:28:03.928234 10152 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 15:28:03.934600 10147 mvcc.cc:205] Tried to move back new op lower bound from 7316994801249320960 to 7316994801239859200. Current Snapshot: MvccSnapshot[applied={T|T < 7316994801249320960}]
I20260810 15:28:03.948418 10117 sys_catalog.cc:455] T 00000000000000000000000000000000 P 666d95c9c1ed437e8b287786c25b4fc1 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "666d95c9c1ed437e8b287786c25b4fc1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b12ab7b24f7549d5871e2bfcd0e1a4b2" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 41395 } } peers { permanent_uuid: "666d95c9c1ed437e8b287786c25b4fc1" member_type: VOTER last_known_addr { host: "127.18.68.189" port: 38753 } } peers { permanent_uuid: "ef0292fe828e4d9cbbc31ed5342f51e6" member_type: VOTER last_known_addr { host: "127.18.68.188" port: 44519 } } }
I20260810 15:28:03.948553 10117 sys_catalog.cc:458] T 00000000000000000000000000000000 P 666d95c9c1ed437e8b287786c25b4fc1 [sys.catalog]: This master's current role is: LEADER
I20260810 15:28:03.949523 10107 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 15:28:03.950338 10107 catalog_manager.cc:1504] Loading token signing keys...
I20260810 15:28:03.958875 10107 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 666d95c9c1ed437e8b287786c25b4fc1: Generated new TSK 0
I20260810 15:28:03.959188 10107 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 15:28:04.862547 10060 catalog_manager.cc:1259] Loaded cluster ID: f2c6cd46d6304521b126da777619f297
I20260810 15:28:04.862637 10060 catalog_manager.cc:1552] T 00000000000000000000000000000000 P ef0292fe828e4d9cbbc31ed5342f51e6: loading cluster ID for follower catalog manager: success
I20260810 15:28:04.863524 10060 catalog_manager.cc:1574] T 00000000000000000000000000000000 P ef0292fe828e4d9cbbc31ed5342f51e6: acquiring CA information for follower catalog manager: success
I20260810 15:28:04.863871 10060 catalog_manager.cc:1602] T 00000000000000000000000000000000 P ef0292fe828e4d9cbbc31ed5342f51e6: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260810 15:28:04.928712 10152 catalog_manager.cc:1259] Loaded cluster ID: f2c6cd46d6304521b126da777619f297
I20260810 15:28:04.928812 10152 catalog_manager.cc:1552] T 00000000000000000000000000000000 P b12ab7b24f7549d5871e2bfcd0e1a4b2: loading cluster ID for follower catalog manager: success
I20260810 15:28:04.929688 10152 catalog_manager.cc:1574] T 00000000000000000000000000000000 P b12ab7b24f7549d5871e2bfcd0e1a4b2: acquiring CA information for follower catalog manager: success
I20260810 15:28:04.930028 10152 catalog_manager.cc:1602] T 00000000000000000000000000000000 P b12ab7b24f7549d5871e2bfcd0e1a4b2: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260810 15:28:05.022933 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 9665
I20260810 15:28:05.041495 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 9794
I20260810 15:28:05.057497 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 9911
2026-08-10T15:28:05Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (3199 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786375520124696-18706-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 15:28:05 dist-test-slave-2p8l krb5kdc[10168](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 15:28:05 dist-test-slave-2p8l krb5kdc[10168](info): set up 2 sockets
Aug 10 15:28:05 dist-test-slave-2p8l krb5kdc[10168](info): commencing operation
krb5kdc: starting...
W20260810 15:28:06.378697 18706 mini_kdc.cc:121] Time spent starting KDC: real 1.291s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786375520124696-18706-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786375520124696-18706-0/krb5kdc/test-user.keytab.
Aug 10 15:28:06 dist-test-slave-2p8l krb5kdc[10168](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375686, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T15:28:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T15:28:06Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.68.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.68.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.68.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab.
Entry for principal kudu/127.18.68.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab.
I20260810 15:28:06.505199 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786375520124696-18706-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786375520124696-18706-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786375520124696-18706-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.190:37973
--webserver_interface=127.18.68.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab
--principal=kudu/127.18.68.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:40789
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.68.190:37973
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:28:06.588932 10194 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:28:06.589186 10194 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:28:06.589227 10194 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:28:06.590430 10194 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 15:28:06.590494 10194 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:28:06.590517 10194 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:28:06.590538 10194 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 15:28:06.590569 10194 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 15:28:06.592067 10194 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:40789
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786375520124696-18706-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786375520124696-18706-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.68.190:37973
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab
--principal=kudu/127.18.68.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.190:37973
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.68.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10194
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786375520124696-18706-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:28:06.592350 10194 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:28:06.592597 10194 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:28:06.597574 10202 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:28:06.597638 10207 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:28:06.597618 10203 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:28:06.598131 10194 server_base.cc:1034] running on GCE node
I20260810 15:28:06.598376 10194 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:28:06.598690 10194 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:28:06.599859 10194 hybrid_clock.cc:648] HybridClock initialized: now 1786375686599816 us; error 61 us; skew 500 ppm
Aug 10 15:28:06 dist-test-slave-2p8l krb5kdc[10168](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375686, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:28:06.606593 10194 init.cc:377] Logged in from keytab as kudu/127.18.68.190@KRBTEST.COM (short username kudu)
I20260810 15:28:06.607095 10194 webserver.cc:460] Webserver started at http://127.18.68.190:38711/ using document root <none> and password file <none>
I20260810 15:28:06.607366 10194 fs_manager.cc:359] Metadata directory not provided
I20260810 15:28:06.607436 10194 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:28:06.607591 10194 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:28:06.608680 10194 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786375520124696-18706-0/minicluster-data/master-0/data/instance:
uuid: "166f31b34892460e88c807e8d2cb0631"
format_stamp: "Formatted at 2026-08-10 15:28:06 on dist-test-slave-2p8l"
server_key: "b1860467ffc2198706f7aa041b50d000"
server_key_iv: "057eb0c472ab552a5821d5d6e6136cdb"
server_key_version: "encryptionkey@0"
I20260810 15:28:06.609055 10194 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786375520124696-18706-0/minicluster-data/master-0/wal/instance:
uuid: "166f31b34892460e88c807e8d2cb0631"
format_stamp: "Formatted at 2026-08-10 15:28:06 on dist-test-slave-2p8l"
server_key: "b1860467ffc2198706f7aa041b50d000"
server_key_iv: "057eb0c472ab552a5821d5d6e6136cdb"
server_key_version: "encryptionkey@0"
I20260810 15:28:06.610523 10194 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 15:28:06.611339 10218 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:28:06.611536 10194 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:28:06.611649 10194 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786375520124696-18706-0/minicluster-data/master-0/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786375520124696-18706-0/minicluster-data/master-0/wal
uuid: "166f31b34892460e88c807e8d2cb0631"
format_stamp: "Formatted at 2026-08-10 15:28:06 on dist-test-slave-2p8l"
server_key: "b1860467ffc2198706f7aa041b50d000"
server_key_iv: "057eb0c472ab552a5821d5d6e6136cdb"
server_key_version: "encryptionkey@0"
I20260810 15:28:06.611725 10194 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786375520124696-18706-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786375520124696-18706-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786375520124696-18706-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:28:06.638410 10194 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:28:06.640497 10194 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:28:06.640688 10194 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:28:06.645171 10194 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.190:37973
I20260810 15:28:06.645241 10320 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.190:37973 every 8 connection(s)
I20260810 15:28:06.645643 10194 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
I20260810 15:28:06.646674 10321 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:28:06.648954 10321 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 166f31b34892460e88c807e8d2cb0631: Bootstrap starting.
I20260810 15:28:06.649501 10321 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 166f31b34892460e88c807e8d2cb0631: Neither blocks nor log segments found. Creating new log.
I20260810 15:28:06.649747 10321 log.cc:824] T 00000000000000000000000000000000 P 166f31b34892460e88c807e8d2cb0631: Log is configured to *not* fsync() on all Append() calls
I20260810 15:28:06.650496 10321 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 166f31b34892460e88c807e8d2cb0631: No bootstrap required, opened a new log
I20260810 15:28:06.650976 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 10194
I20260810 15:28:06.651091 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786375520124696-18706-0/minicluster-data/master-0/wal/instance
I20260810 15:28:06.651317 18706 external_mini_cluster.cc:1428] Setting key 9bac2e4dd5e833ad2cdd802e317afa2a
I20260810 15:28:06.652688 10321 raft_consensus.cc:348] T 00000000000000000000000000000000 P 166f31b34892460e88c807e8d2cb0631 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "166f31b34892460e88c807e8d2cb0631" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 37973 } }
I20260810 15:28:06.652865 10321 raft_consensus.cc:374] T 00000000000000000000000000000000 P 166f31b34892460e88c807e8d2cb0631 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:28:06.652906 10321 raft_consensus.cc:729] T 00000000000000000000000000000000 P 166f31b34892460e88c807e8d2cb0631 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 166f31b34892460e88c807e8d2cb0631, State: Initialized, Role: FOLLOWER
I20260810 15:28:06.653048 10321 consensus_queue.cc:260] T 00000000000000000000000000000000 P 166f31b34892460e88c807e8d2cb0631 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "166f31b34892460e88c807e8d2cb0631" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 37973 } }
I20260810 15:28:06.653139 10321 raft_consensus.cc:388] T 00000000000000000000000000000000 P 166f31b34892460e88c807e8d2cb0631 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 15:28:06.653184 10321 raft_consensus.cc:482] T 00000000000000000000000000000000 P 166f31b34892460e88c807e8d2cb0631 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 15:28:06.653240 10321 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 166f31b34892460e88c807e8d2cb0631 [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:28:06.654348 10321 raft_consensus.cc:504] T 00000000000000000000000000000000 P 166f31b34892460e88c807e8d2cb0631 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "166f31b34892460e88c807e8d2cb0631" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 37973 } }
I20260810 15:28:06.654440 10321 leader_election.cc:302] T 00000000000000000000000000000000 P 166f31b34892460e88c807e8d2cb0631 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 166f31b34892460e88c807e8d2cb0631; no voters:
I20260810 15:28:06.654646 10321 leader_election.cc:288] T 00000000000000000000000000000000 P 166f31b34892460e88c807e8d2cb0631 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 15:28:06.654692 10331 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 166f31b34892460e88c807e8d2cb0631 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 15:28:06.654846 10331 raft_consensus.cc:686] T 00000000000000000000000000000000 P 166f31b34892460e88c807e8d2cb0631 [term 1 LEADER]: Becoming Leader. State: Replica: 166f31b34892460e88c807e8d2cb0631, State: Running, Role: LEADER
I20260810 15:28:06.654923 10321 sys_catalog.cc:564] T 00000000000000000000000000000000 P 166f31b34892460e88c807e8d2cb0631 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 15:28:06.654954 10331 consensus_queue.cc:237] T 00000000000000000000000000000000 P 166f31b34892460e88c807e8d2cb0631 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "166f31b34892460e88c807e8d2cb0631" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 37973 } }
I20260810 15:28:06.655290 10333 sys_catalog.cc:455] T 00000000000000000000000000000000 P 166f31b34892460e88c807e8d2cb0631 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "166f31b34892460e88c807e8d2cb0631" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "166f31b34892460e88c807e8d2cb0631" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 37973 } } }
I20260810 15:28:06.655382 10333 sys_catalog.cc:458] T 00000000000000000000000000000000 P 166f31b34892460e88c807e8d2cb0631 [sys.catalog]: This master's current role is: LEADER
I20260810 15:28:06.655562 10335 sys_catalog.cc:455] T 00000000000000000000000000000000 P 166f31b34892460e88c807e8d2cb0631 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 166f31b34892460e88c807e8d2cb0631. Latest consensus state: current_term: 1 leader_uuid: "166f31b34892460e88c807e8d2cb0631" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "166f31b34892460e88c807e8d2cb0631" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 37973 } } }
I20260810 15:28:06.655647 10335 sys_catalog.cc:458] T 00000000000000000000000000000000 P 166f31b34892460e88c807e8d2cb0631 [sys.catalog]: This master's current role is: LEADER
I20260810 15:28:06.656503 10340 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 15:28:06.657099 10340 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 10 15:28:06 dist-test-slave-2p8l krb5kdc[10168](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375686, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
I20260810 15:28:06.658877 10340 catalog_manager.cc:1347] Generated new cluster ID: 4681ae82ad1e4672ba2b4115dd8143bb
I20260810 15:28:06.658931 10340 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 15:28:06.662974 10326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:06.651876 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55272 (local address 127.18.68.190:37973)
0810 15:28:06.652050 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0810 15:28:06.652058 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 15:28:06.652083 (+ 25us) server_negotiation.cc:407] Connection header received
0810 15:28:06.652665 (+ 582us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:28:06.652671 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:28:06.652719 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:28:06.652834 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:28:06.653664 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:06.654797 (+ 1133us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:06.655921 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:06.656583 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:06.656690 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:06.659298 (+ 2608us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:28:06.659302 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:28:06.659303 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:28:06.659315 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:28:06.661081 (+ 1766us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:28:06.661473 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:28:06.661479 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:28:06.661479 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:28:06.661591 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:28:06.661814 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:28:06.661815 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:28:06.661815 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:28:06.662103 (+ 288us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:28:06.662270 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0810 15:28:06.662495 (+ 225us) server_negotiation.cc:299] Negotiation successful
0810 15:28:06.662671 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":122,"thread_start_us":88,"threads_started":1}
I20260810 15:28:06.664048 18706 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 15:28:06.668397 10340 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 15:28:06.669092 10340 catalog_manager.cc:1504] Loading token signing keys...
I20260810 15:28:06.673659 10340 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 166f31b34892460e88c807e8d2cb0631: Generated new TSK 0
I20260810 15:28:06.673849 10340 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 15:28:06.718436 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 10194
2026-08-10T15:28:06Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1662 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 15:28:06 dist-test-slave-2p8l krb5kdc[10371](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 15:28:06 dist-test-slave-2p8l krb5kdc[10371](info): set up 2 sockets
Aug 10 15:28:06 dist-test-slave-2p8l krb5kdc[10371](info): commencing operation
krb5kdc: starting...
W20260810 15:28:08.007149 18706 mini_kdc.cc:121] Time spent starting KDC: real 1.257s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/krb5kdc/test-user.keytab.
Aug 10 15:28:08 dist-test-slave-2p8l krb5kdc[10371](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375688, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T15:28:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T15:28:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.68.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.68.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.68.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab.
Entry for principal kudu/127.18.68.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab.
I20260810 15:28:08.153175 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.190:42059
--webserver_interface=127.18.68.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab
--principal=kudu/127.18.68.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:44607
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.68.190:42059
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:28:08.235762 10390 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:28:08.235977 10390 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:28:08.236001 10390 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:28:08.237087 10390 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 15:28:08.237121 10390 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:28:08.237136 10390 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:28:08.237149 10390 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 15:28:08.237160 10390 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 15:28:08.238592 10390 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:44607
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.68.190:42059
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab
--principal=kudu/127.18.68.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.190:42059
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.68.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10390
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:28:08.238798 10390 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:28:08.238974 10390 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:28:08.243861 10399 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:28:08.243867 10403 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:28:08.243870 10400 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:28:08.244272 10390 server_base.cc:1034] running on GCE node
I20260810 15:28:08.244534 10390 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:28:08.244848 10390 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:28:08.246034 10390 hybrid_clock.cc:648] HybridClock initialized: now 1786375688246014 us; error 30 us; skew 500 ppm
Aug 10 15:28:08 dist-test-slave-2p8l krb5kdc[10371](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375688, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:28:08.248754 10390 init.cc:377] Logged in from keytab as kudu/127.18.68.190@KRBTEST.COM (short username kudu)
I20260810 15:28:08.249251 10390 webserver.cc:460] Webserver started at http://127.18.68.190:37927/ using document root <none> and password file <none>
I20260810 15:28:08.249492 10390 fs_manager.cc:359] Metadata directory not provided
I20260810 15:28:08.249562 10390 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:28:08.249718 10390 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:28:08.250828 10390 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/master-0/data/instance:
uuid: "a99445ac89234308a23266d8febb1d03"
format_stamp: "Formatted at 2026-08-10 15:28:08 on dist-test-slave-2p8l"
server_key: "9c039938d2684d51a9007029b17a58ad"
server_key_iv: "c0c0e9431248c031453cf5d98942ca5c"
server_key_version: "encryptionkey@0"
I20260810 15:28:08.251196 10390 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/master-0/wal/instance:
uuid: "a99445ac89234308a23266d8febb1d03"
format_stamp: "Formatted at 2026-08-10 15:28:08 on dist-test-slave-2p8l"
server_key: "9c039938d2684d51a9007029b17a58ad"
server_key_iv: "c0c0e9431248c031453cf5d98942ca5c"
server_key_version: "encryptionkey@0"
I20260810 15:28:08.252527 10390 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260810 15:28:08.253298 10412 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:28:08.253494 10390 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260810 15:28:08.253651 10390 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/master-0/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/master-0/wal
uuid: "a99445ac89234308a23266d8febb1d03"
format_stamp: "Formatted at 2026-08-10 15:28:08 on dist-test-slave-2p8l"
server_key: "9c039938d2684d51a9007029b17a58ad"
server_key_iv: "c0c0e9431248c031453cf5d98942ca5c"
server_key_version: "encryptionkey@0"
I20260810 15:28:08.253736 10390 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:28:08.268458 10390 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:28:08.271010 10390 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:28:08.271194 10390 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:28:08.275691 10390 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.190:42059
I20260810 15:28:08.275730 10512 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.190:42059 every 8 connection(s)
I20260810 15:28:08.276120 10390 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
I20260810 15:28:08.277163 10517 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:28:08.278687 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 10390
I20260810 15:28:08.278796 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/master-0/wal/instance
I20260810 15:28:08.279021 18706 external_mini_cluster.cc:1428] Setting key b629b312f842677b832a5a039b507287
I20260810 15:28:08.280057 10517 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a99445ac89234308a23266d8febb1d03: Bootstrap starting.
I20260810 15:28:08.280797 10517 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a99445ac89234308a23266d8febb1d03: Neither blocks nor log segments found. Creating new log.
I20260810 15:28:08.281116 10517 log.cc:824] T 00000000000000000000000000000000 P a99445ac89234308a23266d8febb1d03: Log is configured to *not* fsync() on all Append() calls
I20260810 15:28:08.281884 10517 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a99445ac89234308a23266d8febb1d03: No bootstrap required, opened a new log
I20260810 15:28:08.284195 10517 raft_consensus.cc:348] T 00000000000000000000000000000000 P a99445ac89234308a23266d8febb1d03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a99445ac89234308a23266d8febb1d03" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 42059 } }
I20260810 15:28:08.284377 10517 raft_consensus.cc:374] T 00000000000000000000000000000000 P a99445ac89234308a23266d8febb1d03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:28:08.284418 10517 raft_consensus.cc:729] T 00000000000000000000000000000000 P a99445ac89234308a23266d8febb1d03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a99445ac89234308a23266d8febb1d03, State: Initialized, Role: FOLLOWER
I20260810 15:28:08.284601 10517 consensus_queue.cc:260] T 00000000000000000000000000000000 P a99445ac89234308a23266d8febb1d03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a99445ac89234308a23266d8febb1d03" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 42059 } }
I20260810 15:28:08.284713 10517 raft_consensus.cc:388] T 00000000000000000000000000000000 P a99445ac89234308a23266d8febb1d03 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 15:28:08.284754 10517 raft_consensus.cc:482] T 00000000000000000000000000000000 P a99445ac89234308a23266d8febb1d03 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 15:28:08.284808 10517 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a99445ac89234308a23266d8febb1d03 [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:28:08.285367 10517 raft_consensus.cc:504] T 00000000000000000000000000000000 P a99445ac89234308a23266d8febb1d03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a99445ac89234308a23266d8febb1d03" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 42059 } }
I20260810 15:28:08.285492 10517 leader_election.cc:302] T 00000000000000000000000000000000 P a99445ac89234308a23266d8febb1d03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a99445ac89234308a23266d8febb1d03; no voters:
I20260810 15:28:08.285681 10517 leader_election.cc:288] T 00000000000000000000000000000000 P a99445ac89234308a23266d8febb1d03 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 15:28:08.285728 10526 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a99445ac89234308a23266d8febb1d03 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 15:28:08.285877 10526 raft_consensus.cc:686] T 00000000000000000000000000000000 P a99445ac89234308a23266d8febb1d03 [term 1 LEADER]: Becoming Leader. State: Replica: a99445ac89234308a23266d8febb1d03, State: Running, Role: LEADER
I20260810 15:28:08.285957 10517 sys_catalog.cc:564] T 00000000000000000000000000000000 P a99445ac89234308a23266d8febb1d03 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 15:28:08.285982 10526 consensus_queue.cc:237] T 00000000000000000000000000000000 P a99445ac89234308a23266d8febb1d03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a99445ac89234308a23266d8febb1d03" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 42059 } }
I20260810 15:28:08.286379 10526 sys_catalog.cc:455] T 00000000000000000000000000000000 P a99445ac89234308a23266d8febb1d03 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a99445ac89234308a23266d8febb1d03. Latest consensus state: current_term: 1 leader_uuid: "a99445ac89234308a23266d8febb1d03" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a99445ac89234308a23266d8febb1d03" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 42059 } } }
I20260810 15:28:08.286479 10526 sys_catalog.cc:458] T 00000000000000000000000000000000 P a99445ac89234308a23266d8febb1d03 [sys.catalog]: This master's current role is: LEADER
I20260810 15:28:08.286387 10529 sys_catalog.cc:455] T 00000000000000000000000000000000 P a99445ac89234308a23266d8febb1d03 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a99445ac89234308a23266d8febb1d03" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a99445ac89234308a23266d8febb1d03" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 42059 } } }
I20260810 15:28:08.286654 10529 sys_catalog.cc:458] T 00000000000000000000000000000000 P a99445ac89234308a23266d8febb1d03 [sys.catalog]: This master's current role is: LEADER
Aug 10 15:28:08 dist-test-slave-2p8l krb5kdc[10371](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375688, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
I20260810 15:28:08.287559 10541 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 15:28:08.288278 10541 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 15:28:08.290010 10541 catalog_manager.cc:1347] Generated new cluster ID: 8653322e7ebc4a1dba61902fd0d83b8f
I20260810 15:28:08.290093 10541 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 15:28:08.291311 10523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:08.279600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35010 (local address 127.18.68.190:42059)
0810 15:28:08.279817 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0810 15:28:08.279826 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 15:28:08.279860 (+ 34us) server_negotiation.cc:407] Connection header received
0810 15:28:08.280439 (+ 579us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:28:08.280451 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:28:08.280524 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:28:08.280678 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:28:08.281350 (+ 672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:08.282723 (+ 1373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:08.283509 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:08.284242 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:08.284369 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:08.287401 (+ 3032us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:28:08.287406 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:28:08.287406 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:28:08.287419 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:28:08.289390 (+ 1971us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:28:08.289819 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:28:08.289822 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:28:08.289822 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:28:08.289931 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:28:08.290200 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:28:08.290201 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:28:08.290202 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:28:08.290513 (+ 311us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:28:08.290638 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0810 15:28:08.290917 (+ 279us) server_negotiation.cc:299] Negotiation successful
0810 15:28:08.291066 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":164,"thread_start_us":102,"threads_started":1}
I20260810 15:28:08.306088 10541 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 15:28:08.306669 10541 catalog_manager.cc:1504] Loading token signing keys...
I20260810 15:28:08.313906 10541 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a99445ac89234308a23266d8febb1d03: Generated new TSK 0
I20260810 15:28:08.314152 10541 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.18.68.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.68.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.68.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.129.keytab.
Entry for principal kudu/127.18.68.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.129.keytab.
I20260810 15:28:08.345516 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.68.129:0
--local_ip_for_outbound_sockets=127.18.68.129
--webserver_interface=127.18.68.129
--webserver_port=0
--tserver_master_addrs=127.18.68.190:42059
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.129.keytab
--principal=kudu/127.18.68.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:44607
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:28:08.430140 10565 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:28:08.430400 10565 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:28:08.430449 10565 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:28:08.431634 10565 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:28:08.431676 10565 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:28:08.431703 10565 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.68.129
I20260810 15:28:08.433149 10565 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:44607
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.129.keytab
--principal=kudu/127.18.68.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.68.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.68.129
--webserver_port=0
--tserver_master_addrs=127.18.68.190:42059
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10565
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.68.129
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:28:08.433400 10565 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:28:08.433647 10565 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:28:08.438633 10579 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:28:08.438649 10574 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:28:08.438714 10575 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:28:08.438910 10565 server_base.cc:1034] running on GCE node
I20260810 15:28:08.439142 10565 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:28:08.439385 10565 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:28:08.440546 10565 hybrid_clock.cc:648] HybridClock initialized: now 1786375688440523 us; error 55 us; skew 500 ppm
Aug 10 15:28:08 dist-test-slave-2p8l krb5kdc[10371](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375688, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:28:08.443204 10565 init.cc:377] Logged in from keytab as kudu/127.18.68.129@KRBTEST.COM (short username kudu)
I20260810 15:28:08.443652 10565 webserver.cc:460] Webserver started at http://127.18.68.129:33967/ using document root <none> and password file <none>
I20260810 15:28:08.443879 10565 fs_manager.cc:359] Metadata directory not provided
I20260810 15:28:08.443948 10565 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:28:08.444103 10565 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:28:08.445293 10565 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-0/data/instance:
uuid: "e07aad1b650745529d478e4bbc1a1753"
format_stamp: "Formatted at 2026-08-10 15:28:08 on dist-test-slave-2p8l"
server_key: "a9752259256d82fc264814509ff54439"
server_key_iv: "664ec311721337bf9a6307a782191604"
server_key_version: "encryptionkey@0"
I20260810 15:28:08.445696 10565 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-0/wal/instance:
uuid: "e07aad1b650745529d478e4bbc1a1753"
format_stamp: "Formatted at 2026-08-10 15:28:08 on dist-test-slave-2p8l"
server_key: "a9752259256d82fc264814509ff54439"
server_key_iv: "664ec311721337bf9a6307a782191604"
server_key_version: "encryptionkey@0"
I20260810 15:28:08.447134 10565 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 15:28:08.447952 10587 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:28:08.448150 10565 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260810 15:28:08.448261 10565 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-0/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-0/wal
uuid: "e07aad1b650745529d478e4bbc1a1753"
format_stamp: "Formatted at 2026-08-10 15:28:08 on dist-test-slave-2p8l"
server_key: "a9752259256d82fc264814509ff54439"
server_key_iv: "664ec311721337bf9a6307a782191604"
server_key_version: "encryptionkey@0"
I20260810 15:28:08.448336 10565 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:28:08.469560 10565 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:28:08.472112 10565 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:28:08.472296 10565 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:28:08.472559 10565 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 15:28:08.472899 10565 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 15:28:08.472962 10565 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 15:28:08.473003 10565 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 15:28:08.473034 10565 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 15:28:08.479148 10565 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.129:46757
I20260810 15:28:08.479228 10782 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.129:46757 every 8 connection(s)
I20260810 15:28:08.479574 10565 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-0/data/info.pb
I20260810 15:28:08.481189 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 10565
I20260810 15:28:08.481317 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-0/wal/instance
I20260810 15:28:08.481529 18706 external_mini_cluster.cc:1428] Setting key 835f08730f47a8d60c623e7ab5df6e13
Aug 10 15:28:08 dist-test-slave-2p8l krb5kdc[10371](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375688, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.129@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
I20260810 15:28:08.490170 10523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:08.480402 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.129:35395 (local address 127.18.68.190:42059)
0810 15:28:08.480448 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0810 15:28:08.480450 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:28:08.480699 (+ 249us) server_negotiation.cc:407] Connection header received
0810 15:28:08.481211 (+ 512us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:28:08.481212 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:28:08.481225 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:28:08.481278 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:28:08.482600 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:08.483108 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:08.484135 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:08.484358 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:08.484435 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:08.486825 (+ 2390us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:28:08.486826 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:28:08.486827 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:28:08.486836 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:28:08.488684 (+ 1848us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:28:08.489091 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:28:08.489092 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:28:08.489093 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:28:08.489160 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:28:08.489409 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:28:08.489410 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:28:08.489411 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:28:08.489568 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:28:08.489650 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0810 15:28:08.489937 (+ 287us) server_negotiation.cc:299] Negotiation successful
0810 15:28:08.490033 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260810 15:28:08.490331 10786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:08.480364 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42059 (local address 127.18.68.129:35395)
0810 15:28:08.480536 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:08.480574 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0810 15:28:08.481078 (+ 504us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:28:08.481372 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:28:08.481376 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:28:08.482231 (+ 855us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:28:08.482501 (+ 270us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:28:08.482507 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:28:08.483217 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:28:08.483218 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:28:08.484023 (+ 805us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:28:08.484025 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:28:08.484443 (+ 418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:28:08.484444 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:28:08.484589 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:08.485151 (+ 562us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:28:08.485159 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:28:08.486734 (+ 1575us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:28:08.488774 (+ 2040us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:28:08.488781 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:28:08.488783 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:28:08.489004 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:28:08.489238 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:28:08.489239 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:28:08.489239 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:28:08.489339 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:28:08.489668 (+ 329us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:28:08.489675 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:28:08.489796 (+ 121us) client_negotiation.cc:769] Sending connection context
0810 15:28:08.489889 (+ 93us) client_negotiation.cc:240] Negotiation successful
0810 15:28:08.490011 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":104,"threads_started":1}
I20260810 15:28:08.490960 10784 heartbeater.cc:347] Connected to a master server at 127.18.68.190:42059
I20260810 15:28:08.491055 10784 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.18.68.130@KRBTEST.COM; defaulting to no policy
I20260810 15:28:08.491257 10784 heartbeater.cc:511] Master 127.18.68.190:42059 requested a full tablet report, sending...
I20260810 15:28:08.491833 10444 ts_manager.cc:194] Registered new tserver with Master: e07aad1b650745529d478e4bbc1a1753 (127.18.68.129:46757)
I20260810 15:28:08.492633 10444 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.68.129@KRBTEST.COM'} at 127.18.68.129:35395
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.68.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.68.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.130.keytab.
Entry for principal kudu/127.18.68.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.130.keytab.
I20260810 15:28:08.507197 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.68.130:0
--local_ip_for_outbound_sockets=127.18.68.130
--webserver_interface=127.18.68.130
--webserver_port=0
--tserver_master_addrs=127.18.68.190:42059
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.130.keytab
--principal=kudu/127.18.68.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:44607
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:28:08.592752 10789 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:28:08.592962 10789 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:28:08.592985 10789 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:28:08.594172 10789 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:28:08.594216 10789 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:28:08.594244 10789 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.68.130
I20260810 15:28:08.595671 10789 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:44607
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.130.keytab
--principal=kudu/127.18.68.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.68.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.68.130
--webserver_port=0
--tserver_master_addrs=127.18.68.190:42059
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10789
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.68.130
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:28:08.595858 10789 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:28:08.596036 10789 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:28:08.601248 10795 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:28:08.601235 10803 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:28:08.601235 10796 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:28:08.601608 10789 server_base.cc:1034] running on GCE node
I20260810 15:28:08.601845 10789 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:28:08.602224 10789 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:28:08.603430 10789 hybrid_clock.cc:648] HybridClock initialized: now 1786375688603448 us; error 108 us; skew 500 ppm
Aug 10 15:28:08 dist-test-slave-2p8l krb5kdc[10371](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375688, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:28:08.606576 10789 init.cc:377] Logged in from keytab as kudu/127.18.68.130@KRBTEST.COM (short username kudu)
I20260810 15:28:08.607080 10789 webserver.cc:460] Webserver started at http://127.18.68.130:36719/ using document root <none> and password file <none>
I20260810 15:28:08.607340 10789 fs_manager.cc:359] Metadata directory not provided
I20260810 15:28:08.607411 10789 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:28:08.607591 10789 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:28:08.608719 10789 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-1/data/instance:
uuid: "366244d5f3b44caea819a927fa53d79a"
format_stamp: "Formatted at 2026-08-10 15:28:08 on dist-test-slave-2p8l"
server_key: "171aec0cab8dedb1d87504913422f58e"
server_key_iv: "c4ca0d047445d756db2b280eae43f9b0"
server_key_version: "encryptionkey@0"
I20260810 15:28:08.609117 10789 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-1/wal/instance:
uuid: "366244d5f3b44caea819a927fa53d79a"
format_stamp: "Formatted at 2026-08-10 15:28:08 on dist-test-slave-2p8l"
server_key: "171aec0cab8dedb1d87504913422f58e"
server_key_iv: "c4ca0d047445d756db2b280eae43f9b0"
server_key_version: "encryptionkey@0"
I20260810 15:28:08.610599 10789 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 15:28:08.611343 10813 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:28:08.611508 10789 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 15:28:08.611625 10789 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-1/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-1/wal
uuid: "366244d5f3b44caea819a927fa53d79a"
format_stamp: "Formatted at 2026-08-10 15:28:08 on dist-test-slave-2p8l"
server_key: "171aec0cab8dedb1d87504913422f58e"
server_key_iv: "c4ca0d047445d756db2b280eae43f9b0"
server_key_version: "encryptionkey@0"
I20260810 15:28:08.611703 10789 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:28:08.623270 10789 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:28:08.625335 10789 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:28:08.625505 10789 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:28:08.625756 10789 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 15:28:08.626173 10789 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 15:28:08.626231 10789 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 15:28:08.626273 10789 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 15:28:08.626302 10789 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 15:28:08.632297 10789 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.130:39041
I20260810 15:28:08.632385 11010 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.130:39041 every 8 connection(s)
I20260810 15:28:08.632723 10789 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-1/data/info.pb
I20260810 15:28:08.633082 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 10789
I20260810 15:28:08.633203 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-1/wal/instance
I20260810 15:28:08.633430 18706 external_mini_cluster.cc:1428] Setting key 3d30c62681a7c79bf25f2ebb1e08dfa4
Aug 10 15:28:08 dist-test-slave-2p8l krb5kdc[10371](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375688, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.130@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.18.68.131@KRBTEST.COM; defaulting to no policy
I20260810 15:28:08.643842 10523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:08.633509 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.130:57367 (local address 127.18.68.190:42059)
0810 15:28:08.633593 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0810 15:28:08.633596 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 15:28:08.633828 (+ 232us) server_negotiation.cc:407] Connection header received
0810 15:28:08.634524 (+ 696us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:28:08.634525 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:28:08.634535 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:28:08.634573 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:28:08.635864 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:08.636356 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:08.637820 (+ 1464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:08.638172 (+ 352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:08.638248 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:08.640857 (+ 2609us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:28:08.640858 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:28:08.640858 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:28:08.640865 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:28:08.642297 (+ 1432us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:28:08.642793 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:28:08.642794 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:28:08.642794 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:28:08.642843 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:28:08.643140 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:28:08.643141 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:28:08.643141 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:28:08.643264 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:28:08.643319 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0810 15:28:08.643652 (+ 333us) server_negotiation.cc:299] Negotiation successful
0810 15:28:08.643716 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260810 15:28:08.644090 11013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:08.633513 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42059 (local address 127.18.68.130:57367)
0810 15:28:08.633692 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:08.633729 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0810 15:28:08.634416 (+ 687us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:28:08.634640 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:28:08.634644 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:28:08.635487 (+ 843us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:28:08.635763 (+ 276us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:28:08.635770 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:28:08.636452 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:28:08.636453 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:28:08.637726 (+ 1273us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:28:08.637729 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:28:08.638259 (+ 530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:28:08.638259 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:28:08.638360 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:08.638898 (+ 538us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:28:08.638906 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:28:08.640762 (+ 1856us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:28:08.642380 (+ 1618us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:28:08.642387 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:28:08.642389 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:28:08.642714 (+ 325us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:28:08.642915 (+ 201us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:28:08.642917 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:28:08.642917 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:28:08.643060 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:28:08.643337 (+ 277us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:28:08.643344 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:28:08.643509 (+ 165us) client_negotiation.cc:769] Sending connection context
0810 15:28:08.643637 (+ 128us) client_negotiation.cc:240] Negotiation successful
0810 15:28:08.643823 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":85,"threads_started":1}
I20260810 15:28:08.644641 11011 heartbeater.cc:347] Connected to a master server at 127.18.68.190:42059
I20260810 15:28:08.644786 11011 heartbeater.cc:464] Registering TS with master...
I20260810 15:28:08.644969 11011 heartbeater.cc:511] Master 127.18.68.190:42059 requested a full tablet report, sending...
I20260810 15:28:08.645457 10444 ts_manager.cc:194] Registered new tserver with Master: 366244d5f3b44caea819a927fa53d79a (127.18.68.130:39041)
I20260810 15:28:08.645902 10444 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.68.130@KRBTEST.COM'} at 127.18.68.130:57367
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.68.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.68.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.131.keytab.
Entry for principal kudu/127.18.68.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.131.keytab.
I20260810 15:28:08.664618 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.68.131:0
--local_ip_for_outbound_sockets=127.18.68.131
--webserver_interface=127.18.68.131
--webserver_port=0
--tserver_master_addrs=127.18.68.190:42059
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.131.keytab
--principal=kudu/127.18.68.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:44607
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:28:08.748732 11016 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:28:08.748991 11016 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:28:08.749032 11016 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:28:08.750259 11016 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:28:08.750341 11016 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:28:08.750386 11016 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.68.131
I20260810 15:28:08.752095 11016 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:44607
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.131.keytab
--principal=kudu/127.18.68.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.68.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.68.131
--webserver_port=0
--tserver_master_addrs=127.18.68.190:42059
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11016
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.68.131
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:28:08.752377 11016 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:28:08.752640 11016 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:28:08.757947 11025 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:28:08.757992 11032 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:28:08.757941 11027 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:28:08.758417 11016 server_base.cc:1034] running on GCE node
I20260810 15:28:08.758594 11016 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:28:08.758842 11016 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:28:08.759996 11016 hybrid_clock.cc:648] HybridClock initialized: now 1786375688759979 us; error 32 us; skew 500 ppm
Aug 10 15:28:08 dist-test-slave-2p8l krb5kdc[10371](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375688, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:28:08.762723 11016 init.cc:377] Logged in from keytab as kudu/127.18.68.131@KRBTEST.COM (short username kudu)
I20260810 15:28:08.763221 11016 webserver.cc:460] Webserver started at http://127.18.68.131:36565/ using document root <none> and password file <none>
I20260810 15:28:08.763418 11016 fs_manager.cc:359] Metadata directory not provided
I20260810 15:28:08.763459 11016 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:28:08.763553 11016 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:28:08.764592 11016 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-2/data/instance:
uuid: "8d8cfd4508f741259f67187fe2718218"
format_stamp: "Formatted at 2026-08-10 15:28:08 on dist-test-slave-2p8l"
server_key: "f612ebb61de5810f7397a5b84a448a32"
server_key_iv: "bab7fae206c539665c2fd3531c066e9b"
server_key_version: "encryptionkey@0"
I20260810 15:28:08.764915 11016 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-2/wal/instance:
uuid: "8d8cfd4508f741259f67187fe2718218"
format_stamp: "Formatted at 2026-08-10 15:28:08 on dist-test-slave-2p8l"
server_key: "f612ebb61de5810f7397a5b84a448a32"
server_key_iv: "bab7fae206c539665c2fd3531c066e9b"
server_key_version: "encryptionkey@0"
I20260810 15:28:08.766323 11016 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260810 15:28:08.767253 11043 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:28:08.767452 11016 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:28:08.767570 11016 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-2/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-2/wal
uuid: "8d8cfd4508f741259f67187fe2718218"
format_stamp: "Formatted at 2026-08-10 15:28:08 on dist-test-slave-2p8l"
server_key: "f612ebb61de5810f7397a5b84a448a32"
server_key_iv: "bab7fae206c539665c2fd3531c066e9b"
server_key_version: "encryptionkey@0"
I20260810 15:28:08.767673 11016 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:28:08.787662 11016 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:28:08.790299 11016 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:28:08.790479 11016 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:28:08.790786 11016 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 15:28:08.791128 11016 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 15:28:08.791185 11016 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 15:28:08.791232 11016 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 15:28:08.791260 11016 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 15:28:08.797840 11016 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.131:35203
I20260810 15:28:08.797870 11220 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.131:35203 every 8 connection(s)
I20260810 15:28:08.798347 11016 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-2/data/info.pb
I20260810 15:28:08.800942 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 11016
I20260810 15:28:08.801167 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-2/wal/instance
I20260810 15:28:08.801344 18706 external_mini_cluster.cc:1428] Setting key dc38c19c37cfab2559bd8f92606ea018
Aug 10 15:28:08 dist-test-slave-2p8l krb5kdc[10371](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375688, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.131@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
I20260810 15:28:08.808239 10523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:08.799188 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.131:55109 (local address 127.18.68.190:42059)
0810 15:28:08.799277 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0810 15:28:08.799279 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:28:08.799471 (+ 192us) server_negotiation.cc:407] Connection header received
0810 15:28:08.800008 (+ 537us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:28:08.800010 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:28:08.800021 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:28:08.800099 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:28:08.801083 (+ 984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:08.801760 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:08.802858 (+ 1098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:08.803073 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:08.803162 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:08.805362 (+ 2200us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:28:08.805363 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:28:08.805363 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:28:08.805372 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:28:08.806817 (+ 1445us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:28:08.807244 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:28:08.807246 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:28:08.807246 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:28:08.807311 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:28:08.807566 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:28:08.807568 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:28:08.807568 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:28:08.807690 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:28:08.807778 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0810 15:28:08.808062 (+ 284us) server_negotiation.cc:299] Negotiation successful
0810 15:28:08.808144 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260810 15:28:08.808463 11223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:08.799147 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42059 (local address 127.18.68.131:55109)
0810 15:28:08.799334 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:08.799378 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0810 15:28:08.799889 (+ 511us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:28:08.800178 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:28:08.800181 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:28:08.800780 (+ 599us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:28:08.800977 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:28:08.800981 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:28:08.801865 (+ 884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:28:08.801866 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:28:08.802764 (+ 898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:28:08.802767 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:28:08.803175 (+ 408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:28:08.803176 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:28:08.803317 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:08.803804 (+ 487us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:28:08.803813 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:28:08.805260 (+ 1447us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:28:08.806910 (+ 1650us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:28:08.806918 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:28:08.806921 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:28:08.807152 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:28:08.807379 (+ 227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:28:08.807380 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:28:08.807380 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:28:08.807494 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:28:08.807766 (+ 272us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:28:08.807774 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:28:08.807920 (+ 146us) client_negotiation.cc:769] Sending connection context
0810 15:28:08.808027 (+ 107us) client_negotiation.cc:240] Negotiation successful
0810 15:28:08.808195 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":107,"threads_started":1}
I20260810 15:28:08.808969 11221 heartbeater.cc:347] Connected to a master server at 127.18.68.190:42059
I20260810 15:28:08.809188 11221 heartbeater.cc:464] Registering TS with master...
I20260810 15:28:08.809388 11221 heartbeater.cc:511] Master 127.18.68.190:42059 requested a full tablet report, sending...
I20260810 15:28:08.809821 10444 ts_manager.cc:194] Registered new tserver with Master: 8d8cfd4508f741259f67187fe2718218 (127.18.68.131:35203)
I20260810 15:28:08.810277 10444 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.68.131@KRBTEST.COM'} at 127.18.68.131:55109
I20260810 15:28:08.813194 18706 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 15:28:08.821323 10523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:08.814750 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35026 (local address 127.18.68.190:42059)
0810 15:28:08.814795 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0810 15:28:08.814798 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 15:28:08.814974 (+ 176us) server_negotiation.cc:407] Connection header received
0810 15:28:08.815011 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:28:08.815012 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:28:08.815021 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:28:08.815068 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:28:08.815644 (+ 576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:08.816164 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:08.816893 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:08.817074 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:08.817150 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:08.818552 (+ 1402us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:28:08.818553 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:28:08.818553 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:28:08.818560 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:28:08.820021 (+ 1461us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:28:08.820429 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:28:08.820430 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:28:08.820430 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:28:08.820486 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:28:08.820656 (+ 170us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:28:08.820656 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:28:08.820656 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:28:08.820804 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:28:08.820911 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0810 15:28:08.821115 (+ 204us) server_negotiation.cc:299] Negotiation successful
0810 15:28:08.821187 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260810 15:28:08.823220 10444 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35026:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 15:28:08.824895 10444 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 15:28:08.831957 11247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:08.827788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37846 (local address 127.18.68.129:46757)
0810 15:28:08.828325 (+ 537us) server_negotiation.cc:206] Beginning negotiation
0810 15:28:08.828329 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 15:28:08.828338 (+ 9us) server_negotiation.cc:407] Connection header received
0810 15:28:08.828376 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:28:08.828377 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:28:08.828391 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:28:08.828462 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:28:08.828637 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:08.829341 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:08.830776 (+ 1435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:08.831499 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:08.831603 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:08.831666 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0810 15:28:08.831812 (+ 146us) server_negotiation.cc:299] Negotiation successful
0810 15:28:08.831859 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":498,"thread_start_us":99,"threads_started":1}
I20260810 15:28:08.831966 11238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:08.827577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.131:35203 (local address 127.0.0.1:49660)
0810 15:28:08.827878 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:08.827890 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 15:28:08.827945 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:28:08.828345 (+ 400us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:28:08.828348 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:28:08.828350 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:28:08.828444 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:28:08.828445 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:28:08.829870 (+ 1425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:28:08.829871 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:28:08.830908 (+ 1037us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:28:08.830910 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:28:08.831680 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:28:08.831681 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:28:08.831747 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:08.831752 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 15:28:08.831781 (+ 29us) client_negotiation.cc:240] Negotiation successful
0810 15:28:08.831861 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":286,"thread_start_us":152,"threads_started":1}
I20260810 15:28:08.831974 11243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:08.827566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.129:46757 (local address 127.0.0.1:37846)
0810 15:28:08.827787 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:08.827861 (+ 74us) client_negotiation.cc:174] Beginning negotiation
0810 15:28:08.827938 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:28:08.828540 (+ 602us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:28:08.828541 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:28:08.828543 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:28:08.828578 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:28:08.828579 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:28:08.829443 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:28:08.829444 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:28:08.830679 (+ 1235us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:28:08.830681 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:28:08.831606 (+ 925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:28:08.831607 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:28:08.831689 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:08.831703 (+ 14us) client_negotiation.cc:769] Sending connection context
0810 15:28:08.831797 (+ 94us) client_negotiation.cc:240] Negotiation successful
0810 15:28:08.831865 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":181,"mutex_wait_us":21,"thread_start_us":70,"threads_started":1}
I20260810 15:28:08.832439 11248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:08.827909 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49660 (local address 127.18.68.131:35203)
0810 15:28:08.828146 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0810 15:28:08.828152 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 15:28:08.828163 (+ 11us) server_negotiation.cc:407] Connection header received
0810 15:28:08.828206 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:28:08.828207 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:28:08.828225 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:28:08.828528 (+ 303us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:28:08.828673 (+ 145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:08.829764 (+ 1091us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:08.830991 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:08.831581 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:08.832219 (+ 638us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:08.832288 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0810 15:28:08.832314 (+ 26us) server_negotiation.cc:299] Negotiation successful
0810 15:28:08.832356 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":205,"thread_start_us":120,"threads_started":1}
I20260810 15:28:08.832772 10671 tablet_service.cc:1467] Processing CreateTablet for tablet 8024a847c1524e898759f22ec88a3bad (DEFAULT_TABLE table=test-table [id=919bc648606949259a663dc2b1fc29e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 15:28:08.833182 10671 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8024a847c1524e898759f22ec88a3bad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:28:08.833067 11123 tablet_service.cc:1467] Processing CreateTablet for tablet 8024a847c1524e898759f22ec88a3bad (DEFAULT_TABLE table=test-table [id=919bc648606949259a663dc2b1fc29e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 15:28:08.833317 11249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:08.828026 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42360 (local address 127.18.68.130:39041)
0810 15:28:08.828209 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0810 15:28:08.828214 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 15:28:08.828225 (+ 11us) server_negotiation.cc:407] Connection header received
0810 15:28:08.828280 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:28:08.828282 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:28:08.828298 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:28:08.828384 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:28:08.828622 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:08.829753 (+ 1131us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:08.831367 (+ 1614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:08.832678 (+ 1311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:08.832748 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:08.832802 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0810 15:28:08.833178 (+ 376us) server_negotiation.cc:299] Negotiation successful
0810 15:28:08.833233 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":114,"threads_started":1}
I20260810 15:28:08.833441 11123 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8024a847c1524e898759f22ec88a3bad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:28:08.833336 11240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:08.827580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.130:39041 (local address 127.0.0.1:42360)
0810 15:28:08.828065 (+ 485us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:08.828074 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 15:28:08.828128 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:28:08.828470 (+ 342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:28:08.828472 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:28:08.828474 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:28:08.828529 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:28:08.828531 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:28:08.830168 (+ 1637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:28:08.830170 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:28:08.831269 (+ 1099us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:28:08.831272 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:28:08.832836 (+ 1564us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:28:08.832837 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:28:08.832897 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:08.832901 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 15:28:08.833137 (+ 236us) client_negotiation.cc:240] Negotiation successful
0810 15:28:08.833181 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":467,"thread_start_us":141,"threads_started":1}
I20260810 15:28:08.834201 10891 tablet_service.cc:1467] Processing CreateTablet for tablet 8024a847c1524e898759f22ec88a3bad (DEFAULT_TABLE table=test-table [id=919bc648606949259a663dc2b1fc29e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 15:28:08.834524 10891 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8024a847c1524e898759f22ec88a3bad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:28:08.836196 11254 tablet_bootstrap.cc:492] T 8024a847c1524e898759f22ec88a3bad P 8d8cfd4508f741259f67187fe2718218: Bootstrap starting.
I20260810 15:28:08.836766 11255 tablet_bootstrap.cc:492] T 8024a847c1524e898759f22ec88a3bad P e07aad1b650745529d478e4bbc1a1753: Bootstrap starting.
I20260810 15:28:08.836921 11254 tablet_bootstrap.cc:654] T 8024a847c1524e898759f22ec88a3bad P 8d8cfd4508f741259f67187fe2718218: Neither blocks nor log segments found. Creating new log.
I20260810 15:28:08.837527 11255 tablet_bootstrap.cc:654] T 8024a847c1524e898759f22ec88a3bad P e07aad1b650745529d478e4bbc1a1753: Neither blocks nor log segments found. Creating new log.
I20260810 15:28:08.837510 11254 log.cc:824] T 8024a847c1524e898759f22ec88a3bad P 8d8cfd4508f741259f67187fe2718218: Log is configured to *not* fsync() on all Append() calls
I20260810 15:28:08.837651 11258 tablet_bootstrap.cc:492] T 8024a847c1524e898759f22ec88a3bad P 366244d5f3b44caea819a927fa53d79a: Bootstrap starting.
I20260810 15:28:08.838145 11255 log.cc:824] T 8024a847c1524e898759f22ec88a3bad P e07aad1b650745529d478e4bbc1a1753: Log is configured to *not* fsync() on all Append() calls
I20260810 15:28:08.838351 11258 tablet_bootstrap.cc:654] T 8024a847c1524e898759f22ec88a3bad P 366244d5f3b44caea819a927fa53d79a: Neither blocks nor log segments found. Creating new log.
I20260810 15:28:08.838564 11254 tablet_bootstrap.cc:492] T 8024a847c1524e898759f22ec88a3bad P 8d8cfd4508f741259f67187fe2718218: No bootstrap required, opened a new log
I20260810 15:28:08.838667 11254 ts_tablet_manager.cc:1397] T 8024a847c1524e898759f22ec88a3bad P 8d8cfd4508f741259f67187fe2718218: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260810 15:28:08.838920 11258 log.cc:824] T 8024a847c1524e898759f22ec88a3bad P 366244d5f3b44caea819a927fa53d79a: Log is configured to *not* fsync() on all Append() calls
I20260810 15:28:08.839095 11255 tablet_bootstrap.cc:492] T 8024a847c1524e898759f22ec88a3bad P e07aad1b650745529d478e4bbc1a1753: No bootstrap required, opened a new log
I20260810 15:28:08.839232 11255 ts_tablet_manager.cc:1397] T 8024a847c1524e898759f22ec88a3bad P e07aad1b650745529d478e4bbc1a1753: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260810 15:28:08.839593 11258 tablet_bootstrap.cc:492] T 8024a847c1524e898759f22ec88a3bad P 366244d5f3b44caea819a927fa53d79a: No bootstrap required, opened a new log
I20260810 15:28:08.839677 11258 ts_tablet_manager.cc:1397] T 8024a847c1524e898759f22ec88a3bad P 366244d5f3b44caea819a927fa53d79a: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 15:28:08.840759 11254 raft_consensus.cc:348] T 8024a847c1524e898759f22ec88a3bad P 8d8cfd4508f741259f67187fe2718218 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e07aad1b650745529d478e4bbc1a1753" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 46757 } } peers { permanent_uuid: "366244d5f3b44caea819a927fa53d79a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 39041 } } peers { permanent_uuid: "8d8cfd4508f741259f67187fe2718218" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 35203 } }
I20260810 15:28:08.840935 11254 raft_consensus.cc:374] T 8024a847c1524e898759f22ec88a3bad P 8d8cfd4508f741259f67187fe2718218 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:28:08.840976 11254 raft_consensus.cc:729] T 8024a847c1524e898759f22ec88a3bad P 8d8cfd4508f741259f67187fe2718218 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d8cfd4508f741259f67187fe2718218, State: Initialized, Role: FOLLOWER
I20260810 15:28:08.841094 11254 consensus_queue.cc:260] T 8024a847c1524e898759f22ec88a3bad P 8d8cfd4508f741259f67187fe2718218 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e07aad1b650745529d478e4bbc1a1753" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 46757 } } peers { permanent_uuid: "366244d5f3b44caea819a927fa53d79a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 39041 } } peers { permanent_uuid: "8d8cfd4508f741259f67187fe2718218" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 35203 } }
I20260810 15:28:08.841234 11258 raft_consensus.cc:348] T 8024a847c1524e898759f22ec88a3bad P 366244d5f3b44caea819a927fa53d79a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e07aad1b650745529d478e4bbc1a1753" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 46757 } } peers { permanent_uuid: "366244d5f3b44caea819a927fa53d79a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 39041 } } peers { permanent_uuid: "8d8cfd4508f741259f67187fe2718218" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 35203 } }
I20260810 15:28:08.841378 11254 ts_tablet_manager.cc:1428] T 8024a847c1524e898759f22ec88a3bad P 8d8cfd4508f741259f67187fe2718218: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 15:28:08.841389 11258 raft_consensus.cc:374] T 8024a847c1524e898759f22ec88a3bad P 366244d5f3b44caea819a927fa53d79a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:28:08.841275 11255 raft_consensus.cc:348] T 8024a847c1524e898759f22ec88a3bad P e07aad1b650745529d478e4bbc1a1753 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e07aad1b650745529d478e4bbc1a1753" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 46757 } } peers { permanent_uuid: "366244d5f3b44caea819a927fa53d79a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 39041 } } peers { permanent_uuid: "8d8cfd4508f741259f67187fe2718218" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 35203 } }
I20260810 15:28:08.841431 11258 raft_consensus.cc:729] T 8024a847c1524e898759f22ec88a3bad P 366244d5f3b44caea819a927fa53d79a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 366244d5f3b44caea819a927fa53d79a, State: Initialized, Role: FOLLOWER
I20260810 15:28:08.841437 11255 raft_consensus.cc:374] T 8024a847c1524e898759f22ec88a3bad P e07aad1b650745529d478e4bbc1a1753 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:28:08.841476 11255 raft_consensus.cc:729] T 8024a847c1524e898759f22ec88a3bad P e07aad1b650745529d478e4bbc1a1753 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e07aad1b650745529d478e4bbc1a1753, State: Initialized, Role: FOLLOWER
I20260810 15:28:08.841519 11221 heartbeater.cc:503] Master 127.18.68.190:42059 was elected leader, sending a full tablet report...
I20260810 15:28:08.841579 11258 consensus_queue.cc:260] T 8024a847c1524e898759f22ec88a3bad P 366244d5f3b44caea819a927fa53d79a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e07aad1b650745529d478e4bbc1a1753" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 46757 } } peers { permanent_uuid: "366244d5f3b44caea819a927fa53d79a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 39041 } } peers { permanent_uuid: "8d8cfd4508f741259f67187fe2718218" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 35203 } }
I20260810 15:28:08.841605 11255 consensus_queue.cc:260] T 8024a847c1524e898759f22ec88a3bad P e07aad1b650745529d478e4bbc1a1753 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e07aad1b650745529d478e4bbc1a1753" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 46757 } } peers { permanent_uuid: "366244d5f3b44caea819a927fa53d79a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 39041 } } peers { permanent_uuid: "8d8cfd4508f741259f67187fe2718218" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 35203 } }
I20260810 15:28:08.841897 11255 ts_tablet_manager.cc:1428] T 8024a847c1524e898759f22ec88a3bad P e07aad1b650745529d478e4bbc1a1753: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 15:28:08.841922 11258 ts_tablet_manager.cc:1428] T 8024a847c1524e898759f22ec88a3bad P 366244d5f3b44caea819a927fa53d79a: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 15:28:08.841933 10784 heartbeater.cc:503] Master 127.18.68.190:42059 was elected leader, sending a full tablet report...
I20260810 15:28:08.842051 11011 heartbeater.cc:503] Master 127.18.68.190:42059 was elected leader, sending a full tablet report...
W20260810 15:28:08.883584 11012 tablet.cc:2369] T 8024a847c1524e898759f22ec88a3bad P 366244d5f3b44caea819a927fa53d79a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 15:28:08.948206 11268 raft_consensus.cc:482] T 8024a847c1524e898759f22ec88a3bad P e07aad1b650745529d478e4bbc1a1753 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 15:28:08.948334 11268 raft_consensus.cc:504] T 8024a847c1524e898759f22ec88a3bad P e07aad1b650745529d478e4bbc1a1753 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e07aad1b650745529d478e4bbc1a1753" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 46757 } } peers { permanent_uuid: "366244d5f3b44caea819a927fa53d79a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 39041 } } peers { permanent_uuid: "8d8cfd4508f741259f67187fe2718218" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 35203 } }
I20260810 15:28:08.948805 11268 leader_election.cc:288] T 8024a847c1524e898759f22ec88a3bad P e07aad1b650745529d478e4bbc1a1753 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 366244d5f3b44caea819a927fa53d79a (127.18.68.130:39041), 8d8cfd4508f741259f67187fe2718218 (127.18.68.131:35203)
I20260810 15:28:08.951085 11270 raft_consensus.cc:482] T 8024a847c1524e898759f22ec88a3bad P 366244d5f3b44caea819a927fa53d79a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 15:28:08.951287 11270 raft_consensus.cc:504] T 8024a847c1524e898759f22ec88a3bad P 366244d5f3b44caea819a927fa53d79a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e07aad1b650745529d478e4bbc1a1753" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 46757 } } peers { permanent_uuid: "366244d5f3b44caea819a927fa53d79a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 39041 } } peers { permanent_uuid: "8d8cfd4508f741259f67187fe2718218" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 35203 } }
I20260810 15:28:08.951676 11270 leader_election.cc:288] T 8024a847c1524e898759f22ec88a3bad P 366244d5f3b44caea819a927fa53d79a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e07aad1b650745529d478e4bbc1a1753 (127.18.68.129:46757), 8d8cfd4508f741259f67187fe2718218 (127.18.68.131:35203)
I20260810 15:28:08.952123 10786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:08.948970 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.130:39041 (local address 127.18.68.129:35827)
0810 15:28:08.949023 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:08.949038 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 15:28:08.949090 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:28:08.949313 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:28:08.949314 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:28:08.949316 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:28:08.949406 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:28:08.949408 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:28:08.950156 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:28:08.950157 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:28:08.951060 (+ 903us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:28:08.951065 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:28:08.951828 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:28:08.951829 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:28:08.951920 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:08.951924 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 15:28:08.951986 (+ 62us) client_negotiation.cc:240] Negotiation successful
0810 15:28:08.952029 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260810 15:28:08.952150 11249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:08.949042 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.129:35827 (local address 127.18.68.130:39041)
0810 15:28:08.949092 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0810 15:28:08.949094 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:28:08.949123 (+ 29us) server_negotiation.cc:407] Connection header received
0810 15:28:08.949214 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:28:08.949216 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:28:08.949228 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:28:08.949287 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:28:08.949508 (+ 221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:08.950012 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:08.951181 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:08.951739 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:08.951818 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:08.951827 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0810 15:28:08.952012 (+ 185us) server_negotiation.cc:299] Negotiation successful
0810 15:28:08.952061 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260810 15:28:08.952268 11248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:08.949104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.129:33621 (local address 127.18.68.131:35203)
0810 15:28:08.949151 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0810 15:28:08.949153 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:28:08.949295 (+ 142us) server_negotiation.cc:407] Connection header received
0810 15:28:08.949325 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:28:08.949326 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:28:08.949336 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:28:08.949400 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:28:08.949589 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:08.950192 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:08.951298 (+ 1106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:08.951871 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:08.951931 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:08.951943 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0810 15:28:08.952111 (+ 168us) server_negotiation.cc:299] Negotiation successful
0810 15:28:08.952158 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260810 15:28:08.952643 10928 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8024a847c1524e898759f22ec88a3bad" candidate_uuid: "e07aad1b650745529d478e4bbc1a1753" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "366244d5f3b44caea819a927fa53d79a" is_pre_election: true
I20260810 15:28:08.952714 11273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:08.948997 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.131:35203 (local address 127.18.68.129:33621)
0810 15:28:08.949202 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:08.949212 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 15:28:08.949276 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:28:08.949410 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:28:08.949410 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:28:08.949412 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:28:08.949513 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:28:08.949515 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:28:08.950271 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:28:08.950272 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:28:08.951092 (+ 820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:28:08.951095 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:28:08.951951 (+ 856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:28:08.951952 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:28:08.952023 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:08.952026 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 15:28:08.952573 (+ 547us) client_negotiation.cc:240] Negotiation successful
0810 15:28:08.952625 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":101,"threads_started":1}
I20260810 15:28:08.952773 10928 raft_consensus.cc:2454] T 8024a847c1524e898759f22ec88a3bad P 366244d5f3b44caea819a927fa53d79a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e07aad1b650745529d478e4bbc1a1753 in term 0.
I20260810 15:28:08.953059 10590 leader_election.cc:302] T 8024a847c1524e898759f22ec88a3bad P e07aad1b650745529d478e4bbc1a1753 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 366244d5f3b44caea819a927fa53d79a, e07aad1b650745529d478e4bbc1a1753; no voters:
I20260810 15:28:08.953696 11268 raft_consensus.cc:2781] T 8024a847c1524e898759f22ec88a3bad P e07aad1b650745529d478e4bbc1a1753 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 15:28:08.953666 11155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8024a847c1524e898759f22ec88a3bad" candidate_uuid: "e07aad1b650745529d478e4bbc1a1753" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d8cfd4508f741259f67187fe2718218" is_pre_election: true
I20260810 15:28:08.953783 11268 raft_consensus.cc:482] T 8024a847c1524e898759f22ec88a3bad P e07aad1b650745529d478e4bbc1a1753 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 15:28:08.953838 11155 raft_consensus.cc:2454] T 8024a847c1524e898759f22ec88a3bad P 8d8cfd4508f741259f67187fe2718218 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e07aad1b650745529d478e4bbc1a1753 in term 0.
I20260810 15:28:08.953859 11268 raft_consensus.cc:3037] T 8024a847c1524e898759f22ec88a3bad P e07aad1b650745529d478e4bbc1a1753 [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:28:08.954872 11268 raft_consensus.cc:504] T 8024a847c1524e898759f22ec88a3bad P e07aad1b650745529d478e4bbc1a1753 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e07aad1b650745529d478e4bbc1a1753" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 46757 } } peers { permanent_uuid: "366244d5f3b44caea819a927fa53d79a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 39041 } } peers { permanent_uuid: "8d8cfd4508f741259f67187fe2718218" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 35203 } }
I20260810 15:28:08.955193 11268 leader_election.cc:288] T 8024a847c1524e898759f22ec88a3bad P e07aad1b650745529d478e4bbc1a1753 [CANDIDATE]: Term 1 election: Requested vote from peers 366244d5f3b44caea819a927fa53d79a (127.18.68.130:39041), 8d8cfd4508f741259f67187fe2718218 (127.18.68.131:35203)
I20260810 15:28:08.955255 11155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8024a847c1524e898759f22ec88a3bad" candidate_uuid: "e07aad1b650745529d478e4bbc1a1753" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d8cfd4508f741259f67187fe2718218"
I20260810 15:28:08.955360 11155 raft_consensus.cc:3037] T 8024a847c1524e898759f22ec88a3bad P 8d8cfd4508f741259f67187fe2718218 [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:28:08.955508 10928 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8024a847c1524e898759f22ec88a3bad" candidate_uuid: "e07aad1b650745529d478e4bbc1a1753" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "366244d5f3b44caea819a927fa53d79a"
I20260810 15:28:08.955585 10928 raft_consensus.cc:3037] T 8024a847c1524e898759f22ec88a3bad P 366244d5f3b44caea819a927fa53d79a [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:28:08.955726 11247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:08.952407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.130:57525 (local address 127.18.68.129:46757)
0810 15:28:08.952609 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0810 15:28:08.952611 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:28:08.952618 (+ 7us) server_negotiation.cc:407] Connection header received
0810 15:28:08.952641 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:28:08.952642 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:28:08.952650 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:28:08.952704 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:28:08.952888 (+ 184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:08.953448 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:08.954747 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:08.955292 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:08.955370 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:08.955380 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0810 15:28:08.955621 (+ 241us) server_negotiation.cc:299] Negotiation successful
0810 15:28:08.955662 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":180}
I20260810 15:28:08.955729 11248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:08.952267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.130:40509 (local address 127.18.68.131:35203)
0810 15:28:08.952352 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0810 15:28:08.952354 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:28:08.952546 (+ 192us) server_negotiation.cc:407] Connection header received
0810 15:28:08.952640 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:28:08.952641 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:28:08.952650 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:28:08.952688 (+ 38us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:28:08.952929 (+ 241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:08.953464 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:08.954800 (+ 1336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:08.955364 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:08.955438 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:08.955445 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0810 15:28:08.955635 (+ 190us) server_negotiation.cc:299] Negotiation successful
0810 15:28:08.955671 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71,"thread_start_us":96,"threads_started":1}
I20260810 15:28:08.955950 11274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:08.952219 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.131:35203 (local address 127.18.68.130:40509)
0810 15:28:08.952476 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:08.952488 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 15:28:08.952572 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:28:08.952745 (+ 173us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:28:08.952747 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:28:08.952749 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:28:08.952833 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:28:08.952836 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:28:08.953549 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:28:08.953550 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:28:08.954698 (+ 1148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:28:08.954718 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:28:08.955439 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:28:08.955440 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:28:08.955532 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:08.955537 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 15:28:08.955832 (+ 295us) client_negotiation.cc:240] Negotiation successful
0810 15:28:08.955881 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":235,"thread_start_us":115,"threads_started":1}
I20260810 15:28:08.956224 11153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8024a847c1524e898759f22ec88a3bad" candidate_uuid: "366244d5f3b44caea819a927fa53d79a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d8cfd4508f741259f67187fe2718218" is_pre_election: true
I20260810 15:28:08.956389 11155 raft_consensus.cc:2454] T 8024a847c1524e898759f22ec88a3bad P 8d8cfd4508f741259f67187fe2718218 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e07aad1b650745529d478e4bbc1a1753 in term 1.
I20260810 15:28:08.956501 10928 raft_consensus.cc:2454] T 8024a847c1524e898759f22ec88a3bad P 366244d5f3b44caea819a927fa53d79a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e07aad1b650745529d478e4bbc1a1753 in term 1.
I20260810 15:28:08.956564 10599 leader_election.cc:302] T 8024a847c1524e898759f22ec88a3bad P e07aad1b650745529d478e4bbc1a1753 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d8cfd4508f741259f67187fe2718218, e07aad1b650745529d478e4bbc1a1753; no voters:
I20260810 15:28:08.956668 11268 raft_consensus.cc:2781] T 8024a847c1524e898759f22ec88a3bad P e07aad1b650745529d478e4bbc1a1753 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 15:28:08.956771 11013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:08.951805 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.129:46757 (local address 127.18.68.130:57525)
0810 15:28:08.951998 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:08.952010 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 15:28:08.952047 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:28:08.952745 (+ 698us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:28:08.952747 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:28:08.952749 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:28:08.952807 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:28:08.952809 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:28:08.953541 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:28:08.953542 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:28:08.954650 (+ 1108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:28:08.954653 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:28:08.955388 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:28:08.955389 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:28:08.955476 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:08.955481 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 15:28:08.955535 (+ 54us) client_negotiation.cc:240] Negotiation successful
0810 15:28:08.955577 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150}
I20260810 15:28:08.956838 11268 raft_consensus.cc:686] T 8024a847c1524e898759f22ec88a3bad P e07aad1b650745529d478e4bbc1a1753 [term 1 LEADER]: Becoming Leader. State: Replica: e07aad1b650745529d478e4bbc1a1753, State: Running, Role: LEADER
I20260810 15:28:08.956923 11268 consensus_queue.cc:237] T 8024a847c1524e898759f22ec88a3bad P e07aad1b650745529d478e4bbc1a1753 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e07aad1b650745529d478e4bbc1a1753" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 46757 } } peers { permanent_uuid: "366244d5f3b44caea819a927fa53d79a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 39041 } } peers { permanent_uuid: "8d8cfd4508f741259f67187fe2718218" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 35203 } }
I20260810 15:28:08.957050 10710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8024a847c1524e898759f22ec88a3bad" candidate_uuid: "366244d5f3b44caea819a927fa53d79a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e07aad1b650745529d478e4bbc1a1753" is_pre_election: true
I20260810 15:28:08.957355 10814 leader_election.cc:302] T 8024a847c1524e898759f22ec88a3bad P 366244d5f3b44caea819a927fa53d79a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 366244d5f3b44caea819a927fa53d79a; no voters: 8d8cfd4508f741259f67187fe2718218, e07aad1b650745529d478e4bbc1a1753
I20260810 15:28:08.957562 11270 raft_consensus.cc:2726] T 8024a847c1524e898759f22ec88a3bad P 366244d5f3b44caea819a927fa53d79a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 15:28:08.957834 10443 catalog_manager.cc:5495] T 8024a847c1524e898759f22ec88a3bad P e07aad1b650745529d478e4bbc1a1753 reported cstate change: term changed from 0 to 1, leader changed from <none> to e07aad1b650745529d478e4bbc1a1753 (127.18.68.129). New cstate: current_term: 1 leader_uuid: "e07aad1b650745529d478e4bbc1a1753" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e07aad1b650745529d478e4bbc1a1753" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 46757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "366244d5f3b44caea819a927fa53d79a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 39041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d8cfd4508f741259f67187fe2718218" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 35203 } health_report { overall_health: UNKNOWN } } }
W20260810 15:28:08.980460 10785 tablet.cc:2369] T 8024a847c1524e898759f22ec88a3bad P e07aad1b650745529d478e4bbc1a1753: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 15:28:08.980752 11247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:08.977971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37858 (local address 127.18.68.129:46757)
0810 15:28:08.978043 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0810 15:28:08.978045 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:28:08.978097 (+ 52us) server_negotiation.cc:407] Connection header received
0810 15:28:08.978149 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:28:08.978150 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:28:08.978169 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:28:08.978231 (+ 62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 15:28:08.978350 (+ 119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:08.978832 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:08.979605 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:08.979828 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:08.979887 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:08.980093 (+ 206us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 15:28:08.980231 (+ 138us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 15:28:08.980320 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0810 15:28:08.980456 (+ 136us) server_negotiation.cc:299] Negotiation successful
0810 15:28:08.980476 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260810 15:28:08.982824 11155 raft_consensus.cc:1261] T 8024a847c1524e898759f22ec88a3bad P 8d8cfd4508f741259f67187fe2718218 [term 1 FOLLOWER]: Refusing update from remote peer e07aad1b650745529d478e4bbc1a1753: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 15:28:08.982847 10928 raft_consensus.cc:1261] T 8024a847c1524e898759f22ec88a3bad P 366244d5f3b44caea819a927fa53d79a [term 1 FOLLOWER]: Refusing update from remote peer e07aad1b650745529d478e4bbc1a1753: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 15:28:08.983234 11280 consensus_queue.cc:1035] T 8024a847c1524e898759f22ec88a3bad P e07aad1b650745529d478e4bbc1a1753 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d8cfd4508f741259f67187fe2718218" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 35203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 15:28:08.983387 11268 consensus_queue.cc:1035] T 8024a847c1524e898759f22ec88a3bad P e07aad1b650745529d478e4bbc1a1753 [LEADER]: Connected to new peer: Peer: permanent_uuid: "366244d5f3b44caea819a927fa53d79a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 39041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 15:28:08.986050 11290 mvcc.cc:205] Tried to move back new op lower bound from 7316994822070288384 to 7316994821968117760. Current Snapshot: MvccSnapshot[applied={T|T < 7316994822070288384}]
I20260810 15:28:08.986680 11289 mvcc.cc:205] Tried to move back new op lower bound from 7316994822070288384 to 7316994821968117760. Current Snapshot: MvccSnapshot[applied={T|T < 7316994822070288384}]
I20260810 15:28:08.988678 10443 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35026:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 15:28:08.988785 10443 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35026:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 15:28:08.989600 10443 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a99445ac89234308a23266d8febb1d03: Sending DeleteTablet for 3 replicas of tablet 8024a847c1524e898759f22ec88a3bad
I20260810 15:28:08.989964 10671 tablet_service.cc:1514] Processing DeleteTablet for tablet 8024a847c1524e898759f22ec88a3bad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 15:28:08 UTC) from {username='kudu', principal='kudu/127.18.68.190@KRBTEST.COM'} at 127.0.0.1:37846
I20260810 15:28:08.990007 11123 tablet_service.cc:1514] Processing DeleteTablet for tablet 8024a847c1524e898759f22ec88a3bad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 15:28:08 UTC) from {username='kudu', principal='kudu/127.18.68.190@KRBTEST.COM'} at 127.0.0.1:49660
I20260810 15:28:08.990291 11301 tablet_replica.cc:330] T 8024a847c1524e898759f22ec88a3bad P e07aad1b650745529d478e4bbc1a1753: stopping tablet replica
I20260810 15:28:08.990361 10891 tablet_service.cc:1514] Processing DeleteTablet for tablet 8024a847c1524e898759f22ec88a3bad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 15:28:08 UTC) from {username='kudu', principal='kudu/127.18.68.190@KRBTEST.COM'} at 127.0.0.1:42360
I20260810 15:28:08.990406 11301 raft_consensus.cc:2229] T 8024a847c1524e898759f22ec88a3bad P e07aad1b650745529d478e4bbc1a1753 [term 1 LEADER]: Raft consensus shutting down.
I20260810 15:28:08.990540 11301 raft_consensus.cc:2258] T 8024a847c1524e898759f22ec88a3bad P e07aad1b650745529d478e4bbc1a1753 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 15:28:08.990629 11304 tablet_replica.cc:330] T 8024a847c1524e898759f22ec88a3bad P 366244d5f3b44caea819a927fa53d79a: stopping tablet replica
I20260810 15:28:08.990670 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 10565
I20260810 15:28:08.998273 11302 tablet_replica.cc:330] T 8024a847c1524e898759f22ec88a3bad P 8d8cfd4508f741259f67187fe2718218: stopping tablet replica
I20260810 15:28:08.998289 11304 raft_consensus.cc:2229] T 8024a847c1524e898759f22ec88a3bad P 366244d5f3b44caea819a927fa53d79a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 15:28:08.998431 11302 raft_consensus.cc:2229] T 8024a847c1524e898759f22ec88a3bad P 8d8cfd4508f741259f67187fe2718218 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 15:28:08.998570 11302 raft_consensus.cc:2258] T 8024a847c1524e898759f22ec88a3bad P 8d8cfd4508f741259f67187fe2718218 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 15:28:08.998584 11304 raft_consensus.cc:2258] T 8024a847c1524e898759f22ec88a3bad P 366244d5f3b44caea819a927fa53d79a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 15:28:08.999099 11304 ts_tablet_manager.cc:1905] T 8024a847c1524e898759f22ec88a3bad P 366244d5f3b44caea819a927fa53d79a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 15:28:09.000857 11304 ts_tablet_manager.cc:1918] T 8024a847c1524e898759f22ec88a3bad P 366244d5f3b44caea819a927fa53d79a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 15:28:09.000967 11304 log.cc:1196] T 8024a847c1524e898759f22ec88a3bad P 366244d5f3b44caea819a927fa53d79a: Deleting WAL directory at /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-1/wal/wals/8024a847c1524e898759f22ec88a3bad
I20260810 15:28:09.001534 11304 ts_tablet_manager.cc:1939] T 8024a847c1524e898759f22ec88a3bad P 366244d5f3b44caea819a927fa53d79a: Deleting consensus metadata
I20260810 15:28:09.002108 10416 catalog_manager.cc:4841] TS 366244d5f3b44caea819a927fa53d79a (127.18.68.130:39041): tablet 8024a847c1524e898759f22ec88a3bad (table test-table [id=919bc648606949259a663dc2b1fc29e2]) successfully deleted
W20260810 15:28:09.003260 10413 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.18.68.129:46757 (error 108)
I20260810 15:28:09.003502 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 10789
I20260810 15:28:09.006541 11240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:09.003681 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.129:46757 (local address 127.0.0.1:37874)
0810 15:28:09.006434 (+ 2753us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:09.006496 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.129:46757: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2724}
W20260810 15:28:09.014489 10413 catalog_manager.cc:4584] TS e07aad1b650745529d478e4bbc1a1753 (127.18.68.129:46757): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 8024a847c1524e898759f22ec88a3bad: Network error: Client connection negotiation failed: client connection to 127.18.68.129:46757: connect: Connection refused (error 111)
I20260810 15:28:09.017241 11302 ts_tablet_manager.cc:1905] T 8024a847c1524e898759f22ec88a3bad P 8d8cfd4508f741259f67187fe2718218: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 15:28:09.021531 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 11016
I20260810 15:28:09.042799 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 10390
I20260810 15:28:09.042824 11240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:09.042678 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.131:35203 (local address 127.0.0.1:49668)
0810 15:28:09.042746 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:09.042781 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.131:35203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260810 15:28:09.054102 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.190:42059
--webserver_interface=127.18.68.190
--webserver_port=37927
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab
--principal=kudu/127.18.68.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:44607
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.68.190:42059
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:28:09.137117 11307 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:28:09.137351 11307 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:28:09.137375 11307 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:28:09.138521 11307 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 15:28:09.138566 11307 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:28:09.138579 11307 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:28:09.138592 11307 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 15:28:09.138604 11307 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 15:28:09.140091 11307 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:44607
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.18.68.190:42059
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab
--principal=kudu/127.18.68.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.190:42059
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.68.190
--webserver_port=37927
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11307
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:28:09.140300 11307 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:28:09.140481 11307 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:28:09.150353 11315 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:28:09.150394 11314 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:28:09.150358 11320 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:28:09.150859 11307 server_base.cc:1034] running on GCE node
I20260810 15:28:09.151165 11307 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:28:09.151502 11307 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:28:09.152709 11307 hybrid_clock.cc:648] HybridClock initialized: now 1786375689152693 us; error 30 us; skew 500 ppm
Aug 10 15:28:09 dist-test-slave-2p8l krb5kdc[10371](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375689, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:28:09.155443 11307 init.cc:377] Logged in from keytab as kudu/127.18.68.190@KRBTEST.COM (short username kudu)
I20260810 15:28:09.155928 11307 webserver.cc:460] Webserver started at http://127.18.68.190:37927/ using document root <none> and password file <none>
I20260810 15:28:09.156184 11307 fs_manager.cc:359] Metadata directory not provided
I20260810 15:28:09.156278 11307 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:28:09.157703 11307 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.001s
I20260810 15:28:09.158456 11328 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:28:09.158641 11307 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260810 15:28:09.158759 11307 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/master-0/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/master-0/wal
uuid: "a99445ac89234308a23266d8febb1d03"
format_stamp: "Formatted at 2026-08-10 15:28:08 on dist-test-slave-2p8l"
server_key: "9c039938d2684d51a9007029b17a58ad"
server_key_iv: "c0c0e9431248c031453cf5d98942ca5c"
server_key_version: "encryptionkey@0"
I20260810 15:28:09.159191 11307 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:28:09.170032 11307 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:28:09.172148 11307 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:28:09.172266 11307 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:28:09.176298 11307 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.190:42059
I20260810 15:28:09.176367 11423 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.190:42059 every 8 connection(s)
I20260810 15:28:09.176774 11307 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
I20260810 15:28:09.178679 11427 sys_catalog.cc:263] Verifying existing consensus state
I20260810 15:28:09.179383 11427 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a99445ac89234308a23266d8febb1d03: Bootstrap starting.
I20260810 15:28:09.179746 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 11307
I20260810 15:28:09.180043 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.68.129:46757
--local_ip_for_outbound_sockets=127.18.68.129
--tserver_master_addrs=127.18.68.190:42059
--webserver_port=33967
--webserver_interface=127.18.68.129
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.129.keytab
--principal=kudu/127.18.68.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:44607
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 15:28:09.188673 11427 log.cc:824] T 00000000000000000000000000000000 P a99445ac89234308a23266d8febb1d03: Log is configured to *not* fsync() on all Append() calls
I20260810 15:28:09.190790 11427 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a99445ac89234308a23266d8febb1d03: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 15:28:09.191124 11427 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a99445ac89234308a23266d8febb1d03: Bootstrap complete.
I20260810 15:28:09.193485 11427 raft_consensus.cc:348] T 00000000000000000000000000000000 P a99445ac89234308a23266d8febb1d03 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a99445ac89234308a23266d8febb1d03" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 42059 } }
I20260810 15:28:09.193746 11427 raft_consensus.cc:729] T 00000000000000000000000000000000 P a99445ac89234308a23266d8febb1d03 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a99445ac89234308a23266d8febb1d03, State: Initialized, Role: FOLLOWER
I20260810 15:28:09.193959 11427 consensus_queue.cc:260] T 00000000000000000000000000000000 P a99445ac89234308a23266d8febb1d03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a99445ac89234308a23266d8febb1d03" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 42059 } }
I20260810 15:28:09.194060 11427 raft_consensus.cc:388] T 00000000000000000000000000000000 P a99445ac89234308a23266d8febb1d03 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 15:28:09.194142 11427 raft_consensus.cc:482] T 00000000000000000000000000000000 P a99445ac89234308a23266d8febb1d03 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 15:28:09.194201 11427 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a99445ac89234308a23266d8febb1d03 [term 1 FOLLOWER]: Advancing to term 2
I20260810 15:28:09.195312 11427 raft_consensus.cc:504] T 00000000000000000000000000000000 P a99445ac89234308a23266d8febb1d03 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a99445ac89234308a23266d8febb1d03" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 42059 } }
I20260810 15:28:09.195436 11427 leader_election.cc:302] T 00000000000000000000000000000000 P a99445ac89234308a23266d8febb1d03 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a99445ac89234308a23266d8febb1d03; no voters:
I20260810 15:28:09.195658 11427 leader_election.cc:288] T 00000000000000000000000000000000 P a99445ac89234308a23266d8febb1d03 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260810 15:28:09.195696 11440 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a99445ac89234308a23266d8febb1d03 [term 2 FOLLOWER]: Leader election won for term 2
I20260810 15:28:09.195807 11440 raft_consensus.cc:686] T 00000000000000000000000000000000 P a99445ac89234308a23266d8febb1d03 [term 2 LEADER]: Becoming Leader. State: Replica: a99445ac89234308a23266d8febb1d03, State: Running, Role: LEADER
I20260810 15:28:09.195905 11440 consensus_queue.cc:237] T 00000000000000000000000000000000 P a99445ac89234308a23266d8febb1d03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a99445ac89234308a23266d8febb1d03" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 42059 } }
I20260810 15:28:09.195945 11427 sys_catalog.cc:564] T 00000000000000000000000000000000 P a99445ac89234308a23266d8febb1d03 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 15:28:09.196182 11442 sys_catalog.cc:455] T 00000000000000000000000000000000 P a99445ac89234308a23266d8febb1d03 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "a99445ac89234308a23266d8febb1d03" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a99445ac89234308a23266d8febb1d03" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 42059 } } }
I20260810 15:28:09.196276 11442 sys_catalog.cc:458] T 00000000000000000000000000000000 P a99445ac89234308a23266d8febb1d03 [sys.catalog]: This master's current role is: LEADER
I20260810 15:28:09.196450 11443 sys_catalog.cc:455] T 00000000000000000000000000000000 P a99445ac89234308a23266d8febb1d03 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a99445ac89234308a23266d8febb1d03. Latest consensus state: current_term: 2 leader_uuid: "a99445ac89234308a23266d8febb1d03" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a99445ac89234308a23266d8febb1d03" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 42059 } } }
I20260810 15:28:09.196511 11443 sys_catalog.cc:458] T 00000000000000000000000000000000 P a99445ac89234308a23266d8febb1d03 [sys.catalog]: This master's current role is: LEADER
I20260810 15:28:09.196503 11446 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 15:28:09.197638 11446 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 15:28:09.197808 11446 catalog_manager.cc:1259] Loaded cluster ID: 8653322e7ebc4a1dba61902fd0d83b8f
I20260810 15:28:09.198036 11446 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 15:28:09.198271 11446 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260810 15:28:09.200898 11446 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260810 15:28:09.203022 11446 catalog_manager.cc:1504] Loading token signing keys...
I20260810 15:28:09.203251 11446 catalog_manager.cc:5879] T 00000000000000000000000000000000 P a99445ac89234308a23266d8febb1d03: Loaded TSK: 0
I20260810 15:28:09.203491 11446 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260810 15:28:09.295490 11436 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:28:09.295780 11436 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:28:09.295822 11436 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:28:09.297526 11436 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:28:09.297597 11436 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:28:09.297640 11436 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.68.129
I20260810 15:28:09.299865 11436 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:44607
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.129.keytab
--principal=kudu/127.18.68.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.68.129:46757
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.68.129
--webserver_port=33967
--tserver_master_addrs=127.18.68.190:42059
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11436
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.68.129
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:28:09.300163 11436 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:28:09.300485 11436 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:28:09.306457 11477 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:28:09.306547 11478 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:28:09.306557 11482 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:28:09.306972 11436 server_base.cc:1034] running on GCE node
I20260810 15:28:09.307221 11436 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:28:09.307502 11436 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:28:09.308691 11436 hybrid_clock.cc:648] HybridClock initialized: now 1786375689308677 us; error 30 us; skew 500 ppm
Aug 10 15:28:09 dist-test-slave-2p8l krb5kdc[10371](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375689, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:28:09.311693 11436 init.cc:377] Logged in from keytab as kudu/127.18.68.129@KRBTEST.COM (short username kudu)
I20260810 15:28:09.312265 11436 webserver.cc:460] Webserver started at http://127.18.68.129:33967/ using document root <none> and password file <none>
I20260810 15:28:09.312569 11436 fs_manager.cc:359] Metadata directory not provided
I20260810 15:28:09.312674 11436 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:28:09.314538 11436 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260810 15:28:09.315414 11494 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:28:09.315639 11436 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 15:28:09.315763 11436 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-0/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-0/wal
uuid: "e07aad1b650745529d478e4bbc1a1753"
format_stamp: "Formatted at 2026-08-10 15:28:08 on dist-test-slave-2p8l"
server_key: "a9752259256d82fc264814509ff54439"
server_key_iv: "664ec311721337bf9a6307a782191604"
server_key_version: "encryptionkey@0"
I20260810 15:28:09.316162 11436 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:28:09.325130 11436 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:28:09.327764 11436 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:28:09.327937 11436 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:28:09.328177 11436 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 15:28:09.328679 11507 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260810 15:28:09.330292 11436 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260810 15:28:09.330351 11436 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260810 15:28:09.330379 11436 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260810 15:28:09.331084 11436 ts_tablet_manager.cc:610] Registered 1 tablets
I20260810 15:28:09.331132 11436 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260810 15:28:09.331174 11507 tablet_bootstrap.cc:492] T 8024a847c1524e898759f22ec88a3bad P e07aad1b650745529d478e4bbc1a1753: Bootstrap starting.
I20260810 15:28:09.339459 11436 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.129:46757
I20260810 15:28:09.339648 11696 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.129:46757 every 8 connection(s)
I20260810 15:28:09.340060 11436 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-0/data/info.pb
I20260810 15:28:09.344486 11507 log.cc:824] T 8024a847c1524e898759f22ec88a3bad P e07aad1b650745529d478e4bbc1a1753: Log is configured to *not* fsync() on all Append() calls
I20260810 15:28:09.347040 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 11436
I20260810 15:28:09.347368 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.68.130:39041
--local_ip_for_outbound_sockets=127.18.68.130
--tserver_master_addrs=127.18.68.190:42059
--webserver_port=36719
--webserver_interface=127.18.68.130
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.130.keytab
--principal=kudu/127.18.68.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:44607
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 15:28:09 dist-test-slave-2p8l krb5kdc[10371](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375689, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.129@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
I20260810 15:28:09.350289 11507 tablet_bootstrap.cc:492] T 8024a847c1524e898759f22ec88a3bad P e07aad1b650745529d478e4bbc1a1753: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 15:28:09.350631 11507 tablet_bootstrap.cc:492] T 8024a847c1524e898759f22ec88a3bad P e07aad1b650745529d478e4bbc1a1753: Bootstrap complete.
I20260810 15:28:09.352006 11507 ts_tablet_manager.cc:1397] T 8024a847c1524e898759f22ec88a3bad P e07aad1b650745529d478e4bbc1a1753: Time spent bootstrapping tablet: real 0.021s user 0.010s sys 0.006s
I20260810 15:28:09.353456 11507 raft_consensus.cc:348] T 8024a847c1524e898759f22ec88a3bad P e07aad1b650745529d478e4bbc1a1753 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e07aad1b650745529d478e4bbc1a1753" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 46757 } } peers { permanent_uuid: "366244d5f3b44caea819a927fa53d79a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 39041 } } peers { permanent_uuid: "8d8cfd4508f741259f67187fe2718218" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 35203 } }
I20260810 15:28:09.353796 11507 raft_consensus.cc:729] T 8024a847c1524e898759f22ec88a3bad P e07aad1b650745529d478e4bbc1a1753 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e07aad1b650745529d478e4bbc1a1753, State: Initialized, Role: FOLLOWER
I20260810 15:28:09.353977 11507 consensus_queue.cc:260] T 8024a847c1524e898759f22ec88a3bad P e07aad1b650745529d478e4bbc1a1753 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e07aad1b650745529d478e4bbc1a1753" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 46757 } } peers { permanent_uuid: "366244d5f3b44caea819a927fa53d79a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 39041 } } peers { permanent_uuid: "8d8cfd4508f741259f67187fe2718218" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 35203 } }
I20260810 15:28:09.354295 11507 ts_tablet_manager.cc:1428] T 8024a847c1524e898759f22ec88a3bad P e07aad1b650745529d478e4bbc1a1753: Time spent starting tablet: real 0.002s user 0.004s sys 0.000s
I20260810 15:28:09.356101 11703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:09.340835 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42059 (local address 127.18.68.129:41519)
0810 15:28:09.341072 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:09.341134 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0810 15:28:09.341755 (+ 621us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:28:09.342386 (+ 631us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:28:09.342390 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:28:09.342787 (+ 397us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:28:09.343057 (+ 270us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:28:09.343064 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:28:09.345359 (+ 2295us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:28:09.345360 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:28:09.346703 (+ 1343us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:28:09.346707 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:28:09.347872 (+ 1165us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:28:09.347873 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:28:09.348041 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:09.348698 (+ 657us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:28:09.348707 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:28:09.350543 (+ 1836us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:28:09.353330 (+ 2787us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:28:09.353339 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:28:09.353341 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:28:09.353941 (+ 600us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:28:09.354580 (+ 639us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:28:09.354581 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:28:09.354582 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:28:09.354736 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:28:09.355332 (+ 596us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:28:09.355340 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:28:09.355501 (+ 161us) client_negotiation.cc:769] Sending connection context
0810 15:28:09.355627 (+ 126us) client_negotiation.cc:240] Negotiation successful
0810 15:28:09.355815 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":119,"threads_started":1}
I20260810 15:28:09.356963 11704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:09.341026 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.129:41519 (local address 127.18.68.190:42059)
0810 15:28:09.341236 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0810 15:28:09.341247 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 15:28:09.341308 (+ 61us) server_negotiation.cc:407] Connection header received
0810 15:28:09.342036 (+ 728us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:28:09.342044 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:28:09.342155 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:28:09.342330 (+ 175us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:28:09.343214 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:09.345097 (+ 1883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:09.346823 (+ 1726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:09.347601 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:09.347735 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:09.350746 (+ 3011us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:28:09.350753 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:28:09.350753 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:28:09.350767 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:28:09.353230 (+ 2463us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:28:09.354290 (+ 1060us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:28:09.354295 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:28:09.354295 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:28:09.354475 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:28:09.354824 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:28:09.354826 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:28:09.354826 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:28:09.355204 (+ 378us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:28:09.355296 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0810 15:28:09.356551 (+ 1255us) server_negotiation.cc:299] Negotiation successful
0810 15:28:09.356721 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":163,"thread_start_us":86,"threads_started":1}
I20260810 15:28:09.358275 11697 heartbeater.cc:347] Connected to a master server at 127.18.68.190:42059
I20260810 15:28:09.358381 11697 heartbeater.cc:464] Registering TS with master...
I20260810 15:28:09.358597 11697 heartbeater.cc:511] Master 127.18.68.190:42059 requested a full tablet report, sending...
I20260810 15:28:09.359458 11357 ts_manager.cc:194] Registered new tserver with Master: e07aad1b650745529d478e4bbc1a1753 (127.18.68.129:46757)
I20260810 15:28:09.360654 11357 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.68.129@KRBTEST.COM'} at 127.18.68.129:41519
I20260810 15:28:09.361712 11697 heartbeater.cc:503] Master 127.18.68.190:42059 was elected leader, sending a full tablet report...
I20260810 15:28:09.367624 11714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:09.360447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37890 (local address 127.18.68.129:46757)
0810 15:28:09.360635 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0810 15:28:09.360639 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 15:28:09.362462 (+ 1823us) server_negotiation.cc:407] Connection header received
0810 15:28:09.362659 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:28:09.362662 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:28:09.362680 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:28:09.362739 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:28:09.363052 (+ 313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:09.364381 (+ 1329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:09.366106 (+ 1725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:09.366860 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:09.366910 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:09.366964 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0810 15:28:09.367483 (+ 519us) server_negotiation.cc:299] Negotiation successful
0810 15:28:09.367532 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":112,"threads_started":1}
I20260810 15:28:09.367973 11711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:09.360158 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.129:46757 (local address 127.0.0.1:37890)
0810 15:28:09.362176 (+ 2018us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:09.362398 (+ 222us) client_negotiation.cc:174] Beginning negotiation
0810 15:28:09.362536 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:28:09.362846 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:28:09.362850 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:28:09.362852 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:28:09.362937 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:28:09.362940 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:28:09.364519 (+ 1579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:28:09.364520 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:28:09.365972 (+ 1452us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:28:09.365975 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:28:09.367030 (+ 1055us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:28:09.367030 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:28:09.367346 (+ 316us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:09.367361 (+ 15us) client_negotiation.cc:769] Sending connection context
0810 15:28:09.367806 (+ 445us) client_negotiation.cc:240] Negotiation successful
0810 15:28:09.367883 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1979,"thread_start_us":111,"threads_started":1}
I20260810 15:28:09.368503 11585 tablet_service.cc:1514] Processing DeleteTablet for tablet 8024a847c1524e898759f22ec88a3bad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 15:28:08 UTC) from {username='kudu', principal='kudu/127.18.68.190@KRBTEST.COM'} at 127.0.0.1:37890
I20260810 15:28:09.369280 11715 tablet_replica.cc:330] stopping tablet replica
I20260810 15:28:09.369395 11715 raft_consensus.cc:2229] T 8024a847c1524e898759f22ec88a3bad P e07aad1b650745529d478e4bbc1a1753 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 15:28:09.369470 11715 raft_consensus.cc:2258] T 8024a847c1524e898759f22ec88a3bad P e07aad1b650745529d478e4bbc1a1753 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 15:28:09.369850 11715 ts_tablet_manager.cc:1905] T 8024a847c1524e898759f22ec88a3bad P e07aad1b650745529d478e4bbc1a1753: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 15:28:09.372601 11715 ts_tablet_manager.cc:1918] T 8024a847c1524e898759f22ec88a3bad P e07aad1b650745529d478e4bbc1a1753: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 15:28:09.372699 11715 log.cc:1196] T 8024a847c1524e898759f22ec88a3bad P e07aad1b650745529d478e4bbc1a1753: Deleting WAL directory at /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-0/wal/wals/8024a847c1524e898759f22ec88a3bad
I20260810 15:28:09.372951 11715 ts_tablet_manager.cc:1939] T 8024a847c1524e898759f22ec88a3bad P e07aad1b650745529d478e4bbc1a1753: Deleting consensus metadata
I20260810 15:28:09.373720 11330 catalog_manager.cc:4841] TS e07aad1b650745529d478e4bbc1a1753 (127.18.68.129:46757): tablet 8024a847c1524e898759f22ec88a3bad (table test-table [id=919bc648606949259a663dc2b1fc29e2]) successfully deleted
W20260810 15:28:09.447827 11707 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:28:09.448066 11707 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:28:09.448118 11707 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:28:09.449291 11707 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:28:09.449355 11707 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:28:09.449396 11707 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.68.130
I20260810 15:28:09.450968 11707 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:44607
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.130.keytab
--principal=kudu/127.18.68.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.68.130:39041
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.68.130
--webserver_port=36719
--tserver_master_addrs=127.18.68.190:42059
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11707
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.68.130
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:28:09.451237 11707 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:28:09.451475 11707 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:28:09.456662 11732 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:28:09.456732 11727 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:28:09.456617 11728 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:28:09.456774 11707 server_base.cc:1034] running on GCE node
I20260810 15:28:09.456980 11707 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:28:09.457249 11707 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:28:09.458391 11707 hybrid_clock.cc:648] HybridClock initialized: now 1786375689458377 us; error 38 us; skew 500 ppm
Aug 10 15:28:09 dist-test-slave-2p8l krb5kdc[10371](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375689, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:28:09.460819 11707 init.cc:377] Logged in from keytab as kudu/127.18.68.130@KRBTEST.COM (short username kudu)
I20260810 15:28:09.461360 11707 webserver.cc:460] Webserver started at http://127.18.68.130:36719/ using document root <none> and password file <none>
I20260810 15:28:09.461587 11707 fs_manager.cc:359] Metadata directory not provided
I20260810 15:28:09.461669 11707 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:28:09.463138 11707 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:28:09.463770 11747 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:28:09.463935 11707 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 15:28:09.464030 11707 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-1/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-1/wal
uuid: "366244d5f3b44caea819a927fa53d79a"
format_stamp: "Formatted at 2026-08-10 15:28:08 on dist-test-slave-2p8l"
server_key: "171aec0cab8dedb1d87504913422f58e"
server_key_iv: "c4ca0d047445d756db2b280eae43f9b0"
server_key_version: "encryptionkey@0"
I20260810 15:28:09.464390 11707 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:28:09.472626 11707 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:28:09.474418 11707 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:28:09.474575 11707 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:28:09.474815 11707 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 15:28:09.475126 11707 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 15:28:09.475189 11707 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 15:28:09.475231 11707 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 15:28:09.475261 11707 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 15:28:09.481426 11707 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.130:39041
I20260810 15:28:09.481496 11938 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.130:39041 every 8 connection(s)
I20260810 15:28:09.481824 11707 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-1/data/info.pb
Aug 10 15:28:09 dist-test-slave-2p8l krb5kdc[10371](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375689, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.130@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
I20260810 15:28:09.488060 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 11707
I20260810 15:28:09.488318 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.68.131:35203
--local_ip_for_outbound_sockets=127.18.68.131
--tserver_master_addrs=127.18.68.190:42059
--webserver_port=36565
--webserver_interface=127.18.68.131
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.131.keytab
--principal=kudu/127.18.68.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:44607
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 15:28:09.491124 11704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:09.482571 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.130:58835 (local address 127.18.68.190:42059)
0810 15:28:09.482651 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0810 15:28:09.482654 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 15:28:09.482820 (+ 166us) server_negotiation.cc:407] Connection header received
0810 15:28:09.483291 (+ 471us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:28:09.483292 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:28:09.483304 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:28:09.483355 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:28:09.484261 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:09.484791 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:09.485731 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:09.485928 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:09.485979 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:09.488169 (+ 2190us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:28:09.488171 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:28:09.488171 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:28:09.488179 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:28:09.489593 (+ 1414us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:28:09.490144 (+ 551us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:28:09.490145 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:28:09.490146 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:28:09.490215 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:28:09.490455 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:28:09.490456 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:28:09.490457 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:28:09.490599 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:28:09.490683 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0810 15:28:09.490905 (+ 222us) server_negotiation.cc:299] Negotiation successful
0810 15:28:09.491000 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260810 15:28:09.491146 11941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:09.482545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42059 (local address 127.18.68.130:58835)
0810 15:28:09.482701 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:09.482736 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0810 15:28:09.483210 (+ 474us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:28:09.483407 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:28:09.483410 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:28:09.483961 (+ 551us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:28:09.484169 (+ 208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:28:09.484174 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:28:09.484871 (+ 697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:28:09.484872 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:28:09.485660 (+ 788us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:28:09.485662 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:28:09.485999 (+ 337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:28:09.486000 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:28:09.486162 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:09.486664 (+ 502us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:28:09.486672 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:28:09.488054 (+ 1382us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:28:09.489671 (+ 1617us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:28:09.489679 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:28:09.489681 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:28:09.490005 (+ 324us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:28:09.490288 (+ 283us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:28:09.490289 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:28:09.490289 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:28:09.490391 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:28:09.490668 (+ 277us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:28:09.490673 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:28:09.490780 (+ 107us) client_negotiation.cc:769] Sending connection context
0810 15:28:09.490861 (+ 81us) client_negotiation.cc:240] Negotiation successful
0810 15:28:09.490978 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":97,"threads_started":1}
I20260810 15:28:09.491641 11939 heartbeater.cc:347] Connected to a master server at 127.18.68.190:42059
I20260810 15:28:09.491729 11939 heartbeater.cc:464] Registering TS with master...
I20260810 15:28:09.491905 11939 heartbeater.cc:511] Master 127.18.68.190:42059 requested a full tablet report, sending...
I20260810 15:28:09.492296 11357 ts_manager.cc:194] Registered new tserver with Master: 366244d5f3b44caea819a927fa53d79a (127.18.68.130:39041)
I20260810 15:28:09.492699 11357 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.68.130@KRBTEST.COM'} at 127.18.68.130:58835
W20260810 15:28:09.573086 11942 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:28:09.573325 11942 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:28:09.573369 11942 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:28:09.574661 11942 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:28:09.574723 11942 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:28:09.574770 11942 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.68.131
I20260810 15:28:09.576280 11942 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:44607
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.131.keytab
--principal=kudu/127.18.68.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.68.131:35203
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.68.131
--webserver_port=36565
--tserver_master_addrs=127.18.68.190:42059
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11942
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.68.131
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:28:09.576552 11942 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:28:09.576802 11942 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:28:09.581954 11950 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:28:09.581962 11948 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:28:09.581962 11947 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:28:09.582243 11942 server_base.cc:1034] running on GCE node
I20260810 15:28:09.582545 11942 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:28:09.582793 11942 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:28:09.583956 11942 hybrid_clock.cc:648] HybridClock initialized: now 1786375689583949 us; error 37 us; skew 500 ppm
Aug 10 15:28:09 dist-test-slave-2p8l krb5kdc[10371](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375689, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:28:09.586658 11942 init.cc:377] Logged in from keytab as kudu/127.18.68.131@KRBTEST.COM (short username kudu)
I20260810 15:28:09.587090 11942 webserver.cc:460] Webserver started at http://127.18.68.131:36565/ using document root <none> and password file <none>
I20260810 15:28:09.587412 11942 fs_manager.cc:359] Metadata directory not provided
I20260810 15:28:09.587508 11942 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:28:09.588900 11942 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:28:09.589600 11965 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:28:09.589766 11942 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 15:28:09.589869 11942 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-2/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-2/wal
uuid: "8d8cfd4508f741259f67187fe2718218"
format_stamp: "Formatted at 2026-08-10 15:28:08 on dist-test-slave-2p8l"
server_key: "f612ebb61de5810f7397a5b84a448a32"
server_key_iv: "bab7fae206c539665c2fd3531c066e9b"
server_key_version: "encryptionkey@0"
I20260810 15:28:09.590286 11942 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:28:09.604236 11942 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:28:09.606748 11942 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:28:09.606918 11942 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:28:09.607191 11942 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 15:28:09.607666 11980 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
W20260810 15:28:09.609064 11980 ts_tablet_manager.cc:1852] T 8024a847c1524e898759f22ec88a3bad P 8d8cfd4508f741259f67187fe2718218: Tablet Manager startup: Rolling forward tablet deletion of type TABLET_DATA_DELETED
I20260810 15:28:09.609344 11980 ts_tablet_manager.cc:1905] T 8024a847c1524e898759f22ec88a3bad P 8d8cfd4508f741259f67187fe2718218: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 15:28:09.611418 11980 ts_tablet_manager.cc:1918] T 8024a847c1524e898759f22ec88a3bad P 8d8cfd4508f741259f67187fe2718218: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 15:28:09.611503 11980 log.cc:1196] T 8024a847c1524e898759f22ec88a3bad P 8d8cfd4508f741259f67187fe2718218: Deleting WAL directory at /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-2/wal/wals/8024a847c1524e898759f22ec88a3bad
I20260810 15:28:09.611876 11980 ts_tablet_manager.cc:1939] T 8024a847c1524e898759f22ec88a3bad P 8d8cfd4508f741259f67187fe2718218: Deleting consensus metadata
I20260810 15:28:09.612110 11942 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 0 live tablets)
I20260810 15:28:09.612195 11942 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.005s user 0.000s sys 0.000s
I20260810 15:28:09.612274 11942 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 15:28:09.612306 11942 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 15:28:09.618911 11942 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.131:35203
I20260810 15:28:09.618963 12172 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.131:35203 every 8 connection(s)
I20260810 15:28:09.619282 11942 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-2/data/info.pb
I20260810 15:28:09.625008 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 11942
Aug 10 15:28:09 dist-test-slave-2p8l krb5kdc[10371](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375689, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.131@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
I20260810 15:28:09.628677 11704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:09.620321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.131:59357 (local address 127.18.68.190:42059)
0810 15:28:09.620388 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0810 15:28:09.620390 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:28:09.620417 (+ 27us) server_negotiation.cc:407] Connection header received
0810 15:28:09.620939 (+ 522us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:28:09.620940 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:28:09.620949 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:28:09.621005 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:28:09.621607 (+ 602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:09.622138 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:09.623101 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:09.623318 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:09.623385 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:09.625739 (+ 2354us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:28:09.625740 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:28:09.625740 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:28:09.625748 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:28:09.627344 (+ 1596us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:28:09.627723 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:28:09.627724 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:28:09.627725 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:28:09.627789 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:28:09.628008 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:28:09.628009 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:28:09.628009 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:28:09.628143 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:28:09.628211 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0810 15:28:09.628493 (+ 282us) server_negotiation.cc:299] Negotiation successful
0810 15:28:09.628580 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260810 15:28:09.628926 12176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:09.620117 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42059 (local address 127.18.68.131:59357)
0810 15:28:09.620276 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:09.620313 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0810 15:28:09.620848 (+ 535us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:28:09.621059 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:28:09.621063 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:28:09.621340 (+ 277us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:28:09.621531 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:28:09.621535 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:28:09.622207 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:28:09.622208 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:28:09.623006 (+ 798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:28:09.623008 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:28:09.623399 (+ 391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:28:09.623400 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:28:09.623500 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:09.624070 (+ 570us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:28:09.624078 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:28:09.625636 (+ 1558us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:28:09.627423 (+ 1787us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:28:09.627429 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:28:09.627431 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:28:09.627645 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:28:09.627856 (+ 211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:28:09.627856 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:28:09.627857 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:28:09.627951 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:28:09.628212 (+ 261us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:28:09.628219 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:28:09.628364 (+ 145us) client_negotiation.cc:769] Sending connection context
0810 15:28:09.628472 (+ 108us) client_negotiation.cc:240] Negotiation successful
0810 15:28:09.628640 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":74,"threads_started":1}
I20260810 15:28:09.629607 12174 heartbeater.cc:347] Connected to a master server at 127.18.68.190:42059
I20260810 15:28:09.629725 12174 heartbeater.cc:464] Registering TS with master...
I20260810 15:28:09.629964 12174 heartbeater.cc:511] Master 127.18.68.190:42059 requested a full tablet report, sending...
I20260810 15:28:09.630455 11357 ts_manager.cc:194] Registered new tserver with Master: 8d8cfd4508f741259f67187fe2718218 (127.18.68.131:35203)
I20260810 15:28:09.630991 11357 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.68.131@KRBTEST.COM'} at 127.18.68.131:59357
I20260810 15:28:09.632740 12178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:09.625453 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35032 (local address 127.18.68.190:42059)
0810 15:28:09.625579 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0810 15:28:09.625580 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 15:28:09.625670 (+ 90us) server_negotiation.cc:407] Connection header received
0810 15:28:09.625746 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:28:09.625746 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:28:09.625758 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:28:09.625813 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:28:09.626644 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:09.627184 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:09.628214 (+ 1030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:09.628511 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:09.628574 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:09.630277 (+ 1703us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:28:09.630278 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:28:09.630279 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:28:09.630286 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:28:09.631763 (+ 1477us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:28:09.632097 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:28:09.632098 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:28:09.632099 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:28:09.632161 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:28:09.632333 (+ 172us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:28:09.632334 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:28:09.632334 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:28:09.632443 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:28:09.632560 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0810 15:28:09.632614 (+ 54us) server_negotiation.cc:299] Negotiation successful
0810 15:28:09.632679 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101,"thread_start_us":65,"threads_started":1}
I20260810 15:28:09.633445 18706 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 15:28:09.635978 12178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:09.633791 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35042 (local address 127.18.68.190:42059)
0810 15:28:09.633844 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0810 15:28:09.633846 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:28:09.633979 (+ 133us) server_negotiation.cc:407] Connection header received
0810 15:28:09.634027 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:28:09.634028 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:28:09.634090 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:28:09.634163 (+ 73us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 15:28:09.634244 (+ 81us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:09.634674 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:09.635362 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:09.635540 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:09.635588 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:09.635713 (+ 125us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 15:28:09.635795 (+ 82us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 15:28:09.635850 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0810 15:28:09.635880 (+ 30us) server_negotiation.cc:299] Negotiation successful
0810 15:28:09.635896 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260810 15:28:09.636278 11357 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:35042:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 15:28:09.638005 11357 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 15:28:09.640270 11585 tablet_service.cc:1467] Processing CreateTablet for tablet 3380a02a618d4cd58984008c3d43c010 (DEFAULT_TABLE table=test-table [id=c0a19a776524493b94abacd397be3a09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 15:28:09.640486 11585 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3380a02a618d4cd58984008c3d43c010. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:28:09.642215 11507 tablet_bootstrap.cc:492] T 3380a02a618d4cd58984008c3d43c010 P e07aad1b650745529d478e4bbc1a1753: Bootstrap starting.
I20260810 15:28:09.642601 11507 tablet_bootstrap.cc:654] T 3380a02a618d4cd58984008c3d43c010 P e07aad1b650745529d478e4bbc1a1753: Neither blocks nor log segments found. Creating new log.
I20260810 15:28:09.643240 11507 tablet_bootstrap.cc:492] T 3380a02a618d4cd58984008c3d43c010 P e07aad1b650745529d478e4bbc1a1753: No bootstrap required, opened a new log
I20260810 15:28:09.643296 11507 ts_tablet_manager.cc:1397] T 3380a02a618d4cd58984008c3d43c010 P e07aad1b650745529d478e4bbc1a1753: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260810 15:28:09.643456 11507 raft_consensus.cc:348] T 3380a02a618d4cd58984008c3d43c010 P e07aad1b650745529d478e4bbc1a1753 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d8cfd4508f741259f67187fe2718218" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 35203 } } peers { permanent_uuid: "366244d5f3b44caea819a927fa53d79a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 39041 } } peers { permanent_uuid: "e07aad1b650745529d478e4bbc1a1753" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 46757 } }
I20260810 15:28:09.643543 11507 raft_consensus.cc:374] T 3380a02a618d4cd58984008c3d43c010 P e07aad1b650745529d478e4bbc1a1753 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:28:09.643591 11507 raft_consensus.cc:729] T 3380a02a618d4cd58984008c3d43c010 P e07aad1b650745529d478e4bbc1a1753 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e07aad1b650745529d478e4bbc1a1753, State: Initialized, Role: FOLLOWER
I20260810 15:28:09.643635 11507 consensus_queue.cc:260] T 3380a02a618d4cd58984008c3d43c010 P e07aad1b650745529d478e4bbc1a1753 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d8cfd4508f741259f67187fe2718218" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 35203 } } peers { permanent_uuid: "366244d5f3b44caea819a927fa53d79a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 39041 } } peers { permanent_uuid: "e07aad1b650745529d478e4bbc1a1753" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 46757 } }
I20260810 15:28:09.643728 11507 ts_tablet_manager.cc:1428] T 3380a02a618d4cd58984008c3d43c010 P e07aad1b650745529d478e4bbc1a1753: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260810 15:28:09.644217 11711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:09.639960 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.130:39041 (local address 127.0.0.1:42366)
0810 15:28:09.640008 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:09.640018 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 15:28:09.640055 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:28:09.640662 (+ 607us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:28:09.640663 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:28:09.640665 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:28:09.640701 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:28:09.640702 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:28:09.641971 (+ 1269us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:28:09.641972 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:28:09.643074 (+ 1102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:28:09.643077 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:28:09.643981 (+ 904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:28:09.643982 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:28:09.644044 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:09.644047 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 15:28:09.644107 (+ 60us) client_negotiation.cc:240] Negotiation successful
0810 15:28:09.644150 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260810 15:28:09.644238 12184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:09.640153 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42366 (local address 127.18.68.130:39041)
0810 15:28:09.640488 (+ 335us) server_negotiation.cc:206] Beginning negotiation
0810 15:28:09.640492 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 15:28:09.640501 (+ 9us) server_negotiation.cc:407] Connection header received
0810 15:28:09.640551 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:28:09.640553 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:28:09.640571 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:28:09.640648 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:28:09.640784 (+ 136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:09.641863 (+ 1079us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:09.643151 (+ 1288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:09.643879 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:09.643979 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:09.644047 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0810 15:28:09.644120 (+ 73us) server_negotiation.cc:299] Negotiation successful
0810 15:28:09.644159 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":302,"thread_start_us":109,"threads_started":1}
I20260810 15:28:09.644594 12181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:09.640008 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.131:35203 (local address 127.0.0.1:49680)
0810 15:28:09.640272 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:09.640283 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 15:28:09.640335 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:28:09.640924 (+ 589us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:28:09.640925 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:28:09.640927 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:28:09.640963 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:28:09.640965 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:28:09.641775 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:28:09.641776 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:28:09.643137 (+ 1361us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:28:09.643139 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:28:09.644318 (+ 1179us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:28:09.644319 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:28:09.644385 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:09.644389 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 15:28:09.644442 (+ 53us) client_negotiation.cc:240] Negotiation successful
0810 15:28:09.644492 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":246,"mutex_wait_us":63,"thread_start_us":110,"threads_started":1}
I20260810 15:28:09.644866 12186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:09.640259 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49680 (local address 127.18.68.131:35203)
0810 15:28:09.640781 (+ 522us) server_negotiation.cc:206] Beginning negotiation
0810 15:28:09.640785 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 15:28:09.640794 (+ 9us) server_negotiation.cc:407] Connection header received
0810 15:28:09.640825 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:28:09.640827 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:28:09.640845 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:28:09.640926 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:28:09.641018 (+ 92us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:09.641673 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:09.643224 (+ 1551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:09.644166 (+ 942us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:09.644226 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:09.644280 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0810 15:28:09.644762 (+ 482us) server_negotiation.cc:299] Negotiation successful
0810 15:28:09.644801 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":488,"thread_start_us":110,"threads_started":1}
I20260810 15:28:09.645031 11836 tablet_service.cc:1467] Processing CreateTablet for tablet 3380a02a618d4cd58984008c3d43c010 (DEFAULT_TABLE table=test-table [id=c0a19a776524493b94abacd397be3a09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 15:28:09.645406 11836 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3380a02a618d4cd58984008c3d43c010. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:28:09.645325 12058 tablet_service.cc:1467] Processing CreateTablet for tablet 3380a02a618d4cd58984008c3d43c010 (DEFAULT_TABLE table=test-table [id=c0a19a776524493b94abacd397be3a09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 15:28:09.645604 12058 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3380a02a618d4cd58984008c3d43c010. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:28:09.647804 11980 tablet_bootstrap.cc:492] T 3380a02a618d4cd58984008c3d43c010 P 8d8cfd4508f741259f67187fe2718218: Bootstrap starting.
I20260810 15:28:09.648612 11980 tablet_bootstrap.cc:654] T 3380a02a618d4cd58984008c3d43c010 P 8d8cfd4508f741259f67187fe2718218: Neither blocks nor log segments found. Creating new log.
I20260810 15:28:09.648844 11980 log.cc:824] T 3380a02a618d4cd58984008c3d43c010 P 8d8cfd4508f741259f67187fe2718218: Log is configured to *not* fsync() on all Append() calls
I20260810 15:28:09.649065 12190 tablet_bootstrap.cc:492] T 3380a02a618d4cd58984008c3d43c010 P 366244d5f3b44caea819a927fa53d79a: Bootstrap starting.
I20260810 15:28:09.649621 12190 tablet_bootstrap.cc:654] T 3380a02a618d4cd58984008c3d43c010 P 366244d5f3b44caea819a927fa53d79a: Neither blocks nor log segments found. Creating new log.
I20260810 15:28:09.650156 12190 log.cc:824] T 3380a02a618d4cd58984008c3d43c010 P 366244d5f3b44caea819a927fa53d79a: Log is configured to *not* fsync() on all Append() calls
I20260810 15:28:09.650673 11980 tablet_bootstrap.cc:492] T 3380a02a618d4cd58984008c3d43c010 P 8d8cfd4508f741259f67187fe2718218: No bootstrap required, opened a new log
I20260810 15:28:09.650727 11980 ts_tablet_manager.cc:1397] T 3380a02a618d4cd58984008c3d43c010 P 8d8cfd4508f741259f67187fe2718218: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260810 15:28:09.650887 12190 tablet_bootstrap.cc:492] T 3380a02a618d4cd58984008c3d43c010 P 366244d5f3b44caea819a927fa53d79a: No bootstrap required, opened a new log
I20260810 15:28:09.650966 12190 ts_tablet_manager.cc:1397] T 3380a02a618d4cd58984008c3d43c010 P 366244d5f3b44caea819a927fa53d79a: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260810 15:28:09.652262 11980 raft_consensus.cc:348] T 3380a02a618d4cd58984008c3d43c010 P 8d8cfd4508f741259f67187fe2718218 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d8cfd4508f741259f67187fe2718218" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 35203 } } peers { permanent_uuid: "366244d5f3b44caea819a927fa53d79a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 39041 } } peers { permanent_uuid: "e07aad1b650745529d478e4bbc1a1753" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 46757 } }
I20260810 15:28:09.652387 11980 raft_consensus.cc:374] T 3380a02a618d4cd58984008c3d43c010 P 8d8cfd4508f741259f67187fe2718218 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:28:09.652410 11980 raft_consensus.cc:729] T 3380a02a618d4cd58984008c3d43c010 P 8d8cfd4508f741259f67187fe2718218 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d8cfd4508f741259f67187fe2718218, State: Initialized, Role: FOLLOWER
I20260810 15:28:09.652400 12190 raft_consensus.cc:348] T 3380a02a618d4cd58984008c3d43c010 P 366244d5f3b44caea819a927fa53d79a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d8cfd4508f741259f67187fe2718218" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 35203 } } peers { permanent_uuid: "366244d5f3b44caea819a927fa53d79a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 39041 } } peers { permanent_uuid: "e07aad1b650745529d478e4bbc1a1753" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 46757 } }
I20260810 15:28:09.652526 11980 consensus_queue.cc:260] T 3380a02a618d4cd58984008c3d43c010 P 8d8cfd4508f741259f67187fe2718218 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d8cfd4508f741259f67187fe2718218" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 35203 } } peers { permanent_uuid: "366244d5f3b44caea819a927fa53d79a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 39041 } } peers { permanent_uuid: "e07aad1b650745529d478e4bbc1a1753" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 46757 } }
I20260810 15:28:09.652565 12190 raft_consensus.cc:374] T 3380a02a618d4cd58984008c3d43c010 P 366244d5f3b44caea819a927fa53d79a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:28:09.652606 12190 raft_consensus.cc:729] T 3380a02a618d4cd58984008c3d43c010 P 366244d5f3b44caea819a927fa53d79a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 366244d5f3b44caea819a927fa53d79a, State: Initialized, Role: FOLLOWER
I20260810 15:28:09.652720 12190 consensus_queue.cc:260] T 3380a02a618d4cd58984008c3d43c010 P 366244d5f3b44caea819a927fa53d79a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d8cfd4508f741259f67187fe2718218" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 35203 } } peers { permanent_uuid: "366244d5f3b44caea819a927fa53d79a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 39041 } } peers { permanent_uuid: "e07aad1b650745529d478e4bbc1a1753" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 46757 } }
I20260810 15:28:09.652787 11980 ts_tablet_manager.cc:1428] T 3380a02a618d4cd58984008c3d43c010 P 8d8cfd4508f741259f67187fe2718218: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 15:28:09.652848 12174 heartbeater.cc:503] Master 127.18.68.190:42059 was elected leader, sending a full tablet report...
I20260810 15:28:09.653108 11939 heartbeater.cc:503] Master 127.18.68.190:42059 was elected leader, sending a full tablet report...
I20260810 15:28:09.653479 12190 ts_tablet_manager.cc:1428] T 3380a02a618d4cd58984008c3d43c010 P 366244d5f3b44caea819a927fa53d79a: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
W20260810 15:28:09.732435 11940 tablet.cc:2369] T 3380a02a618d4cd58984008c3d43c010 P 366244d5f3b44caea819a927fa53d79a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 15:28:09.845824 11702 tablet.cc:2369] T 3380a02a618d4cd58984008c3d43c010 P e07aad1b650745529d478e4bbc1a1753: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 15:28:09.869918 12175 tablet.cc:2369] T 3380a02a618d4cd58984008c3d43c010 P 8d8cfd4508f741259f67187fe2718218: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 15:28:09.890542 12194 raft_consensus.cc:482] T 3380a02a618d4cd58984008c3d43c010 P 8d8cfd4508f741259f67187fe2718218 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 15:28:09.890686 12194 raft_consensus.cc:504] T 3380a02a618d4cd58984008c3d43c010 P 8d8cfd4508f741259f67187fe2718218 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d8cfd4508f741259f67187fe2718218" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 35203 } } peers { permanent_uuid: "366244d5f3b44caea819a927fa53d79a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 39041 } } peers { permanent_uuid: "e07aad1b650745529d478e4bbc1a1753" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 46757 } }
I20260810 15:28:09.891130 12194 leader_election.cc:288] T 3380a02a618d4cd58984008c3d43c010 P 8d8cfd4508f741259f67187fe2718218 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 366244d5f3b44caea819a927fa53d79a (127.18.68.130:39041), e07aad1b650745529d478e4bbc1a1753 (127.18.68.129:46757)
I20260810 15:28:09.894347 12184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:09.891472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.131:60023 (local address 127.18.68.130:39041)
0810 15:28:09.891522 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0810 15:28:09.891524 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:28:09.891535 (+ 11us) server_negotiation.cc:407] Connection header received
0810 15:28:09.891569 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:28:09.891570 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:28:09.891580 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:28:09.891651 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:28:09.891793 (+ 142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:09.892401 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:09.893449 (+ 1048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:09.893937 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:09.894019 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:09.894028 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0810 15:28:09.894241 (+ 213us) server_negotiation.cc:299] Negotiation successful
0810 15:28:09.894280 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260810 15:28:09.894348 12176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:09.891328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.130:39041 (local address 127.18.68.131:60023)
0810 15:28:09.891385 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:09.891398 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 15:28:09.891453 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:28:09.891658 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:28:09.891659 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:28:09.891661 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:28:09.891724 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:28:09.891726 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:28:09.892481 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:28:09.892482 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:28:09.893353 (+ 871us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:28:09.893356 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:28:09.894028 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:28:09.894030 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:28:09.894149 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:09.894153 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 15:28:09.894233 (+ 80us) client_negotiation.cc:240] Negotiation successful
0810 15:28:09.894272 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33,"mutex_wait_us":20}
I20260810 15:28:09.894472 12199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:09.891332 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.129:46757 (local address 127.18.68.131:53593)
0810 15:28:09.891573 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:09.891585 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 15:28:09.891646 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:28:09.891887 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:28:09.891888 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:28:09.891890 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:28:09.891962 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:28:09.891963 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:28:09.892691 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:28:09.892692 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:28:09.893432 (+ 740us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:28:09.893434 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:28:09.894157 (+ 723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:28:09.894158 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:28:09.894234 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:09.894237 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 15:28:09.894311 (+ 74us) client_negotiation.cc:240] Negotiation successful
0810 15:28:09.894351 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":225,"mutex_wait_us":83,"thread_start_us":124,"threads_started":1}
I20260810 15:28:09.894666 12197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:09.891421 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.131:53593 (local address 127.18.68.129:46757)
0810 15:28:09.891583 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0810 15:28:09.891585 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:28:09.891784 (+ 199us) server_negotiation.cc:407] Connection header received
0810 15:28:09.891809 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:28:09.891810 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:28:09.891820 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:28:09.891868 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:28:09.892034 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:09.892577 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:09.893525 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:09.894025 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:09.894157 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:09.894166 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0810 15:28:09.894318 (+ 152us) server_negotiation.cc:299] Negotiation successful
0810 15:28:09.894359 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":72,"threads_started":1}
I20260810 15:28:09.894701 11868 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3380a02a618d4cd58984008c3d43c010" candidate_uuid: "8d8cfd4508f741259f67187fe2718218" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "366244d5f3b44caea819a927fa53d79a" is_pre_election: true
I20260810 15:28:09.894847 11868 raft_consensus.cc:2454] T 3380a02a618d4cd58984008c3d43c010 P 366244d5f3b44caea819a927fa53d79a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d8cfd4508f741259f67187fe2718218 in term 0.
I20260810 15:28:09.894940 11620 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3380a02a618d4cd58984008c3d43c010" candidate_uuid: "8d8cfd4508f741259f67187fe2718218" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e07aad1b650745529d478e4bbc1a1753" is_pre_election: true
I20260810 15:28:09.895093 11972 leader_election.cc:302] T 3380a02a618d4cd58984008c3d43c010 P 8d8cfd4508f741259f67187fe2718218 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 366244d5f3b44caea819a927fa53d79a, 8d8cfd4508f741259f67187fe2718218; no voters:
I20260810 15:28:09.895110 11620 raft_consensus.cc:2454] T 3380a02a618d4cd58984008c3d43c010 P e07aad1b650745529d478e4bbc1a1753 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d8cfd4508f741259f67187fe2718218 in term 0.
I20260810 15:28:09.895247 12194 raft_consensus.cc:2781] T 3380a02a618d4cd58984008c3d43c010 P 8d8cfd4508f741259f67187fe2718218 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 15:28:09.895328 12194 raft_consensus.cc:482] T 3380a02a618d4cd58984008c3d43c010 P 8d8cfd4508f741259f67187fe2718218 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 15:28:09.895355 12194 raft_consensus.cc:3037] T 3380a02a618d4cd58984008c3d43c010 P 8d8cfd4508f741259f67187fe2718218 [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:28:09.896163 12194 raft_consensus.cc:504] T 3380a02a618d4cd58984008c3d43c010 P 8d8cfd4508f741259f67187fe2718218 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d8cfd4508f741259f67187fe2718218" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 35203 } } peers { permanent_uuid: "366244d5f3b44caea819a927fa53d79a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 39041 } } peers { permanent_uuid: "e07aad1b650745529d478e4bbc1a1753" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 46757 } }
I20260810 15:28:09.896313 12194 leader_election.cc:288] T 3380a02a618d4cd58984008c3d43c010 P 8d8cfd4508f741259f67187fe2718218 [CANDIDATE]: Term 1 election: Requested vote from peers 366244d5f3b44caea819a927fa53d79a (127.18.68.130:39041), e07aad1b650745529d478e4bbc1a1753 (127.18.68.129:46757)
I20260810 15:28:09.896477 11868 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3380a02a618d4cd58984008c3d43c010" candidate_uuid: "8d8cfd4508f741259f67187fe2718218" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "366244d5f3b44caea819a927fa53d79a"
I20260810 15:28:09.896468 11620 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3380a02a618d4cd58984008c3d43c010" candidate_uuid: "8d8cfd4508f741259f67187fe2718218" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e07aad1b650745529d478e4bbc1a1753"
I20260810 15:28:09.896557 11868 raft_consensus.cc:3037] T 3380a02a618d4cd58984008c3d43c010 P 366244d5f3b44caea819a927fa53d79a [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:28:09.896566 11620 raft_consensus.cc:3037] T 3380a02a618d4cd58984008c3d43c010 P e07aad1b650745529d478e4bbc1a1753 [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:28:09.897445 11868 raft_consensus.cc:2454] T 3380a02a618d4cd58984008c3d43c010 P 366244d5f3b44caea819a927fa53d79a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d8cfd4508f741259f67187fe2718218 in term 1.
I20260810 15:28:09.897444 11620 raft_consensus.cc:2454] T 3380a02a618d4cd58984008c3d43c010 P e07aad1b650745529d478e4bbc1a1753 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d8cfd4508f741259f67187fe2718218 in term 1.
I20260810 15:28:09.897652 11968 leader_election.cc:302] T 3380a02a618d4cd58984008c3d43c010 P 8d8cfd4508f741259f67187fe2718218 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d8cfd4508f741259f67187fe2718218, e07aad1b650745529d478e4bbc1a1753; no voters:
I20260810 15:28:09.897755 12194 raft_consensus.cc:2781] T 3380a02a618d4cd58984008c3d43c010 P 8d8cfd4508f741259f67187fe2718218 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 15:28:09.897903 12194 raft_consensus.cc:686] T 3380a02a618d4cd58984008c3d43c010 P 8d8cfd4508f741259f67187fe2718218 [term 1 LEADER]: Becoming Leader. State: Replica: 8d8cfd4508f741259f67187fe2718218, State: Running, Role: LEADER
I20260810 15:28:09.897982 12194 consensus_queue.cc:237] T 3380a02a618d4cd58984008c3d43c010 P 8d8cfd4508f741259f67187fe2718218 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d8cfd4508f741259f67187fe2718218" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 35203 } } peers { permanent_uuid: "366244d5f3b44caea819a927fa53d79a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 39041 } } peers { permanent_uuid: "e07aad1b650745529d478e4bbc1a1753" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 46757 } }
I20260810 15:28:09.898857 11356 catalog_manager.cc:5495] T 3380a02a618d4cd58984008c3d43c010 P 8d8cfd4508f741259f67187fe2718218 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8d8cfd4508f741259f67187fe2718218 (127.18.68.131). New cstate: current_term: 1 leader_uuid: "8d8cfd4508f741259f67187fe2718218" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d8cfd4508f741259f67187fe2718218" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 35203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "366244d5f3b44caea819a927fa53d79a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 39041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e07aad1b650745529d478e4bbc1a1753" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 46757 } health_report { overall_health: UNKNOWN } } }
I20260810 15:28:09.933238 12186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:09.930823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49684 (local address 127.18.68.131:35203)
0810 15:28:09.930890 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0810 15:28:09.930892 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:28:09.930902 (+ 10us) server_negotiation.cc:407] Connection header received
0810 15:28:09.930957 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:28:09.930958 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:28:09.930977 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:28:09.931056 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 15:28:09.931197 (+ 141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:09.931669 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:09.932408 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:09.932605 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:09.932687 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:09.932864 (+ 177us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 15:28:09.932972 (+ 108us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 15:28:09.933070 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0810 15:28:09.933090 (+ 20us) server_negotiation.cc:299] Negotiation successful
0810 15:28:09.933119 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260810 15:28:09.935382 11868 raft_consensus.cc:1261] T 3380a02a618d4cd58984008c3d43c010 P 366244d5f3b44caea819a927fa53d79a [term 1 FOLLOWER]: Refusing update from remote peer 8d8cfd4508f741259f67187fe2718218: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 15:28:09.935401 11620 raft_consensus.cc:1261] T 3380a02a618d4cd58984008c3d43c010 P e07aad1b650745529d478e4bbc1a1753 [term 1 FOLLOWER]: Refusing update from remote peer 8d8cfd4508f741259f67187fe2718218: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 15:28:09.935832 12200 consensus_queue.cc:1035] T 3380a02a618d4cd58984008c3d43c010 P 8d8cfd4508f741259f67187fe2718218 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e07aad1b650745529d478e4bbc1a1753" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 46757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 15:28:09.936050 12194 consensus_queue.cc:1035] T 3380a02a618d4cd58984008c3d43c010 P 8d8cfd4508f741259f67187fe2718218 [LEADER]: Connected to new peer: Peer: permanent_uuid: "366244d5f3b44caea819a927fa53d79a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 39041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 15:28:09.938421 12209 mvcc.cc:205] Tried to move back new op lower bound from 7316994825972195328 to 7316994825822863360. Current Snapshot: MvccSnapshot[applied={T|T < 7316994825972195328}]
I20260810 15:28:09.941186 11357 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:35042:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 15:28:09.941301 11357 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:35042:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 15:28:09.942127 11357 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a99445ac89234308a23266d8febb1d03: Sending DeleteTablet for 3 replicas of tablet 3380a02a618d4cd58984008c3d43c010
I20260810 15:28:09.942488 11836 tablet_service.cc:1514] Processing DeleteTablet for tablet 3380a02a618d4cd58984008c3d43c010 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 15:28:09 UTC) from {username='kudu', principal='kudu/127.18.68.190@KRBTEST.COM'} at 127.0.0.1:42366
I20260810 15:28:09.942556 12058 tablet_service.cc:1514] Processing DeleteTablet for tablet 3380a02a618d4cd58984008c3d43c010 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 15:28:09 UTC) from {username='kudu', principal='kudu/127.18.68.190@KRBTEST.COM'} at 127.0.0.1:49680
I20260810 15:28:09.942572 11585 tablet_service.cc:1514] Processing DeleteTablet for tablet 3380a02a618d4cd58984008c3d43c010 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 15:28:09 UTC) from {username='kudu', principal='kudu/127.18.68.190@KRBTEST.COM'} at 127.0.0.1:37890
I20260810 15:28:09.942922 12225 tablet_replica.cc:330] T 3380a02a618d4cd58984008c3d43c010 P 366244d5f3b44caea819a927fa53d79a: stopping tablet replica
I20260810 15:28:09.942945 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 11436
I20260810 15:28:09.943046 12225 raft_consensus.cc:2229] T 3380a02a618d4cd58984008c3d43c010 P 366244d5f3b44caea819a927fa53d79a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 15:28:09.943164 12225 raft_consensus.cc:2258] T 3380a02a618d4cd58984008c3d43c010 P 366244d5f3b44caea819a927fa53d79a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 15:28:09.952991 12225 ts_tablet_manager.cc:1905] T 3380a02a618d4cd58984008c3d43c010 P 366244d5f3b44caea819a927fa53d79a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 15:28:09.954574 12228 tablet_replica.cc:330] T 3380a02a618d4cd58984008c3d43c010 P 8d8cfd4508f741259f67187fe2718218: stopping tablet replica
I20260810 15:28:09.954741 12228 raft_consensus.cc:2229] T 3380a02a618d4cd58984008c3d43c010 P 8d8cfd4508f741259f67187fe2718218 [term 1 LEADER]: Raft consensus shutting down.
I20260810 15:28:09.954886 12228 raft_consensus.cc:2258] T 3380a02a618d4cd58984008c3d43c010 P 8d8cfd4508f741259f67187fe2718218 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 15:28:09.955355 12225 ts_tablet_manager.cc:1918] T 3380a02a618d4cd58984008c3d43c010 P 366244d5f3b44caea819a927fa53d79a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 15:28:09.955510 12225 log.cc:1196] T 3380a02a618d4cd58984008c3d43c010 P 366244d5f3b44caea819a927fa53d79a: Deleting WAL directory at /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-1/wal/wals/3380a02a618d4cd58984008c3d43c010
I20260810 15:28:09.955960 12225 ts_tablet_manager.cc:1939] T 3380a02a618d4cd58984008c3d43c010 P 366244d5f3b44caea819a927fa53d79a: Deleting consensus metadata
I20260810 15:28:09.956599 11332 catalog_manager.cc:4841] TS 366244d5f3b44caea819a927fa53d79a (127.18.68.130:39041): tablet 3380a02a618d4cd58984008c3d43c010 (table test-table [id=c0a19a776524493b94abacd397be3a09]) successfully deleted
I20260810 15:28:09.957417 12228 ts_tablet_manager.cc:1905] T 3380a02a618d4cd58984008c3d43c010 P 8d8cfd4508f741259f67187fe2718218: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 15:28:09.959764 12228 ts_tablet_manager.cc:1918] T 3380a02a618d4cd58984008c3d43c010 P 8d8cfd4508f741259f67187fe2718218: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 15:28:09.959844 12228 log.cc:1196] T 3380a02a618d4cd58984008c3d43c010 P 8d8cfd4508f741259f67187fe2718218: Deleting WAL directory at /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-2/wal/wals/3380a02a618d4cd58984008c3d43c010
I20260810 15:28:09.960101 12228 ts_tablet_manager.cc:1939] T 3380a02a618d4cd58984008c3d43c010 P 8d8cfd4508f741259f67187fe2718218: Deleting consensus metadata
I20260810 15:28:09.960598 11334 catalog_manager.cc:4841] TS 8d8cfd4508f741259f67187fe2718218 (127.18.68.131:35203): tablet 3380a02a618d4cd58984008c3d43c010 (table test-table [id=c0a19a776524493b94abacd397be3a09]) successfully deleted
W20260810 15:28:09.962239 11330 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.18.68.129:46757 (error 108)
I20260810 15:28:09.962752 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 11707
I20260810 15:28:09.962872 12181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:09.962702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.129:46757 (local address 127.0.0.1:37902)
0810 15:28:09.962779 (+ 77us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:09.962829 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.129:46757: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260810 15:28:09.969213 11330 catalog_manager.cc:4584] TS e07aad1b650745529d478e4bbc1a1753 (127.18.68.129:46757): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 3380a02a618d4cd58984008c3d43c010: Network error: Client connection negotiation failed: client connection to 127.18.68.129:46757: connect: Connection refused (error 111)
I20260810 15:28:09.975394 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 11942
I20260810 15:28:10.002473 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 11307
I20260810 15:28:10.021886 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.190:42059
--webserver_interface=127.18.68.190
--webserver_port=37927
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab
--principal=kudu/127.18.68.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:44607
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.68.190:42059
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:28:10.104602 12232 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:28:10.104862 12232 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:28:10.104903 12232 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:28:10.106103 12232 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 15:28:10.106182 12232 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:28:10.106206 12232 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:28:10.106228 12232 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 15:28:10.106256 12232 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 15:28:10.107822 12232 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:44607
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.68.190:42059
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab
--principal=kudu/127.18.68.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.190:42059
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.68.190
--webserver_port=37927
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12232
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:28:10.108100 12232 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:28:10.108343 12232 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:28:10.113371 12244 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:28:10.113456 12246 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:28:10.113384 12249 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:28:10.113739 12232 server_base.cc:1034] running on GCE node
I20260810 15:28:10.113998 12232 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:28:10.114377 12232 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:28:10.115540 12232 hybrid_clock.cc:648] HybridClock initialized: now 1786375690115528 us; error 42 us; skew 500 ppm
Aug 10 15:28:10 dist-test-slave-2p8l krb5kdc[10371](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375690, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:28:10.118206 12232 init.cc:377] Logged in from keytab as kudu/127.18.68.190@KRBTEST.COM (short username kudu)
I20260810 15:28:10.118698 12232 webserver.cc:460] Webserver started at http://127.18.68.190:37927/ using document root <none> and password file <none>
I20260810 15:28:10.118952 12232 fs_manager.cc:359] Metadata directory not provided
I20260810 15:28:10.119019 12232 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:28:10.120379 12232 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:28:10.121070 12258 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:28:10.121261 12232 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260810 15:28:10.121366 12232 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/master-0/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/master-0/wal
uuid: "a99445ac89234308a23266d8febb1d03"
format_stamp: "Formatted at 2026-08-10 15:28:08 on dist-test-slave-2p8l"
server_key: "9c039938d2684d51a9007029b17a58ad"
server_key_iv: "c0c0e9431248c031453cf5d98942ca5c"
server_key_version: "encryptionkey@0"
I20260810 15:28:10.121728 12232 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:28:10.134414 12232 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:28:10.136656 12232 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:28:10.136823 12232 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:28:10.141036 12232 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.190:42059
I20260810 15:28:10.141074 12359 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.190:42059 every 8 connection(s)
I20260810 15:28:10.141469 12232 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
I20260810 15:28:10.143095 12365 sys_catalog.cc:263] Verifying existing consensus state
I20260810 15:28:10.143780 12365 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a99445ac89234308a23266d8febb1d03: Bootstrap starting.
I20260810 15:28:10.147804 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 12232
I20260810 15:28:10.148115 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.68.129:46757
--local_ip_for_outbound_sockets=127.18.68.129
--tserver_master_addrs=127.18.68.190:42059
--webserver_port=33967
--webserver_interface=127.18.68.129
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.129.keytab
--principal=kudu/127.18.68.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:44607
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 15:28:10.153427 12365 log.cc:824] T 00000000000000000000000000000000 P a99445ac89234308a23266d8febb1d03: Log is configured to *not* fsync() on all Append() calls
I20260810 15:28:10.156962 12365 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a99445ac89234308a23266d8febb1d03: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 15:28:10.157336 12365 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a99445ac89234308a23266d8febb1d03: Bootstrap complete.
I20260810 15:28:10.161430 12365 raft_consensus.cc:348] T 00000000000000000000000000000000 P a99445ac89234308a23266d8febb1d03 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a99445ac89234308a23266d8febb1d03" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 42059 } }
I20260810 15:28:10.161737 12365 raft_consensus.cc:729] T 00000000000000000000000000000000 P a99445ac89234308a23266d8febb1d03 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: a99445ac89234308a23266d8febb1d03, State: Initialized, Role: FOLLOWER
I20260810 15:28:10.161891 12365 consensus_queue.cc:260] T 00000000000000000000000000000000 P a99445ac89234308a23266d8febb1d03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a99445ac89234308a23266d8febb1d03" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 42059 } }
I20260810 15:28:10.161953 12365 raft_consensus.cc:388] T 00000000000000000000000000000000 P a99445ac89234308a23266d8febb1d03 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 15:28:10.161990 12365 raft_consensus.cc:482] T 00000000000000000000000000000000 P a99445ac89234308a23266d8febb1d03 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 15:28:10.162034 12365 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a99445ac89234308a23266d8febb1d03 [term 2 FOLLOWER]: Advancing to term 3
I20260810 15:28:10.163365 12365 raft_consensus.cc:504] T 00000000000000000000000000000000 P a99445ac89234308a23266d8febb1d03 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a99445ac89234308a23266d8febb1d03" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 42059 } }
I20260810 15:28:10.163478 12365 leader_election.cc:302] T 00000000000000000000000000000000 P a99445ac89234308a23266d8febb1d03 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a99445ac89234308a23266d8febb1d03; no voters:
I20260810 15:28:10.163640 12365 leader_election.cc:288] T 00000000000000000000000000000000 P a99445ac89234308a23266d8febb1d03 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260810 15:28:10.163710 12369 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a99445ac89234308a23266d8febb1d03 [term 3 FOLLOWER]: Leader election won for term 3
I20260810 15:28:10.163882 12369 raft_consensus.cc:686] T 00000000000000000000000000000000 P a99445ac89234308a23266d8febb1d03 [term 3 LEADER]: Becoming Leader. State: Replica: a99445ac89234308a23266d8febb1d03, State: Running, Role: LEADER
I20260810 15:28:10.163903 12365 sys_catalog.cc:564] T 00000000000000000000000000000000 P a99445ac89234308a23266d8febb1d03 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 15:28:10.164023 12369 consensus_queue.cc:237] T 00000000000000000000000000000000 P a99445ac89234308a23266d8febb1d03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a99445ac89234308a23266d8febb1d03" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 42059 } }
I20260810 15:28:10.164318 12372 sys_catalog.cc:455] T 00000000000000000000000000000000 P a99445ac89234308a23266d8febb1d03 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "a99445ac89234308a23266d8febb1d03" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a99445ac89234308a23266d8febb1d03" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 42059 } } }
I20260810 15:28:10.164408 12372 sys_catalog.cc:458] T 00000000000000000000000000000000 P a99445ac89234308a23266d8febb1d03 [sys.catalog]: This master's current role is: LEADER
I20260810 15:28:10.164706 12373 sys_catalog.cc:455] T 00000000000000000000000000000000 P a99445ac89234308a23266d8febb1d03 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a99445ac89234308a23266d8febb1d03. Latest consensus state: current_term: 3 leader_uuid: "a99445ac89234308a23266d8febb1d03" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a99445ac89234308a23266d8febb1d03" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 42059 } } }
I20260810 15:28:10.164855 12373 sys_catalog.cc:458] T 00000000000000000000000000000000 P a99445ac89234308a23266d8febb1d03 [sys.catalog]: This master's current role is: LEADER
I20260810 15:28:10.164994 12385 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 15:28:10.165772 12385 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 15:28:10.165910 12385 catalog_manager.cc:1259] Loaded cluster ID: 8653322e7ebc4a1dba61902fd0d83b8f
I20260810 15:28:10.165964 12385 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260810 15:28:10.166275 12385 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f361e8949ad google::LogMessage::Fail() at ??:0
@ 0x7f361e89788a google::LogMessage::SendToLog() at ??:0
@ 0x7f361e8944de google::LogMessage::Flush() at ??:0
@ 0x7f361e895a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f36267b50f1 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7f36267be8b9 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f36207620d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f3620757954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f36215bb6db start_thread at ??:0
@ 0x7f361d39261f clone at ??:0
W20260810 15:28:10.246413 12367 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:28:10.246649 12367 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:28:10.246690 12367 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:28:10.247815 12367 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:28:10.247876 12367 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:28:10.247916 12367 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.68.129
I20260810 15:28:10.249367 12367 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:44607
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.129.keytab
--principal=kudu/127.18.68.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.68.129:46757
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.68.129
--webserver_port=33967
--tserver_master_addrs=127.18.68.190:42059
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12367
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.68.129
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:28:10.249652 12367 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:28:10.249884 12367 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:28:10.254951 12440 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:28:10.255077 12435 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:28:10.254951 12433 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:28:10.255287 12367 server_base.cc:1034] running on GCE node
I20260810 15:28:10.255481 12367 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:28:10.255735 12367 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:28:10.256912 12367 hybrid_clock.cc:648] HybridClock initialized: now 1786375690256897 us; error 27 us; skew 500 ppm
Aug 10 15:28:10 dist-test-slave-2p8l krb5kdc[10371](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375690, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:28:10.260039 12367 init.cc:377] Logged in from keytab as kudu/127.18.68.129@KRBTEST.COM (short username kudu)
I20260810 15:28:10.260548 12367 webserver.cc:460] Webserver started at http://127.18.68.129:33967/ using document root <none> and password file <none>
I20260810 15:28:10.260815 12367 fs_manager.cc:359] Metadata directory not provided
I20260810 15:28:10.260885 12367 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:28:10.262344 12367 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260810 15:28:10.263077 12450 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:28:10.263275 12367 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260810 15:28:10.263373 12367 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-0/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-0/wal
uuid: "e07aad1b650745529d478e4bbc1a1753"
format_stamp: "Formatted at 2026-08-10 15:28:08 on dist-test-slave-2p8l"
server_key: "a9752259256d82fc264814509ff54439"
server_key_iv: "664ec311721337bf9a6307a782191604"
server_key_version: "encryptionkey@0"
I20260810 15:28:10.263723 12367 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:28:10.275375 12367 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:28:10.277664 12367 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:28:10.277824 12367 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:28:10.278152 12367 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 15:28:10.278607 12466 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260810 15:28:10.280593 12367 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260810 15:28:10.280658 12367 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260810 15:28:10.280695 12367 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260810 15:28:10.281373 12367 ts_tablet_manager.cc:610] Registered 1 tablets
I20260810 15:28:10.281426 12367 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260810 15:28:10.281581 12466 tablet_bootstrap.cc:492] T 3380a02a618d4cd58984008c3d43c010 P e07aad1b650745529d478e4bbc1a1753: Bootstrap starting.
I20260810 15:28:10.289279 12367 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.129:46757
I20260810 15:28:10.289397 12638 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.129:46757 every 8 connection(s)
I20260810 15:28:10.289772 12367 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-0/data/info.pb
I20260810 15:28:10.293569 12466 log.cc:824] T 3380a02a618d4cd58984008c3d43c010 P e07aad1b650745529d478e4bbc1a1753: Log is configured to *not* fsync() on all Append() calls
I20260810 15:28:10.295280 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 12367
I20260810 15:28:10.295670 12466 tablet_bootstrap.cc:492] T 3380a02a618d4cd58984008c3d43c010 P e07aad1b650745529d478e4bbc1a1753: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 15:28:10.295656 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.68.130:39041
--local_ip_for_outbound_sockets=127.18.68.130
--tserver_master_addrs=127.18.68.190:42059
--webserver_port=36719
--webserver_interface=127.18.68.130
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.130.keytab
--principal=kudu/127.18.68.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:44607
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 15:28:10.295993 12466 tablet_bootstrap.cc:492] T 3380a02a618d4cd58984008c3d43c010 P e07aad1b650745529d478e4bbc1a1753: Bootstrap complete.
I20260810 15:28:10.296972 12466 ts_tablet_manager.cc:1397] T 3380a02a618d4cd58984008c3d43c010 P e07aad1b650745529d478e4bbc1a1753: Time spent bootstrapping tablet: real 0.016s user 0.007s sys 0.005s
I20260810 15:28:10.298364 12466 raft_consensus.cc:348] T 3380a02a618d4cd58984008c3d43c010 P e07aad1b650745529d478e4bbc1a1753 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d8cfd4508f741259f67187fe2718218" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 35203 } } peers { permanent_uuid: "366244d5f3b44caea819a927fa53d79a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 39041 } } peers { permanent_uuid: "e07aad1b650745529d478e4bbc1a1753" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 46757 } }
I20260810 15:28:10.298731 12466 raft_consensus.cc:729] T 3380a02a618d4cd58984008c3d43c010 P e07aad1b650745529d478e4bbc1a1753 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e07aad1b650745529d478e4bbc1a1753, State: Initialized, Role: FOLLOWER
I20260810 15:28:10.298884 12466 consensus_queue.cc:260] T 3380a02a618d4cd58984008c3d43c010 P e07aad1b650745529d478e4bbc1a1753 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d8cfd4508f741259f67187fe2718218" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 35203 } } peers { permanent_uuid: "366244d5f3b44caea819a927fa53d79a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 39041 } } peers { permanent_uuid: "e07aad1b650745529d478e4bbc1a1753" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 46757 } }
I20260810 15:28:10.299155 12466 ts_tablet_manager.cc:1428] T 3380a02a618d4cd58984008c3d43c010 P e07aad1b650745529d478e4bbc1a1753: Time spent starting tablet: real 0.002s user 0.002s sys 0.003s
W20260810 15:28:10.402230 12649 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:28:10.402477 12649 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:28:10.402532 12649 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:28:10.403818 12649 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:28:10.403888 12649 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:28:10.403939 12649 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.68.130
I20260810 15:28:10.405583 12649 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:44607
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.130.keytab
--principal=kudu/127.18.68.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.68.130:39041
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.68.130
--webserver_port=36719
--tserver_master_addrs=127.18.68.190:42059
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12649
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.68.130
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:28:10.405856 12649 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:28:10.406164 12649 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:28:10.411728 12660 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:28:10.411857 12649 server_base.cc:1034] running on GCE node
W20260810 15:28:10.411897 12665 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:28:10.411767 12661 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:28:10.412148 12649 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:28:10.412405 12649 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:28:10.413612 12649 hybrid_clock.cc:648] HybridClock initialized: now 1786375690413609 us; error 50 us; skew 500 ppm
Aug 10 15:28:10 dist-test-slave-2p8l krb5kdc[10371](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375690, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:28:10.416870 12649 init.cc:377] Logged in from keytab as kudu/127.18.68.130@KRBTEST.COM (short username kudu)
I20260810 15:28:10.418773 12649 webserver.cc:460] Webserver started at http://127.18.68.130:36719/ using document root <none> and password file <none>
I20260810 15:28:10.419078 12649 fs_manager.cc:359] Metadata directory not provided
I20260810 15:28:10.419160 12649 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:28:10.421101 12649 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.001s
I20260810 15:28:10.421875 12679 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:28:10.422107 12649 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:28:10.422205 12649 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-1/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-1/wal
uuid: "366244d5f3b44caea819a927fa53d79a"
format_stamp: "Formatted at 2026-08-10 15:28:08 on dist-test-slave-2p8l"
server_key: "171aec0cab8dedb1d87504913422f58e"
server_key_iv: "c4ca0d047445d756db2b280eae43f9b0"
server_key_version: "encryptionkey@0"
I20260810 15:28:10.422711 12649 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260810 15:28:10.424443 12645 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 15:28:10.290695 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42059 (local address 127.18.68.129:56275)
0810 15:28:10.290989 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:10.291066 (+ 77us) client_negotiation.cc:174] Beginning negotiation
0810 15:28:10.291706 (+ 640us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:28:10.424298 (+132592us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42059: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":118,"threads_started":1}
W20260810 15:28:10.424675 12641 heartbeater.cc:644] Failed to heartbeat to 127.18.68.190:42059 (0 consecutive failures): Network error: Failed to ping master at 127.18.68.190:42059: Client connection negotiation failed: client connection to 127.18.68.190:42059: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260810 15:28:10.425035 12645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:10.424927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42059 (local address 127.18.68.129:59813)
0810 15:28:10.424978 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:10.425018 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260810 15:28:10.425341 12645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:10.425254 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42059 (local address 127.18.68.129:51789)
0810 15:28:10.425296 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:10.425320 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260810 15:28:10.425444 12641 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260810 15:28:10.449290 12649 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:28:10.451829 12649 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:28:10.451994 12649 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:28:10.452262 12649 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 15:28:10.452590 12649 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 15:28:10.452646 12649 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 15:28:10.452692 12649 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 15:28:10.452728 12649 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 15:28:10.459481 12649 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.130:39041
I20260810 15:28:10.459532 12868 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.130:39041 every 8 connection(s)
I20260810 15:28:10.459909 12649 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-1/data/info.pb
I20260810 15:28:10.461071 12873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:10.460628 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42059 (local address 127.18.68.130:43285)
0810 15:28:10.460814 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:10.460917 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":75,"threads_started":1}
W20260810 15:28:10.461515 12871 heartbeater.cc:644] Failed to heartbeat to 127.18.68.190:42059 (0 consecutive failures): Network error: Failed to ping master at 127.18.68.190:42059: Client connection negotiation failed: client connection to 127.18.68.190:42059: connect: Connection refused (error 111)
I20260810 15:28:10.461838 12873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:10.461747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42059 (local address 127.18.68.130:54755)
0810 15:28:10.461791 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:10.461819 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260810 15:28:10.462098 12873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:10.462037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42059 (local address 127.18.68.130:44749)
0810 15:28:10.462068 (+ 31us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:10.462087 (+ 19us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":11}
W20260810 15:28:10.462251 12871 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260810 15:28:10.463415 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 12649
I20260810 15:28:10.463640 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.68.131:35203
--local_ip_for_outbound_sockets=127.18.68.131
--tserver_master_addrs=127.18.68.190:42059
--webserver_port=36565
--webserver_interface=127.18.68.131
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.131.keytab
--principal=kudu/127.18.68.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:44607
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:28:10.548411 12875 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:28:10.548664 12875 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:28:10.548709 12875 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:28:10.549890 12875 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:28:10.549957 12875 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:28:10.550004 12875 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.68.131
I20260810 15:28:10.551608 12875 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:44607
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.131.keytab
--principal=kudu/127.18.68.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.68.131:35203
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.68.131
--webserver_port=36565
--tserver_master_addrs=127.18.68.190:42059
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12875
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.68.131
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:28:10.551884 12875 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:28:10.552109 12875 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:28:10.557125 12888 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:28:10.557178 12892 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:28:10.557158 12886 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:28:10.557325 12875 server_base.cc:1034] running on GCE node
I20260810 15:28:10.557526 12875 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:28:10.557782 12875 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:28:10.558970 12875 hybrid_clock.cc:648] HybridClock initialized: now 1786375690558952 us; error 33 us; skew 500 ppm
Aug 10 15:28:10 dist-test-slave-2p8l krb5kdc[10371](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375690, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:28:10.561419 12875 init.cc:377] Logged in from keytab as kudu/127.18.68.131@KRBTEST.COM (short username kudu)
I20260810 15:28:10.561875 12875 webserver.cc:460] Webserver started at http://127.18.68.131:36565/ using document root <none> and password file <none>
I20260810 15:28:10.562175 12875 fs_manager.cc:359] Metadata directory not provided
I20260810 15:28:10.562225 12875 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:28:10.563508 12875 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:28:10.564127 12903 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:28:10.564330 12875 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 15:28:10.564438 12875 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-2/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-2/wal
uuid: "8d8cfd4508f741259f67187fe2718218"
format_stamp: "Formatted at 2026-08-10 15:28:08 on dist-test-slave-2p8l"
server_key: "f612ebb61de5810f7397a5b84a448a32"
server_key_iv: "bab7fae206c539665c2fd3531c066e9b"
server_key_version: "encryptionkey@0"
I20260810 15:28:10.564795 12875 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:28:10.581488 12875 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:28:10.583352 12875 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:28:10.583508 12875 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:28:10.583752 12875 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 15:28:10.584060 12875 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 15:28:10.584112 12875 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 15:28:10.584154 12875 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 15:28:10.584175 12875 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 15:28:10.590082 12875 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.131:35203
I20260810 15:28:10.590126 13085 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.131:35203 every 8 connection(s)
I20260810 15:28:10.590456 12875 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786375520124696-18706-0/minicluster-data/ts-2/data/info.pb
I20260810 15:28:10.591627 13092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:10.591198 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42059 (local address 127.18.68.131:48605)
0810 15:28:10.591380 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:10.591461 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":82,"threads_started":1}
W20260810 15:28:10.592015 13087 heartbeater.cc:644] Failed to heartbeat to 127.18.68.190:42059 (0 consecutive failures): Network error: Failed to ping master at 127.18.68.190:42059: Client connection negotiation failed: client connection to 127.18.68.190:42059: connect: Connection refused (error 111)
I20260810 15:28:10.592279 13092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:10.592209 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42059 (local address 127.18.68.131:54867)
0810 15:28:10.592238 (+ 29us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:10.592263 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":15}
I20260810 15:28:10.592514 13092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:10.592466 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42059 (local address 127.18.68.131:43177)
0810 15:28:10.592487 (+ 21us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:10.592503 (+ 16us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":12}
W20260810 15:28:10.592618 13087 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260810 15:28:10.599615 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 12875
I20260810 15:28:11.426028 13094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:11.425783 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42059 (local address 127.18.68.129:59955)
0810 15:28:11.425923 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:11.425960 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":67,"threads_started":1}
I20260810 15:28:11.462695 13097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:11.462507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42059 (local address 127.18.68.130:50761)
0810 15:28:11.462618 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:11.462646 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93,"thread_start_us":54,"threads_started":1}
I20260810 15:28:11.593145 13098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:11.592920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42059 (local address 127.18.68.131:41751)
0810 15:28:11.593040 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:11.593085 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":59,"threads_started":1}
I20260810 15:28:11.661470 13099 raft_consensus.cc:482] T 3380a02a618d4cd58984008c3d43c010 P e07aad1b650745529d478e4bbc1a1753 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 15:28:11.661629 13099 raft_consensus.cc:504] T 3380a02a618d4cd58984008c3d43c010 P e07aad1b650745529d478e4bbc1a1753 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d8cfd4508f741259f67187fe2718218" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 35203 } } peers { permanent_uuid: "366244d5f3b44caea819a927fa53d79a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 39041 } } peers { permanent_uuid: "e07aad1b650745529d478e4bbc1a1753" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 46757 } }
I20260810 15:28:11.661906 13099 leader_election.cc:288] T 3380a02a618d4cd58984008c3d43c010 P e07aad1b650745529d478e4bbc1a1753 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8d8cfd4508f741259f67187fe2718218 (127.18.68.131:35203), 366244d5f3b44caea819a927fa53d79a (127.18.68.130:39041)
Aug 10 15:28:11 dist-test-slave-2p8l krb5kdc[10371](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375690, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.129@KRBTEST.COM for kudu/127.18.68.131@KRBTEST.COM
Aug 10 15:28:11 dist-test-slave-2p8l krb5kdc[10371](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375690, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.129@KRBTEST.COM for kudu/127.18.68.130@KRBTEST.COM
I20260810 15:28:11.675493 13094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:11.662057 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.131:35203 (local address 127.18.68.129:53903)
0810 15:28:11.662136 (+ 79us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:11.662149 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 15:28:11.662237 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:28:11.663128 (+ 891us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:28:11.663130 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:28:11.663506 (+ 376us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:28:11.663684 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:28:11.663690 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:28:11.664765 (+ 1075us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:28:11.664766 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:28:11.665551 (+ 785us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:28:11.665553 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:28:11.666188 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:28:11.666189 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:28:11.666303 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:11.670261 (+ 3958us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:28:11.670279 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:28:11.671866 (+ 1587us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:28:11.673912 (+ 2046us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:28:11.673920 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:28:11.673922 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:28:11.674223 (+ 301us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:28:11.674482 (+ 259us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:28:11.674483 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:28:11.674483 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:28:11.674590 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:28:11.674958 (+ 368us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:28:11.674965 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:28:11.675096 (+ 131us) client_negotiation.cc:769] Sending connection context
0810 15:28:11.675199 (+ 103us) client_negotiation.cc:240] Negotiation successful
0810 15:28:11.675384 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":54,"mutex_wait_us":5}
I20260810 15:28:11.675510 13109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:11.662220 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.129:53903 (local address 127.18.68.131:35203)
0810 15:28:11.662406 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0810 15:28:11.662418 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 15:28:11.662452 (+ 34us) server_negotiation.cc:407] Connection header received
0810 15:28:11.662900 (+ 448us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:28:11.662903 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:28:11.662938 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:28:11.663088 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:28:11.663821 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:11.664658 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:11.665643 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:11.666032 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:11.666231 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:11.671982 (+ 5751us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:28:11.671986 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:28:11.671987 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:28:11.671996 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:28:11.673810 (+ 1814us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:28:11.674314 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:28:11.674317 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:28:11.674317 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:28:11.674408 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:28:11.674660 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:28:11.674660 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:28:11.674661 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:28:11.674887 (+ 226us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:28:11.674977 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0810 15:28:11.675270 (+ 293us) server_negotiation.cc:299] Negotiation successful
0810 15:28:11.675391 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":91,"threads_started":1}
I20260810 15:28:11.675580 13107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:11.662207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.129:42851 (local address 127.18.68.130:39041)
0810 15:28:11.662383 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0810 15:28:11.662396 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0810 15:28:11.662433 (+ 37us) server_negotiation.cc:407] Connection header received
0810 15:28:11.662884 (+ 451us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:28:11.662886 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:28:11.662928 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:28:11.663076 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:28:11.663810 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:11.664670 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:11.665643 (+ 973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:11.666134 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:11.666258 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:11.672367 (+ 6109us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:28:11.672375 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:28:11.672375 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:28:11.672385 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:28:11.674026 (+ 1641us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:28:11.674481 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:28:11.674485 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:28:11.674485 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:28:11.674573 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:28:11.674783 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:28:11.674784 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:28:11.674785 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:28:11.675015 (+ 230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:28:11.675119 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0810 15:28:11.675315 (+ 196us) server_negotiation.cc:299] Negotiation successful
0810 15:28:11.675454 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":69,"threads_started":1}
I20260810 15:28:11.675591 13105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:11.662193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.130:39041 (local address 127.18.68.129:42851)
0810 15:28:11.662295 (+ 102us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:11.662306 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 15:28:11.662370 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:28:11.663128 (+ 758us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:28:11.663131 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:28:11.663506 (+ 375us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:28:11.663684 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:28:11.663690 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:28:11.664780 (+ 1090us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:28:11.664781 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:28:11.665552 (+ 771us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:28:11.665555 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:28:11.666314 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:28:11.666315 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:28:11.666389 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:11.670269 (+ 3880us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:28:11.670284 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:28:11.672257 (+ 1973us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:28:11.674193 (+ 1936us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:28:11.674194 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:28:11.674194 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:28:11.674389 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:28:11.674648 (+ 259us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:28:11.674649 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:28:11.674649 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:28:11.674714 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:28:11.675107 (+ 393us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:28:11.675107 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:28:11.675152 (+ 45us) client_negotiation.cc:769] Sending connection context
0810 15:28:11.675237 (+ 85us) client_negotiation.cc:240] Negotiation successful
0810 15:28:11.675465 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":90,"mutex_wait_us":157,"thread_start_us":51,"threads_started":1}
W20260810 15:28:11.676827 12459 leader_election.cc:341] T 3380a02a618d4cd58984008c3d43c010 P e07aad1b650745529d478e4bbc1a1753 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 366244d5f3b44caea819a927fa53d79a (127.18.68.130:39041): Not found: Tablet not found: 3380a02a618d4cd58984008c3d43c010
W20260810 15:28:11.676918 12463 leader_election.cc:341] T 3380a02a618d4cd58984008c3d43c010 P e07aad1b650745529d478e4bbc1a1753 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8d8cfd4508f741259f67187fe2718218 (127.18.68.131:35203): Not found: Tablet not found: 3380a02a618d4cd58984008c3d43c010
I20260810 15:28:11.676966 12463 leader_election.cc:302] T 3380a02a618d4cd58984008c3d43c010 P e07aad1b650745529d478e4bbc1a1753 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e07aad1b650745529d478e4bbc1a1753; no voters: 366244d5f3b44caea819a927fa53d79a, 8d8cfd4508f741259f67187fe2718218
I20260810 15:28:11.677066 13099 raft_consensus.cc:2726] T 3380a02a618d4cd58984008c3d43c010 P e07aad1b650745529d478e4bbc1a1753 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 15:28:12.426760 13110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:12.426536 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42059 (local address 127.18.68.129:55653)
0810 15:28:12.426671 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:12.426711 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":68,"threads_started":1}
I20260810 15:28:12.463375 13112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:12.463148 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42059 (local address 127.18.68.130:38499)
0810 15:28:12.463277 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:12.463333 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":72,"threads_started":1}
I20260810 15:28:12.593986 13113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:12.593734 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42059 (local address 127.18.68.131:49161)
0810 15:28:12.593873 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:12.593914 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":80,"threads_started":1}
I20260810 15:28:13.427467 13114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:13.427245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42059 (local address 127.18.68.129:41295)
0810 15:28:13.427384 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:13.427421 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":71,"threads_started":1}
I20260810 15:28:13.464154 13115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:13.463894 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42059 (local address 127.18.68.130:36981)
0810 15:28:13.464055 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:13.464092 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":100,"threads_started":1}
I20260810 15:28:13.594631 13120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:13.594436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42059 (local address 127.18.68.131:57475)
0810 15:28:13.594556 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:13.594590 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":64,"threads_started":1}
I20260810 15:28:13.646376 13122 raft_consensus.cc:482] T 3380a02a618d4cd58984008c3d43c010 P e07aad1b650745529d478e4bbc1a1753 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 15:28:13.646493 13122 raft_consensus.cc:504] T 3380a02a618d4cd58984008c3d43c010 P e07aad1b650745529d478e4bbc1a1753 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d8cfd4508f741259f67187fe2718218" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 35203 } } peers { permanent_uuid: "366244d5f3b44caea819a927fa53d79a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 39041 } } peers { permanent_uuid: "e07aad1b650745529d478e4bbc1a1753" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 46757 } }
I20260810 15:28:13.646740 13122 leader_election.cc:288] T 3380a02a618d4cd58984008c3d43c010 P e07aad1b650745529d478e4bbc1a1753 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8d8cfd4508f741259f67187fe2718218 (127.18.68.131:35203), 366244d5f3b44caea819a927fa53d79a (127.18.68.130:39041)
W20260810 15:28:13.647125 12459 leader_election.cc:341] T 3380a02a618d4cd58984008c3d43c010 P e07aad1b650745529d478e4bbc1a1753 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 366244d5f3b44caea819a927fa53d79a (127.18.68.130:39041): Not found: Tablet not found: 3380a02a618d4cd58984008c3d43c010
W20260810 15:28:13.647281 12463 leader_election.cc:341] T 3380a02a618d4cd58984008c3d43c010 P e07aad1b650745529d478e4bbc1a1753 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8d8cfd4508f741259f67187fe2718218 (127.18.68.131:35203): Not found: Tablet not found: 3380a02a618d4cd58984008c3d43c010
I20260810 15:28:13.647337 12463 leader_election.cc:302] T 3380a02a618d4cd58984008c3d43c010 P e07aad1b650745529d478e4bbc1a1753 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e07aad1b650745529d478e4bbc1a1753; no voters: 366244d5f3b44caea819a927fa53d79a, 8d8cfd4508f741259f67187fe2718218
I20260810 15:28:13.647418 13122 raft_consensus.cc:2726] T 3380a02a618d4cd58984008c3d43c010 P e07aad1b650745529d478e4bbc1a1753 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 15:28:14.428195 13124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:14.427938 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42059 (local address 127.18.68.129:38605)
0810 15:28:14.428098 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:14.428142 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":92,"threads_started":1}
I20260810 15:28:14.464941 13125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:14.464700 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42059 (local address 127.18.68.130:55625)
0810 15:28:14.464838 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:14.464885 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":66,"threads_started":1}
I20260810 15:28:14.595312 13126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:14.595076 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42059 (local address 127.18.68.131:34885)
0810 15:28:14.595228 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:14.595266 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":83,"threads_started":1}
I20260810 15:28:15.429068 13127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:15.428838 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42059 (local address 127.18.68.129:38019)
0810 15:28:15.428976 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:15.429020 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":74,"threads_started":1}
I20260810 15:28:15.465598 13129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:15.465405 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42059 (local address 127.18.68.130:58395)
0810 15:28:15.465525 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:15.465557 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":64,"threads_started":1}
I20260810 15:28:15.596017 13130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:15.595803 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42059 (local address 127.18.68.131:53519)
0810 15:28:15.595927 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:15.595969 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":68,"threads_started":1}
I20260810 15:28:16.158676 13131 raft_consensus.cc:482] T 3380a02a618d4cd58984008c3d43c010 P e07aad1b650745529d478e4bbc1a1753 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 15:28:16.158787 13131 raft_consensus.cc:504] T 3380a02a618d4cd58984008c3d43c010 P e07aad1b650745529d478e4bbc1a1753 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d8cfd4508f741259f67187fe2718218" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 35203 } } peers { permanent_uuid: "366244d5f3b44caea819a927fa53d79a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 39041 } } peers { permanent_uuid: "e07aad1b650745529d478e4bbc1a1753" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 46757 } }
I20260810 15:28:16.159022 13131 leader_election.cc:288] T 3380a02a618d4cd58984008c3d43c010 P e07aad1b650745529d478e4bbc1a1753 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8d8cfd4508f741259f67187fe2718218 (127.18.68.131:35203), 366244d5f3b44caea819a927fa53d79a (127.18.68.130:39041)
W20260810 15:28:16.159471 12459 leader_election.cc:341] T 3380a02a618d4cd58984008c3d43c010 P e07aad1b650745529d478e4bbc1a1753 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 366244d5f3b44caea819a927fa53d79a (127.18.68.130:39041): Not found: Tablet not found: 3380a02a618d4cd58984008c3d43c010
W20260810 15:28:16.159546 12463 leader_election.cc:341] T 3380a02a618d4cd58984008c3d43c010 P e07aad1b650745529d478e4bbc1a1753 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8d8cfd4508f741259f67187fe2718218 (127.18.68.131:35203): Not found: Tablet not found: 3380a02a618d4cd58984008c3d43c010
I20260810 15:28:16.159639 12463 leader_election.cc:302] T 3380a02a618d4cd58984008c3d43c010 P e07aad1b650745529d478e4bbc1a1753 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e07aad1b650745529d478e4bbc1a1753; no voters: 366244d5f3b44caea819a927fa53d79a, 8d8cfd4508f741259f67187fe2718218
I20260810 15:28:16.159725 13131 raft_consensus.cc:2726] T 3380a02a618d4cd58984008c3d43c010 P e07aad1b650745529d478e4bbc1a1753 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 15:28:16.429745 13133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:16.429524 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42059 (local address 127.18.68.129:35541)
0810 15:28:16.429658 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:16.429696 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":63,"threads_started":1}
I20260810 15:28:16.466298 13134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:16.466096 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42059 (local address 127.18.68.130:41241)
0810 15:28:16.466218 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:16.466253 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":73,"threads_started":1}
I20260810 15:28:16.596835 13135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:16.596577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42059 (local address 127.18.68.131:45101)
0810 15:28:16.596743 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:16.596788 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":88,"threads_started":1}
I20260810 15:28:17.430518 13138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:17.430273 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42059 (local address 127.18.68.129:54351)
0810 15:28:17.430430 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:17.430469 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":95,"threads_started":1}
I20260810 15:28:17.466944 13139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:17.466738 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42059 (local address 127.18.68.130:34951)
0810 15:28:17.466867 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:17.466901 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":72,"threads_started":1}
I20260810 15:28:17.597710 13141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:17.597447 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42059 (local address 127.18.68.131:46791)
0810 15:28:17.597617 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:17.597662 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":71,"threads_started":1}
I20260810 15:28:17.769729 13142 raft_consensus.cc:482] T 3380a02a618d4cd58984008c3d43c010 P e07aad1b650745529d478e4bbc1a1753 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 15:28:17.769855 13142 raft_consensus.cc:504] T 3380a02a618d4cd58984008c3d43c010 P e07aad1b650745529d478e4bbc1a1753 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d8cfd4508f741259f67187fe2718218" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 35203 } } peers { permanent_uuid: "366244d5f3b44caea819a927fa53d79a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 39041 } } peers { permanent_uuid: "e07aad1b650745529d478e4bbc1a1753" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 46757 } }
I20260810 15:28:17.770046 13142 leader_election.cc:288] T 3380a02a618d4cd58984008c3d43c010 P e07aad1b650745529d478e4bbc1a1753 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8d8cfd4508f741259f67187fe2718218 (127.18.68.131:35203), 366244d5f3b44caea819a927fa53d79a (127.18.68.130:39041)
W20260810 15:28:17.770478 12463 leader_election.cc:341] T 3380a02a618d4cd58984008c3d43c010 P e07aad1b650745529d478e4bbc1a1753 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8d8cfd4508f741259f67187fe2718218 (127.18.68.131:35203): Not found: Tablet not found: 3380a02a618d4cd58984008c3d43c010
W20260810 15:28:17.770548 12459 leader_election.cc:341] T 3380a02a618d4cd58984008c3d43c010 P e07aad1b650745529d478e4bbc1a1753 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 366244d5f3b44caea819a927fa53d79a (127.18.68.130:39041): Not found: Tablet not found: 3380a02a618d4cd58984008c3d43c010
I20260810 15:28:17.770660 12459 leader_election.cc:302] T 3380a02a618d4cd58984008c3d43c010 P e07aad1b650745529d478e4bbc1a1753 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e07aad1b650745529d478e4bbc1a1753; no voters: 366244d5f3b44caea819a927fa53d79a, 8d8cfd4508f741259f67187fe2718218
I20260810 15:28:17.770774 13142 raft_consensus.cc:2726] T 3380a02a618d4cd58984008c3d43c010 P e07aad1b650745529d478e4bbc1a1753 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 15:28:18.431290 13143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:18.431035 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42059 (local address 127.18.68.129:50117)
0810 15:28:18.431183 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:18.431240 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":71,"threads_started":1}
I20260810 15:28:18.467747 13144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:18.467494 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42059 (local address 127.18.68.130:44125)
0810 15:28:18.467665 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:18.467703 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":59,"threads_started":1}
I20260810 15:28:18.598491 13146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:18.598252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42059 (local address 127.18.68.131:41287)
0810 15:28:18.598395 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:18.598440 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":65,"threads_started":1}
I20260810 15:28:19.431982 13147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:19.431769 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42059 (local address 127.18.68.129:44141)
0810 15:28:19.431898 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:19.431934 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":65,"threads_started":1}
I20260810 15:28:19.468518 13149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:19.468238 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42059 (local address 127.18.68.130:39143)
0810 15:28:19.468429 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:19.468468 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":121,"threads_started":1}
I20260810 15:28:19.599283 13151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:19.599037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42059 (local address 127.18.68.131:41275)
0810 15:28:19.599180 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:19.599236 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":62,"threads_started":1}
I20260810 15:28:19.812851 13152 raft_consensus.cc:482] T 3380a02a618d4cd58984008c3d43c010 P e07aad1b650745529d478e4bbc1a1753 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 15:28:19.812953 13152 raft_consensus.cc:504] T 3380a02a618d4cd58984008c3d43c010 P e07aad1b650745529d478e4bbc1a1753 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d8cfd4508f741259f67187fe2718218" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 35203 } } peers { permanent_uuid: "366244d5f3b44caea819a927fa53d79a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 39041 } } peers { permanent_uuid: "e07aad1b650745529d478e4bbc1a1753" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 46757 } }
I20260810 15:28:19.813205 13152 leader_election.cc:288] T 3380a02a618d4cd58984008c3d43c010 P e07aad1b650745529d478e4bbc1a1753 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8d8cfd4508f741259f67187fe2718218 (127.18.68.131:35203), 366244d5f3b44caea819a927fa53d79a (127.18.68.130:39041)
W20260810 15:28:19.813606 12459 leader_election.cc:341] T 3380a02a618d4cd58984008c3d43c010 P e07aad1b650745529d478e4bbc1a1753 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 366244d5f3b44caea819a927fa53d79a (127.18.68.130:39041): Not found: Tablet not found: 3380a02a618d4cd58984008c3d43c010
W20260810 15:28:19.813717 12463 leader_election.cc:341] T 3380a02a618d4cd58984008c3d43c010 P e07aad1b650745529d478e4bbc1a1753 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8d8cfd4508f741259f67187fe2718218 (127.18.68.131:35203): Not found: Tablet not found: 3380a02a618d4cd58984008c3d43c010
I20260810 15:28:19.813799 12463 leader_election.cc:302] T 3380a02a618d4cd58984008c3d43c010 P e07aad1b650745529d478e4bbc1a1753 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e07aad1b650745529d478e4bbc1a1753; no voters: 366244d5f3b44caea819a927fa53d79a, 8d8cfd4508f741259f67187fe2718218
I20260810 15:28:19.813884 13152 raft_consensus.cc:2726] T 3380a02a618d4cd58984008c3d43c010 P e07aad1b650745529d478e4bbc1a1753 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 15:28:20.432802 13153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:20.432553 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42059 (local address 127.18.68.129:50681)
0810 15:28:20.432705 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:20.432752 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":69,"threads_started":1}
I20260810 15:28:20.469228 13154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:20.468951 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42059 (local address 127.18.68.130:51469)
0810 15:28:20.469146 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:20.469185 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":98,"threads_started":1}
I20260810 15:28:20.600183 13160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:20.599873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42059 (local address 127.18.68.131:56201)
0810 15:28:20.600081 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:20.600132 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":89,"threads_started":1}
I20260810 15:28:21.433511 13161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:21.433292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42059 (local address 127.18.68.129:59561)
0810 15:28:21.433423 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:21.433461 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":65,"threads_started":1}
I20260810 15:28:21.469918 13162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:21.469709 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42059 (local address 127.18.68.130:40231)
0810 15:28:21.469843 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:21.469876 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":83,"threads_started":1}
I20260810 15:28:21.600940 13164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:21.600695 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42059 (local address 127.18.68.131:40925)
0810 15:28:21.600855 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:21.600893 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":80,"threads_started":1}
I20260810 15:28:22.434262 13165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:22.433985 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42059 (local address 127.18.68.129:54363)
0810 15:28:22.434166 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:22.434208 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":101,"threads_started":1}
I20260810 15:28:22.470628 13166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:22.470430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42059 (local address 127.18.68.130:55433)
0810 15:28:22.470556 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:22.470588 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":64,"threads_started":1}
I20260810 15:28:22.601701 13167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:22.601444 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42059 (local address 127.18.68.131:46757)
0810 15:28:22.601605 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:22.601650 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":68,"threads_started":1}
I20260810 15:28:23.435006 13169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:23.434768 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42059 (local address 127.18.68.129:49323)
0810 15:28:23.434911 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:23.434955 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":78,"threads_started":1}
I20260810 15:28:23.471334 13173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:23.471087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42059 (local address 127.18.68.130:38953)
0810 15:28:23.471250 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:23.471288 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":79,"threads_started":1}
I20260810 15:28:23.602488 13174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:23.602263 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42059 (local address 127.18.68.131:42821)
0810 15:28:23.602398 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:23.602441 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":68,"threads_started":1}
I20260810 15:28:24.435786 13175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:24.435557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42059 (local address 127.18.68.129:41699)
0810 15:28:24.435694 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:24.435738 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":73,"threads_started":1}
I20260810 15:28:24.472016 13178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:24.471806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42059 (local address 127.18.68.130:55535)
0810 15:28:24.471932 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:24.471971 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":66,"threads_started":1}
I20260810 15:28:24.603338 13179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:24.603088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42059 (local address 127.18.68.131:48609)
0810 15:28:24.603243 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:24.603288 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":83,"threads_started":1}
I20260810 15:28:25.436691 13184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:25.436448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42059 (local address 127.18.68.129:41255)
0810 15:28:25.436598 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:25.436632 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":65,"threads_started":1}
I20260810 15:28:25.472728 13186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:25.472505 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42059 (local address 127.18.68.130:53153)
0810 15:28:25.472647 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:25.472683 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":90,"threads_started":1}
I20260810 15:28:25.603343 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 12367
I20260810 15:28:25.608773 13187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:25.603883 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42059 (local address 127.18.68.131:41817)
0810 15:28:25.608642 (+ 4759us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:25.608705 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":4733,"thread_start_us":55,"threads_started":1}
I20260810 15:28:25.618474 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 12649
I20260810 15:28:25.627547 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 12875
2026-08-10T15:28:25Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (18911 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 15:28:25 dist-test-slave-2p8l krb5kdc[13190](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 15:28:25 dist-test-slave-2p8l krb5kdc[13190](info): set up 2 sockets
Aug 10 15:28:25 dist-test-slave-2p8l krb5kdc[13190](info): commencing operation
krb5kdc: starting...
W20260810 15:28:26.928515 18706 mini_kdc.cc:121] Time spent starting KDC: real 1.267s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/krb5kdc/test-user.keytab.
Aug 10 15:28:27 dist-test-slave-2p8l krb5kdc[13190](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375707, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T15:28:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T15:28:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.68.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.68.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.68.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab.
Entry for principal kudu/127.18.68.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab.
I20260810 15:28:27.054994 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.190:42677
--webserver_interface=127.18.68.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab
--principal=kudu/127.18.68.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:36547
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.68.190:42677
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:28:27.137418 13212 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:28:27.137625 13212 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:28:27.137650 13212 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:28:27.138742 13212 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260810 15:28:27.138777 13212 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260810 15:28:27.138789 13212 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260810 15:28:27.138801 13212 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 15:28:27.138814 13212 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:28:27.138827 13212 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:28:27.138840 13212 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 15:28:27.138852 13212 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 15:28:27.140244 13212 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:36547
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.18.68.190:42677
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab
--principal=kudu/127.18.68.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.190:42677
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.68.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13212
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:28:27.140430 13212 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:28:27.140600 13212 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 15:28:27.145810 13212 server_base.cc:1034] running on GCE node
W20260810 15:28:27.145759 13224 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:28:27.145781 13226 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:28:27.145761 13222 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:28:27.146310 13212 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:28:27.146656 13212 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:28:27.147826 13212 hybrid_clock.cc:648] HybridClock initialized: now 1786375707147812 us; error 47 us; skew 500 ppm
Aug 10 15:28:27 dist-test-slave-2p8l krb5kdc[13190](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375707, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:28:27.150364 13212 init.cc:377] Logged in from keytab as kudu/127.18.68.190@KRBTEST.COM (short username kudu)
I20260810 15:28:27.150846 13212 webserver.cc:460] Webserver started at http://127.18.68.190:35787/ using document root <none> and password file <none>
I20260810 15:28:27.151099 13212 fs_manager.cc:359] Metadata directory not provided
I20260810 15:28:27.151168 13212 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:28:27.151314 13212 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:28:27.152354 13212 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/master-0/data/instance:
uuid: "963e2863e7434f1c9258598c51d06dfd"
format_stamp: "Formatted at 2026-08-10 15:28:27 on dist-test-slave-2p8l"
server_key: "9516f1afec1008f72c46ea43258b581e"
server_key_iv: "453dfdec05cdbfce41f584edcf6b5cc4"
server_key_version: "encryptionkey@0"
I20260810 15:28:27.152730 13212 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/master-0/wal/instance:
uuid: "963e2863e7434f1c9258598c51d06dfd"
format_stamp: "Formatted at 2026-08-10 15:28:27 on dist-test-slave-2p8l"
server_key: "9516f1afec1008f72c46ea43258b581e"
server_key_iv: "453dfdec05cdbfce41f584edcf6b5cc4"
server_key_version: "encryptionkey@0"
I20260810 15:28:27.154142 13212 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.003s
I20260810 15:28:27.154932 13239 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:28:27.155134 13212 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:28:27.155229 13212 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/master-0/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/master-0/wal
uuid: "963e2863e7434f1c9258598c51d06dfd"
format_stamp: "Formatted at 2026-08-10 15:28:27 on dist-test-slave-2p8l"
server_key: "9516f1afec1008f72c46ea43258b581e"
server_key_iv: "453dfdec05cdbfce41f584edcf6b5cc4"
server_key_version: "encryptionkey@0"
I20260810 15:28:27.155313 13212 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:28:27.184971 13212 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:28:27.187305 13212 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:28:27.187482 13212 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:28:27.191893 13212 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.190:42677
I20260810 15:28:27.191932 13331 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.190:42677 every 8 connection(s)
I20260810 15:28:27.192317 13212 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
I20260810 15:28:27.193252 13332 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:28:27.195641 13332 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 963e2863e7434f1c9258598c51d06dfd: Bootstrap starting.
I20260810 15:28:27.196200 13332 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 963e2863e7434f1c9258598c51d06dfd: Neither blocks nor log segments found. Creating new log.
I20260810 15:28:27.196446 13332 log.cc:824] T 00000000000000000000000000000000 P 963e2863e7434f1c9258598c51d06dfd: Log is configured to *not* fsync() on all Append() calls
I20260810 15:28:27.197135 13332 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 963e2863e7434f1c9258598c51d06dfd: No bootstrap required, opened a new log
I20260810 15:28:27.198761 13332 raft_consensus.cc:348] T 00000000000000000000000000000000 P 963e2863e7434f1c9258598c51d06dfd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "963e2863e7434f1c9258598c51d06dfd" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 42677 } }
I20260810 15:28:27.198900 13332 raft_consensus.cc:374] T 00000000000000000000000000000000 P 963e2863e7434f1c9258598c51d06dfd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:28:27.198925 13332 raft_consensus.cc:729] T 00000000000000000000000000000000 P 963e2863e7434f1c9258598c51d06dfd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 963e2863e7434f1c9258598c51d06dfd, State: Initialized, Role: FOLLOWER
I20260810 15:28:27.199062 13332 consensus_queue.cc:260] T 00000000000000000000000000000000 P 963e2863e7434f1c9258598c51d06dfd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "963e2863e7434f1c9258598c51d06dfd" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 42677 } }
I20260810 15:28:27.199144 13332 raft_consensus.cc:388] T 00000000000000000000000000000000 P 963e2863e7434f1c9258598c51d06dfd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 15:28:27.199167 13332 raft_consensus.cc:482] T 00000000000000000000000000000000 P 963e2863e7434f1c9258598c51d06dfd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 15:28:27.199198 13332 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 963e2863e7434f1c9258598c51d06dfd [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:28:27.199678 13332 raft_consensus.cc:504] T 00000000000000000000000000000000 P 963e2863e7434f1c9258598c51d06dfd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "963e2863e7434f1c9258598c51d06dfd" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 42677 } }
I20260810 15:28:27.199764 13332 leader_election.cc:302] T 00000000000000000000000000000000 P 963e2863e7434f1c9258598c51d06dfd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 963e2863e7434f1c9258598c51d06dfd; no voters:
I20260810 15:28:27.199890 13332 leader_election.cc:288] T 00000000000000000000000000000000 P 963e2863e7434f1c9258598c51d06dfd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 15:28:27.199967 13338 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 963e2863e7434f1c9258598c51d06dfd [term 1 FOLLOWER]: Leader election won for term 1
I20260810 15:28:27.200163 13338 raft_consensus.cc:686] T 00000000000000000000000000000000 P 963e2863e7434f1c9258598c51d06dfd [term 1 LEADER]: Becoming Leader. State: Replica: 963e2863e7434f1c9258598c51d06dfd, State: Running, Role: LEADER
I20260810 15:28:27.200184 13332 sys_catalog.cc:564] T 00000000000000000000000000000000 P 963e2863e7434f1c9258598c51d06dfd [sys.catalog]: configured and running, proceeding with master startup.
I20260810 15:28:27.200289 13338 consensus_queue.cc:237] T 00000000000000000000000000000000 P 963e2863e7434f1c9258598c51d06dfd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "963e2863e7434f1c9258598c51d06dfd" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 42677 } }
I20260810 15:28:27.200742 13341 sys_catalog.cc:455] T 00000000000000000000000000000000 P 963e2863e7434f1c9258598c51d06dfd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 963e2863e7434f1c9258598c51d06dfd. Latest consensus state: current_term: 1 leader_uuid: "963e2863e7434f1c9258598c51d06dfd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "963e2863e7434f1c9258598c51d06dfd" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 42677 } } }
I20260810 15:28:27.200899 13341 sys_catalog.cc:458] T 00000000000000000000000000000000 P 963e2863e7434f1c9258598c51d06dfd [sys.catalog]: This master's current role is: LEADER
I20260810 15:28:27.200930 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 13212
I20260810 15:28:27.201068 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/master-0/wal/instance
I20260810 15:28:27.201311 18706 external_mini_cluster.cc:1428] Setting key bf3cdb85c63a22dd066cc0690fa17234
I20260810 15:28:27.201412 13354 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 15:28:27.200703 13339 sys_catalog.cc:455] T 00000000000000000000000000000000 P 963e2863e7434f1c9258598c51d06dfd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "963e2863e7434f1c9258598c51d06dfd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "963e2863e7434f1c9258598c51d06dfd" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 42677 } } }
I20260810 15:28:27.202070 13339 sys_catalog.cc:458] T 00000000000000000000000000000000 P 963e2863e7434f1c9258598c51d06dfd [sys.catalog]: This master's current role is: LEADER
I20260810 15:28:27.202112 13354 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 15:28:27.203912 13354 catalog_manager.cc:1347] Generated new cluster ID: 737dd647fa494222aa9b63c4ee84d527
I20260810 15:28:27.204022 13354 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 10 15:28:27 dist-test-slave-2p8l krb5kdc[13190](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375707, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
I20260810 15:28:27.211932 13368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:27.202050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33950 (local address 127.18.68.190:42677)
0810 15:28:27.202379 (+ 329us) server_negotiation.cc:206] Beginning negotiation
0810 15:28:27.202389 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 15:28:27.202426 (+ 37us) server_negotiation.cc:407] Connection header received
0810 15:28:27.202840 (+ 414us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:28:27.202864 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:28:27.202929 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:28:27.203093 (+ 164us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:28:27.203879 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:27.204764 (+ 885us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:27.205558 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:27.205997 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:27.206149 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:27.208505 (+ 2356us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:28:27.208509 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:28:27.208510 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:28:27.208521 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:28:27.210331 (+ 1810us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:28:27.210721 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:28:27.210725 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:28:27.210725 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:28:27.210816 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:28:27.211046 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:28:27.211047 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:28:27.211047 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:28:27.211300 (+ 253us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:28:27.211454 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0810 15:28:27.211583 (+ 129us) server_negotiation.cc:299] Negotiation successful
0810 15:28:27.211728 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":266,"thread_start_us":86,"threads_started":1}
I20260810 15:28:27.229092 13354 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 15:28:27.229645 13354 catalog_manager.cc:1504] Loading token signing keys...
I20260810 15:28:27.232784 13354 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 963e2863e7434f1c9258598c51d06dfd: Generated new TSK 0
I20260810 15:28:27.232955 13354 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.18.68.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.68.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.68.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.129.keytab.
Entry for principal kudu/127.18.68.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.129.keytab.
I20260810 15:28:27.264356 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.68.129:0
--local_ip_for_outbound_sockets=127.18.68.129
--webserver_interface=127.18.68.129
--webserver_port=0
--tserver_master_addrs=127.18.68.190:42677
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.129.keytab
--principal=kudu/127.18.68.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:36547
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:28:27.358750 13381 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:28:27.358968 13381 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:28:27.358992 13381 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:28:27.360322 13381 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:28:27.360369 13381 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:28:27.360406 13381 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.68.129
I20260810 15:28:27.361948 13381 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:36547
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.129.keytab
--principal=kudu/127.18.68.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.68.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.68.129
--webserver_port=0
--tserver_master_addrs=127.18.68.190:42677
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13381
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.68.129
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:28:27.362282 13381 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:28:27.362538 13381 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:28:27.367660 13390 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:28:27.367805 13387 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:28:27.367664 13388 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:28:27.367974 13381 server_base.cc:1034] running on GCE node
I20260810 15:28:27.368299 13381 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:28:27.368551 13381 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:28:27.369724 13381 hybrid_clock.cc:648] HybridClock initialized: now 1786375707369715 us; error 35 us; skew 500 ppm
Aug 10 15:28:27 dist-test-slave-2p8l krb5kdc[13190](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375707, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:28:27.372422 13381 init.cc:377] Logged in from keytab as kudu/127.18.68.129@KRBTEST.COM (short username kudu)
I20260810 15:28:27.372869 13381 webserver.cc:460] Webserver started at http://127.18.68.129:39509/ using document root <none> and password file <none>
I20260810 15:28:27.373050 13381 fs_manager.cc:359] Metadata directory not provided
I20260810 15:28:27.373090 13381 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:28:27.373186 13381 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:28:27.374262 13381 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-0/data/instance:
uuid: "2504da2f74754aeebf64a3b94ec9dacd"
format_stamp: "Formatted at 2026-08-10 15:28:27 on dist-test-slave-2p8l"
server_key: "adebe38f8ed45961c99c83118f43d2bd"
server_key_iv: "8ac6acd1909b685c9b0d855989fd33d2"
server_key_version: "encryptionkey@0"
I20260810 15:28:27.374579 13381 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-0/wal/instance:
uuid: "2504da2f74754aeebf64a3b94ec9dacd"
format_stamp: "Formatted at 2026-08-10 15:28:27 on dist-test-slave-2p8l"
server_key: "adebe38f8ed45961c99c83118f43d2bd"
server_key_iv: "8ac6acd1909b685c9b0d855989fd33d2"
server_key_version: "encryptionkey@0"
I20260810 15:28:27.375895 13381 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260810 15:28:27.376641 13400 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:28:27.376814 13381 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 15:28:27.376906 13381 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-0/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-0/wal
uuid: "2504da2f74754aeebf64a3b94ec9dacd"
format_stamp: "Formatted at 2026-08-10 15:28:27 on dist-test-slave-2p8l"
server_key: "adebe38f8ed45961c99c83118f43d2bd"
server_key_iv: "8ac6acd1909b685c9b0d855989fd33d2"
server_key_version: "encryptionkey@0"
I20260810 15:28:27.376974 13381 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:28:27.404394 13381 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:28:27.406517 13381 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:28:27.406692 13381 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:28:27.406958 13381 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 15:28:27.407310 13381 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 15:28:27.407366 13381 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 15:28:27.407401 13381 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 15:28:27.407428 13381 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 15:28:27.413324 13381 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.129:38391
I20260810 15:28:27.413376 13588 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.129:38391 every 8 connection(s)
I20260810 15:28:27.413697 13381 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-0/data/info.pb
Aug 10 15:28:27 dist-test-slave-2p8l krb5kdc[13190](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375707, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.129@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
I20260810 15:28:27.420730 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 13381
I20260810 15:28:27.420838 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-0/wal/instance
I20260810 15:28:27.421099 18706 external_mini_cluster.cc:1428] Setting key 87c1c9a5a4fe734be3b6a93ba569f897
I20260810 15:28:27.424932 13368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:27.414461 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.129:33319 (local address 127.18.68.190:42677)
0810 15:28:27.414549 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0810 15:28:27.414551 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:28:27.414737 (+ 186us) server_negotiation.cc:407] Connection header received
0810 15:28:27.415232 (+ 495us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:28:27.415233 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:28:27.415243 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:28:27.415297 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:28:27.416221 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:27.416759 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:27.417866 (+ 1107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:27.418096 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:27.418155 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:27.420724 (+ 2569us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:28:27.420727 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:28:27.420727 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:28:27.420739 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:28:27.423261 (+ 2522us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:28:27.423784 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:28:27.423786 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:28:27.423787 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:28:27.423864 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:28:27.424210 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:28:27.424211 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:28:27.424211 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:28:27.424332 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:28:27.424393 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0810 15:28:27.424792 (+ 399us) server_negotiation.cc:299] Negotiation successful
0810 15:28:27.424868 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260810 15:28:27.425326 13591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:27.414409 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42677 (local address 127.18.68.129:33319)
0810 15:28:27.414606 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:27.414646 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0810 15:28:27.415142 (+ 496us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:28:27.415355 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:28:27.415359 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:28:27.415934 (+ 575us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:28:27.416135 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:28:27.416140 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:28:27.416861 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:28:27.416862 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:28:27.417776 (+ 914us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:28:27.417779 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:28:27.418184 (+ 405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:28:27.418185 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:28:27.418292 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:27.418805 (+ 513us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:28:27.418815 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:28:27.420594 (+ 1779us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:28:27.423361 (+ 2767us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:28:27.423370 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:28:27.423372 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:28:27.423651 (+ 279us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:28:27.423958 (+ 307us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:28:27.423959 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:28:27.423959 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:28:27.424117 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:28:27.424411 (+ 294us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:28:27.424418 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:28:27.424636 (+ 218us) client_negotiation.cc:769] Sending connection context
0810 15:28:27.424774 (+ 138us) client_negotiation.cc:240] Negotiation successful
0810 15:28:27.424983 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":95,"threads_started":1}
I20260810 15:28:27.425832 13589 heartbeater.cc:347] Connected to a master server at 127.18.68.190:42677
I20260810 15:28:27.425936 13589 heartbeater.cc:464] Registering TS with master...
I20260810 15:28:27.426188 13589 heartbeater.cc:511] Master 127.18.68.190:42677 requested a full tablet report, sending...
I20260810 15:28:27.426746 13265 ts_manager.cc:194] Registered new tserver with Master: 2504da2f74754aeebf64a3b94ec9dacd (127.18.68.129:38391)
I20260810 15:28:27.427433 13265 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.68.129@KRBTEST.COM'} at 127.18.68.129:33319
WARNING: no policy specified for kudu/127.18.68.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.68.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.68.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.130.keytab.
Entry for principal kudu/127.18.68.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.130.keytab.
I20260810 15:28:27.448633 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.68.130:0
--local_ip_for_outbound_sockets=127.18.68.130
--webserver_interface=127.18.68.130
--webserver_port=0
--tserver_master_addrs=127.18.68.190:42677
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.130.keytab
--principal=kudu/127.18.68.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:36547
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:28:27.532511 13595 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:28:27.532711 13595 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:28:27.532733 13595 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:28:27.533809 13595 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:28:27.533846 13595 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:28:27.533872 13595 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.68.130
I20260810 15:28:27.535279 13595 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:36547
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.130.keytab
--principal=kudu/127.18.68.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.68.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.68.130
--webserver_port=0
--tserver_master_addrs=127.18.68.190:42677
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13595
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.68.130
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:28:27.535468 13595 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:28:27.535643 13595 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:28:27.540601 13608 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:28:27.540674 13603 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:28:27.540621 13605 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:28:27.540984 13595 server_base.cc:1034] running on GCE node
I20260810 15:28:27.541144 13595 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:28:27.541371 13595 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:28:27.542565 13595 hybrid_clock.cc:648] HybridClock initialized: now 1786375707542549 us; error 33 us; skew 500 ppm
Aug 10 15:28:27 dist-test-slave-2p8l krb5kdc[13190](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375707, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:28:27.545279 13595 init.cc:377] Logged in from keytab as kudu/127.18.68.130@KRBTEST.COM (short username kudu)
I20260810 15:28:27.545842 13595 webserver.cc:460] Webserver started at http://127.18.68.130:40625/ using document root <none> and password file <none>
I20260810 15:28:27.546169 13595 fs_manager.cc:359] Metadata directory not provided
I20260810 15:28:27.546248 13595 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:28:27.546420 13595 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:28:27.547562 13595 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-1/data/instance:
uuid: "e428d6c365a44bfbb97901a4471ff5d4"
format_stamp: "Formatted at 2026-08-10 15:28:27 on dist-test-slave-2p8l"
server_key: "9266be9fcf01d29b16c55ff0be3adb03"
server_key_iv: "714f39bd16dfa992d21402416c6bb8ea"
server_key_version: "encryptionkey@0"
I20260810 15:28:27.547960 13595 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-1/wal/instance:
uuid: "e428d6c365a44bfbb97901a4471ff5d4"
format_stamp: "Formatted at 2026-08-10 15:28:27 on dist-test-slave-2p8l"
server_key: "9266be9fcf01d29b16c55ff0be3adb03"
server_key_iv: "714f39bd16dfa992d21402416c6bb8ea"
server_key_version: "encryptionkey@0"
I20260810 15:28:27.549387 13595 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 15:28:27.550307 13627 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:28:27.550554 13595 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:28:27.550683 13595 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-1/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-1/wal
uuid: "e428d6c365a44bfbb97901a4471ff5d4"
format_stamp: "Formatted at 2026-08-10 15:28:27 on dist-test-slave-2p8l"
server_key: "9266be9fcf01d29b16c55ff0be3adb03"
server_key_iv: "714f39bd16dfa992d21402416c6bb8ea"
server_key_version: "encryptionkey@0"
I20260810 15:28:27.550773 13595 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:28:27.574024 13595 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:28:27.576242 13595 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:28:27.576433 13595 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:28:27.576712 13595 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 15:28:27.577059 13595 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 15:28:27.577119 13595 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 15:28:27.577158 13595 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 15:28:27.577211 13595 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 15:28:27.584116 13595 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.130:39415
I20260810 15:28:27.584156 13831 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.130:39415 every 8 connection(s)
I20260810 15:28:27.584535 13595 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-1/data/info.pb
Aug 10 15:28:27 dist-test-slave-2p8l krb5kdc[13190](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375707, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.130@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
I20260810 15:28:27.593663 13368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:27.585313 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.130:35019 (local address 127.18.68.190:42677)
0810 15:28:27.585391 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0810 15:28:27.585393 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:28:27.585568 (+ 175us) server_negotiation.cc:407] Connection header received
0810 15:28:27.586132 (+ 564us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:28:27.586134 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:28:27.586150 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:28:27.586233 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:28:27.587161 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:27.587676 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:27.588645 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:27.588864 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:27.588933 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:27.591027 (+ 2094us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:28:27.591029 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:28:27.591029 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:28:27.591036 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:28:27.592513 (+ 1477us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:28:27.592865 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:28:27.592866 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:28:27.592866 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:28:27.592919 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:28:27.593131 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:28:27.593132 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:28:27.593132 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:28:27.593238 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:28:27.593292 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0810 15:28:27.593517 (+ 225us) server_negotiation.cc:299] Negotiation successful
0810 15:28:27.593598 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260810 15:28:27.593803 13837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:27.585255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42677 (local address 127.18.68.130:35019)
0810 15:28:27.585428 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:27.585470 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0810 15:28:27.585945 (+ 475us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:28:27.586305 (+ 360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:28:27.586308 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:28:27.586870 (+ 562us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:28:27.587063 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:28:27.587067 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:28:27.587759 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:28:27.587759 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:28:27.588537 (+ 778us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:28:27.588539 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:28:27.588957 (+ 418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:28:27.588958 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:28:27.589055 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:27.589552 (+ 497us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:28:27.589560 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:28:27.590943 (+ 1383us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:28:27.592584 (+ 1641us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:28:27.592589 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:28:27.592590 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:28:27.592796 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:28:27.592977 (+ 181us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:28:27.592978 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:28:27.592978 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:28:27.593073 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:28:27.593294 (+ 221us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:28:27.593299 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:28:27.593407 (+ 108us) client_negotiation.cc:769] Sending connection context
0810 15:28:27.593491 (+ 84us) client_negotiation.cc:240] Negotiation successful
0810 15:28:27.593610 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":97,"threads_started":1}
I20260810 15:28:27.594257 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 13595
I20260810 15:28:27.594379 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-1/wal/instance
I20260810 15:28:27.594360 13833 heartbeater.cc:347] Connected to a master server at 127.18.68.190:42677
I20260810 15:28:27.594473 13833 heartbeater.cc:464] Registering TS with master...
I20260810 15:28:27.594647 18706 external_mini_cluster.cc:1428] Setting key b84c94b5e52bf8b13cef75da9410f129
I20260810 15:28:27.594671 13833 heartbeater.cc:511] Master 127.18.68.190:42677 requested a full tablet report, sending...
I20260810 15:28:27.595109 13265 ts_manager.cc:194] Registered new tserver with Master: e428d6c365a44bfbb97901a4471ff5d4 (127.18.68.130:39415)
I20260810 15:28:27.595633 13265 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.68.130@KRBTEST.COM'} at 127.18.68.130:35019
WARNING: no policy specified for kudu/127.18.68.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.68.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.68.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.131.keytab.
Entry for principal kudu/127.18.68.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.131.keytab.
I20260810 15:28:27.621409 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.68.131:0
--local_ip_for_outbound_sockets=127.18.68.131
--webserver_interface=127.18.68.131
--webserver_port=0
--tserver_master_addrs=127.18.68.190:42677
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.131.keytab
--principal=kudu/127.18.68.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:36547
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:28:27.706436 13843 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:28:27.706646 13843 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:28:27.706671 13843 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:28:27.707844 13843 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:28:27.707883 13843 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:28:27.707911 13843 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.68.131
I20260810 15:28:27.709367 13843 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:36547
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.131.keytab
--principal=kudu/127.18.68.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.68.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.68.131
--webserver_port=0
--tserver_master_addrs=127.18.68.190:42677
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13843
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.68.131
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:28:27.709614 13843 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:28:27.709842 13843 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:28:27.714982 13852 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:28:27.714980 13850 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:28:27.715191 13843 server_base.cc:1034] running on GCE node
W20260810 15:28:27.715221 13854 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:28:27.715441 13843 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:28:27.715740 13843 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:28:27.716912 13843 hybrid_clock.cc:648] HybridClock initialized: now 1786375707716902 us; error 35 us; skew 500 ppm
Aug 10 15:28:27 dist-test-slave-2p8l krb5kdc[13190](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375707, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:28:27.719894 13843 init.cc:377] Logged in from keytab as kudu/127.18.68.131@KRBTEST.COM (short username kudu)
I20260810 15:28:27.720361 13843 webserver.cc:460] Webserver started at http://127.18.68.131:34127/ using document root <none> and password file <none>
I20260810 15:28:27.720613 13843 fs_manager.cc:359] Metadata directory not provided
I20260810 15:28:27.720690 13843 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:28:27.720849 13843 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:28:27.721998 13843 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-2/data/instance:
uuid: "dee73ad54e7740bbbbfaafc864b08b64"
format_stamp: "Formatted at 2026-08-10 15:28:27 on dist-test-slave-2p8l"
server_key: "718e8cf954b3db2511b8fe7f447cc26e"
server_key_iv: "c32aeeb9dda9391caddb0986649d7164"
server_key_version: "encryptionkey@0"
I20260810 15:28:27.722483 13843 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-2/wal/instance:
uuid: "dee73ad54e7740bbbbfaafc864b08b64"
format_stamp: "Formatted at 2026-08-10 15:28:27 on dist-test-slave-2p8l"
server_key: "718e8cf954b3db2511b8fe7f447cc26e"
server_key_iv: "c32aeeb9dda9391caddb0986649d7164"
server_key_version: "encryptionkey@0"
I20260810 15:28:27.723939 13843 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 15:28:27.724841 13871 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:28:27.725055 13843 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:28:27.725185 13843 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-2/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-2/wal
uuid: "dee73ad54e7740bbbbfaafc864b08b64"
format_stamp: "Formatted at 2026-08-10 15:28:27 on dist-test-slave-2p8l"
server_key: "718e8cf954b3db2511b8fe7f447cc26e"
server_key_iv: "c32aeeb9dda9391caddb0986649d7164"
server_key_version: "encryptionkey@0"
I20260810 15:28:27.725270 13843 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:28:27.737274 13843 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:28:27.739482 13843 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:28:27.739665 13843 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:28:27.739938 13843 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 15:28:27.740286 13843 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 15:28:27.740355 13843 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 15:28:27.740404 13843 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 15:28:27.740432 13843 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 15:28:27.747336 13843 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.131:37887
I20260810 15:28:27.747386 14051 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.131:37887 every 8 connection(s)
I20260810 15:28:27.747736 13843 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-2/data/info.pb
Aug 10 15:28:27 dist-test-slave-2p8l krb5kdc[13190](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375707, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.131@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
I20260810 15:28:27.757145 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 13843
I20260810 15:28:27.757298 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-2/wal/instance
I20260810 15:28:27.757622 18706 external_mini_cluster.cc:1428] Setting key 5ba4a6d37e99f10f3b92d4556e56e844
I20260810 15:28:27.757776 13368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:27.748480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.131:48083 (local address 127.18.68.190:42677)
0810 15:28:27.748550 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0810 15:28:27.748552 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:28:27.748725 (+ 173us) server_negotiation.cc:407] Connection header received
0810 15:28:27.749190 (+ 465us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:28:27.749191 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:28:27.749203 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:28:27.749273 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:28:27.750285 (+ 1012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:27.750823 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:27.751848 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:27.752065 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:27.752129 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:27.754505 (+ 2376us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:28:27.754507 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:28:27.754507 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:28:27.754515 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:28:27.755838 (+ 1323us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:28:27.756291 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:28:27.756293 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:28:27.756293 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:28:27.756357 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:28:27.756949 (+ 592us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:28:27.756951 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:28:27.756951 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:28:27.757109 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:28:27.757208 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0810 15:28:27.757565 (+ 357us) server_negotiation.cc:299] Negotiation successful
0810 15:28:27.757672 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260810 15:28:27.758021 14054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:27.748420 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42677 (local address 127.18.68.131:48083)
0810 15:28:27.748588 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:27.748631 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0810 15:28:27.749106 (+ 475us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:28:27.749326 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:28:27.749329 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:28:27.749908 (+ 579us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:28:27.750187 (+ 279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:28:27.750193 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:28:27.750906 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:28:27.750906 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:28:27.751761 (+ 855us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:28:27.751764 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:28:27.752144 (+ 380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:28:27.752144 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:28:27.752252 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:27.752783 (+ 531us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:28:27.752792 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:28:27.754379 (+ 1587us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:28:27.755933 (+ 1554us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:28:27.755941 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:28:27.755944 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:28:27.756196 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:28:27.756444 (+ 248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:28:27.756445 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:28:27.756445 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:28:27.756601 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:28:27.757209 (+ 608us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:28:27.757218 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:28:27.757406 (+ 188us) client_negotiation.cc:769] Sending connection context
0810 15:28:27.757527 (+ 121us) client_negotiation.cc:240] Negotiation successful
0810 15:28:27.757770 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":95,"threads_started":1}
I20260810 15:28:27.758634 14052 heartbeater.cc:347] Connected to a master server at 127.18.68.190:42677
I20260810 15:28:27.758750 14052 heartbeater.cc:464] Registering TS with master...
I20260810 15:28:27.758985 14052 heartbeater.cc:511] Master 127.18.68.190:42677 requested a full tablet report, sending...
I20260810 15:28:27.759410 13265 ts_manager.cc:194] Registered new tserver with Master: dee73ad54e7740bbbbfaafc864b08b64 (127.18.68.131:37887)
I20260810 15:28:27.759794 13265 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.68.131@KRBTEST.COM'} at 127.18.68.131:48083
I20260810 15:28:27.769678 18706 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 15:28:27.777215 13368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:27.771212 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33964 (local address 127.18.68.190:42677)
0810 15:28:27.771282 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0810 15:28:27.771284 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:28:27.771422 (+ 138us) server_negotiation.cc:407] Connection header received
0810 15:28:27.771461 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:28:27.771461 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:28:27.771471 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:28:27.771523 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:28:27.772080 (+ 557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:27.772599 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:27.773301 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:27.773490 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:27.773545 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:27.774859 (+ 1314us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:28:27.774861 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:28:27.774861 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:28:27.774867 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:28:27.776285 (+ 1418us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:28:27.776574 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:28:27.776575 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:28:27.776575 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:28:27.776654 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:28:27.776807 (+ 153us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:28:27.776807 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:28:27.776808 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:28:27.776933 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:28:27.777007 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0810 15:28:27.777066 (+ 59us) server_negotiation.cc:299] Negotiation successful
0810 15:28:27.777122 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260810 15:28:27.778930 13265 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33964:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 15:28:27.780699 13265 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 15:28:27.787523 14072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:27.783141 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56952 (local address 127.18.68.129:38391)
0810 15:28:27.783496 (+ 355us) server_negotiation.cc:206] Beginning negotiation
0810 15:28:27.783499 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 15:28:27.783508 (+ 9us) server_negotiation.cc:407] Connection header received
0810 15:28:27.783538 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:28:27.783540 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:28:27.783552 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:28:27.783644 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:28:27.783810 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:27.784905 (+ 1095us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:27.786480 (+ 1575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:27.787043 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:27.787154 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:27.787221 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0810 15:28:27.787389 (+ 168us) server_negotiation.cc:299] Negotiation successful
0810 15:28:27.787431 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":314,"thread_start_us":94,"threads_started":1}
I20260810 15:28:27.787542 14071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:27.783043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.129:38391 (local address 127.0.0.1:56952)
0810 15:28:27.783234 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:27.783274 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0810 15:28:27.783347 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:28:27.783651 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:28:27.783654 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:28:27.783657 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:28:27.783722 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:28:27.783724 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:28:27.785007 (+ 1283us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:28:27.785008 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:28:27.786357 (+ 1349us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:28:27.786360 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:28:27.787158 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:28:27.787159 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:28:27.787249 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:27.787264 (+ 15us) client_negotiation.cc:769] Sending connection context
0810 15:28:27.787369 (+ 105us) client_negotiation.cc:240] Negotiation successful
0810 15:28:27.787429 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"mutex_wait_us":58,"thread_start_us":61,"threads_started":1}
I20260810 15:28:27.787703 14068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:27.783068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.130:39415 (local address 127.0.0.1:43852)
0810 15:28:27.783319 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:27.783329 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 15:28:27.783372 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:28:27.783683 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:28:27.783684 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:28:27.783686 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:28:27.783819 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:28:27.783822 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:28:27.784896 (+ 1074us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:28:27.784897 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:28:27.786513 (+ 1616us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:28:27.786515 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:28:27.787480 (+ 965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:28:27.787480 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:28:27.787551 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:27.787555 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 15:28:27.787607 (+ 52us) client_negotiation.cc:240] Negotiation successful
0810 15:28:27.787640 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":239,"mutex_wait_us":64,"thread_start_us":109,"threads_started":1}
I20260810 15:28:27.787722 14074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:27.783302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39182 (local address 127.18.68.131:37887)
0810 15:28:27.783498 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0810 15:28:27.783502 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 15:28:27.783917 (+ 415us) server_negotiation.cc:407] Connection header received
0810 15:28:27.783962 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:28:27.783965 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:28:27.783980 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:28:27.784051 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:28:27.784260 (+ 209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:27.785248 (+ 988us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:27.786428 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:27.787145 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:27.787221 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:27.787276 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0810 15:28:27.787588 (+ 312us) server_negotiation.cc:299] Negotiation successful
0810 15:28:27.787632 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":166,"thread_start_us":94,"threads_started":1}
I20260810 15:28:27.787811 14070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:27.783068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.131:37887 (local address 127.0.0.1:39182)
0810 15:28:27.783790 (+ 722us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:27.783801 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 15:28:27.783853 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:28:27.784130 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:28:27.784130 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:28:27.784132 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:28:27.784170 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:28:27.784171 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:28:27.785346 (+ 1175us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:28:27.785347 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:28:27.786341 (+ 994us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:28:27.786344 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:28:27.787316 (+ 972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:28:27.787317 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:28:27.787386 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:27.787390 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 15:28:27.787438 (+ 48us) client_negotiation.cc:240] Negotiation successful
0810 15:28:27.787483 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":702,"mutex_wait_us":4,"thread_start_us":90,"threads_started":1}
I20260810 15:28:27.788025 14073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:27.783310 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43852 (local address 127.18.68.130:39415)
0810 15:28:27.783498 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0810 15:28:27.783502 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 15:28:27.783514 (+ 12us) server_negotiation.cc:407] Connection header received
0810 15:28:27.783557 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:28:27.783559 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:28:27.783573 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:28:27.783685 (+ 112us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:28:27.783980 (+ 295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:27.784788 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:27.786602 (+ 1814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:27.787332 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:27.787396 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:27.787448 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0810 15:28:27.787878 (+ 430us) server_negotiation.cc:299] Negotiation successful
0810 15:28:27.787935 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157,"thread_start_us":83,"threads_started":1}
I20260810 15:28:27.788719 13941 tablet_service.cc:1467] Processing CreateTablet for tablet e9f44ebef32d4d4a9739647fea1da822 (DEFAULT_TABLE table=test-table [id=a37779c4a0e748d892bd58f471bca96d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 15:28:27.788731 13719 tablet_service.cc:1467] Processing CreateTablet for tablet e9f44ebef32d4d4a9739647fea1da822 (DEFAULT_TABLE table=test-table [id=a37779c4a0e748d892bd58f471bca96d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 15:28:27.789108 13941 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e9f44ebef32d4d4a9739647fea1da822. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:28:27.789109 13719 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e9f44ebef32d4d4a9739647fea1da822. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:28:27.789057 13486 tablet_service.cc:1467] Processing CreateTablet for tablet e9f44ebef32d4d4a9739647fea1da822 (DEFAULT_TABLE table=test-table [id=a37779c4a0e748d892bd58f471bca96d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 15:28:27.789357 13486 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e9f44ebef32d4d4a9739647fea1da822. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:28:27.791958 14077 tablet_bootstrap.cc:492] T e9f44ebef32d4d4a9739647fea1da822 P dee73ad54e7740bbbbfaafc864b08b64: Bootstrap starting.
I20260810 15:28:27.792531 14078 tablet_bootstrap.cc:492] T e9f44ebef32d4d4a9739647fea1da822 P e428d6c365a44bfbb97901a4471ff5d4: Bootstrap starting.
I20260810 15:28:27.792838 14077 tablet_bootstrap.cc:654] T e9f44ebef32d4d4a9739647fea1da822 P dee73ad54e7740bbbbfaafc864b08b64: Neither blocks nor log segments found. Creating new log.
I20260810 15:28:27.793241 14078 tablet_bootstrap.cc:654] T e9f44ebef32d4d4a9739647fea1da822 P e428d6c365a44bfbb97901a4471ff5d4: Neither blocks nor log segments found. Creating new log.
I20260810 15:28:27.793573 14077 log.cc:824] T e9f44ebef32d4d4a9739647fea1da822 P dee73ad54e7740bbbbfaafc864b08b64: Log is configured to *not* fsync() on all Append() calls
I20260810 15:28:27.793857 14078 log.cc:824] T e9f44ebef32d4d4a9739647fea1da822 P e428d6c365a44bfbb97901a4471ff5d4: Log is configured to *not* fsync() on all Append() calls
I20260810 15:28:27.793977 14079 tablet_bootstrap.cc:492] T e9f44ebef32d4d4a9739647fea1da822 P 2504da2f74754aeebf64a3b94ec9dacd: Bootstrap starting.
I20260810 15:28:27.794489 14077 tablet_bootstrap.cc:492] T e9f44ebef32d4d4a9739647fea1da822 P dee73ad54e7740bbbbfaafc864b08b64: No bootstrap required, opened a new log
I20260810 15:28:27.794549 14077 ts_tablet_manager.cc:1397] T e9f44ebef32d4d4a9739647fea1da822 P dee73ad54e7740bbbbfaafc864b08b64: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260810 15:28:27.794664 14078 tablet_bootstrap.cc:492] T e9f44ebef32d4d4a9739647fea1da822 P e428d6c365a44bfbb97901a4471ff5d4: No bootstrap required, opened a new log
I20260810 15:28:27.794751 14078 ts_tablet_manager.cc:1397] T e9f44ebef32d4d4a9739647fea1da822 P e428d6c365a44bfbb97901a4471ff5d4: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260810 15:28:27.795994 14077 raft_consensus.cc:348] T e9f44ebef32d4d4a9739647fea1da822 P dee73ad54e7740bbbbfaafc864b08b64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2504da2f74754aeebf64a3b94ec9dacd" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 38391 } } peers { permanent_uuid: "dee73ad54e7740bbbbfaafc864b08b64" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37887 } } peers { permanent_uuid: "e428d6c365a44bfbb97901a4471ff5d4" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 39415 } }
I20260810 15:28:27.796177 14077 raft_consensus.cc:374] T e9f44ebef32d4d4a9739647fea1da822 P dee73ad54e7740bbbbfaafc864b08b64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:28:27.796224 14077 raft_consensus.cc:729] T e9f44ebef32d4d4a9739647fea1da822 P dee73ad54e7740bbbbfaafc864b08b64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dee73ad54e7740bbbbfaafc864b08b64, State: Initialized, Role: FOLLOWER
I20260810 15:28:27.796052 14078 raft_consensus.cc:348] T e9f44ebef32d4d4a9739647fea1da822 P e428d6c365a44bfbb97901a4471ff5d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2504da2f74754aeebf64a3b94ec9dacd" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 38391 } } peers { permanent_uuid: "dee73ad54e7740bbbbfaafc864b08b64" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37887 } } peers { permanent_uuid: "e428d6c365a44bfbb97901a4471ff5d4" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 39415 } }
I20260810 15:28:27.796277 14078 raft_consensus.cc:374] T e9f44ebef32d4d4a9739647fea1da822 P e428d6c365a44bfbb97901a4471ff5d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:28:27.796329 14078 raft_consensus.cc:729] T e9f44ebef32d4d4a9739647fea1da822 P e428d6c365a44bfbb97901a4471ff5d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e428d6c365a44bfbb97901a4471ff5d4, State: Initialized, Role: FOLLOWER
I20260810 15:28:27.796340 14077 consensus_queue.cc:260] T e9f44ebef32d4d4a9739647fea1da822 P dee73ad54e7740bbbbfaafc864b08b64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2504da2f74754aeebf64a3b94ec9dacd" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 38391 } } peers { permanent_uuid: "dee73ad54e7740bbbbfaafc864b08b64" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37887 } } peers { permanent_uuid: "e428d6c365a44bfbb97901a4471ff5d4" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 39415 } }
I20260810 15:28:27.796445 14078 consensus_queue.cc:260] T e9f44ebef32d4d4a9739647fea1da822 P e428d6c365a44bfbb97901a4471ff5d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2504da2f74754aeebf64a3b94ec9dacd" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 38391 } } peers { permanent_uuid: "dee73ad54e7740bbbbfaafc864b08b64" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37887 } } peers { permanent_uuid: "e428d6c365a44bfbb97901a4471ff5d4" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 39415 } }
I20260810 15:28:27.796658 14077 ts_tablet_manager.cc:1428] T e9f44ebef32d4d4a9739647fea1da822 P dee73ad54e7740bbbbfaafc864b08b64: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 15:28:27.796671 14052 heartbeater.cc:503] Master 127.18.68.190:42677 was elected leader, sending a full tablet report...
I20260810 15:28:27.796736 14078 ts_tablet_manager.cc:1428] T e9f44ebef32d4d4a9739647fea1da822 P e428d6c365a44bfbb97901a4471ff5d4: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260810 15:28:27.796986 13833 heartbeater.cc:503] Master 127.18.68.190:42677 was elected leader, sending a full tablet report...
I20260810 15:28:27.797542 14079 tablet_bootstrap.cc:654] T e9f44ebef32d4d4a9739647fea1da822 P 2504da2f74754aeebf64a3b94ec9dacd: Neither blocks nor log segments found. Creating new log.
I20260810 15:28:27.798345 14079 log.cc:824] T e9f44ebef32d4d4a9739647fea1da822 P 2504da2f74754aeebf64a3b94ec9dacd: Log is configured to *not* fsync() on all Append() calls
I20260810 15:28:27.799160 14079 tablet_bootstrap.cc:492] T e9f44ebef32d4d4a9739647fea1da822 P 2504da2f74754aeebf64a3b94ec9dacd: No bootstrap required, opened a new log
I20260810 15:28:27.799219 14079 ts_tablet_manager.cc:1397] T e9f44ebef32d4d4a9739647fea1da822 P 2504da2f74754aeebf64a3b94ec9dacd: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260810 15:28:27.800786 14079 raft_consensus.cc:348] T e9f44ebef32d4d4a9739647fea1da822 P 2504da2f74754aeebf64a3b94ec9dacd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2504da2f74754aeebf64a3b94ec9dacd" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 38391 } } peers { permanent_uuid: "dee73ad54e7740bbbbfaafc864b08b64" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37887 } } peers { permanent_uuid: "e428d6c365a44bfbb97901a4471ff5d4" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 39415 } }
I20260810 15:28:27.800992 14079 raft_consensus.cc:374] T e9f44ebef32d4d4a9739647fea1da822 P 2504da2f74754aeebf64a3b94ec9dacd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:28:27.801017 14079 raft_consensus.cc:729] T e9f44ebef32d4d4a9739647fea1da822 P 2504da2f74754aeebf64a3b94ec9dacd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2504da2f74754aeebf64a3b94ec9dacd, State: Initialized, Role: FOLLOWER
I20260810 15:28:27.801142 14079 consensus_queue.cc:260] T e9f44ebef32d4d4a9739647fea1da822 P 2504da2f74754aeebf64a3b94ec9dacd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2504da2f74754aeebf64a3b94ec9dacd" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 38391 } } peers { permanent_uuid: "dee73ad54e7740bbbbfaafc864b08b64" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37887 } } peers { permanent_uuid: "e428d6c365a44bfbb97901a4471ff5d4" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 39415 } }
I20260810 15:28:27.801463 14079 ts_tablet_manager.cc:1428] T e9f44ebef32d4d4a9739647fea1da822 P 2504da2f74754aeebf64a3b94ec9dacd: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 15:28:27.801550 13589 heartbeater.cc:503] Master 127.18.68.190:42677 was elected leader, sending a full tablet report...
W20260810 15:28:27.835233 13834 tablet.cc:2369] T e9f44ebef32d4d4a9739647fea1da822 P e428d6c365a44bfbb97901a4471ff5d4: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 15:28:27.914425 13590 tablet.cc:2369] T e9f44ebef32d4d4a9739647fea1da822 P 2504da2f74754aeebf64a3b94ec9dacd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 15:28:27.917035 14086 raft_consensus.cc:482] T e9f44ebef32d4d4a9739647fea1da822 P e428d6c365a44bfbb97901a4471ff5d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 15:28:27.917145 14086 raft_consensus.cc:504] T e9f44ebef32d4d4a9739647fea1da822 P e428d6c365a44bfbb97901a4471ff5d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2504da2f74754aeebf64a3b94ec9dacd" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 38391 } } peers { permanent_uuid: "dee73ad54e7740bbbbfaafc864b08b64" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37887 } } peers { permanent_uuid: "e428d6c365a44bfbb97901a4471ff5d4" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 39415 } }
I20260810 15:28:27.917552 14086 leader_election.cc:288] T e9f44ebef32d4d4a9739647fea1da822 P e428d6c365a44bfbb97901a4471ff5d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2504da2f74754aeebf64a3b94ec9dacd (127.18.68.129:38391), dee73ad54e7740bbbbfaafc864b08b64 (127.18.68.131:37887)
I20260810 15:28:27.920996 13837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:27.917814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.129:38391 (local address 127.18.68.130:41889)
0810 15:28:27.917881 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:27.917895 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 15:28:27.917948 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:28:27.918199 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:28:27.918200 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:28:27.918203 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:28:27.918286 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:28:27.918288 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:28:27.919329 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:28:27.919330 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:28:27.920115 (+ 785us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:28:27.920117 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:28:27.920706 (+ 589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:28:27.920707 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:28:27.920805 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:27.920808 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 15:28:27.920870 (+ 62us) client_negotiation.cc:240] Negotiation successful
0810 15:28:27.920919 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45,"mutex_wait_us":28}
I20260810 15:28:27.920996 14072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:27.917890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.130:41889 (local address 127.18.68.129:38391)
0810 15:28:27.917949 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0810 15:28:27.917952 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 15:28:27.917963 (+ 11us) server_negotiation.cc:407] Connection header received
0810 15:28:27.918099 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:28:27.918101 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:28:27.918114 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:28:27.918179 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:28:27.918370 (+ 191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:27.919232 (+ 862us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:27.920232 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:27.920635 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:27.920706 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:27.920716 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0810 15:28:27.920889 (+ 173us) server_negotiation.cc:299] Negotiation successful
0810 15:28:27.920930 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260810 15:28:27.921293 14074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:27.917996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.130:53585 (local address 127.18.68.131:37887)
0810 15:28:27.918052 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0810 15:28:27.918054 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:28:27.918146 (+ 92us) server_negotiation.cc:407] Connection header received
0810 15:28:27.918230 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:28:27.918231 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:28:27.918241 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:28:27.918312 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:28:27.918600 (+ 288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:27.919360 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:27.920400 (+ 1040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:27.920832 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:27.920941 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:27.920951 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0810 15:28:27.921158 (+ 207us) server_negotiation.cc:299] Negotiation successful
0810 15:28:27.921219 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260810 15:28:27.921355 13517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9f44ebef32d4d4a9739647fea1da822" candidate_uuid: "e428d6c365a44bfbb97901a4471ff5d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2504da2f74754aeebf64a3b94ec9dacd" is_pre_election: true
I20260810 15:28:27.921547 13517 raft_consensus.cc:2454] T e9f44ebef32d4d4a9739647fea1da822 P 2504da2f74754aeebf64a3b94ec9dacd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e428d6c365a44bfbb97901a4471ff5d4 in term 0.
I20260810 15:28:27.921559 14091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:27.917826 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.131:37887 (local address 127.18.68.130:53585)
0810 15:28:27.918053 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:27.918088 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0810 15:28:27.918161 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:28:27.918322 (+ 161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:28:27.918342 (+ 20us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:28:27.918345 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:28:27.918440 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:28:27.918441 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:28:27.919441 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:28:27.919442 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:28:27.920299 (+ 857us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:28:27.920301 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:28:27.920943 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:28:27.920944 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:28:27.921021 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:27.921025 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 15:28:27.921409 (+ 384us) client_negotiation.cc:240] Negotiation successful
0810 15:28:27.921464 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":207,"mutex_wait_us":15,"thread_start_us":123,"threads_started":1}
I20260810 15:28:27.921851 13635 leader_election.cc:302] T e9f44ebef32d4d4a9739647fea1da822 P e428d6c365a44bfbb97901a4471ff5d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2504da2f74754aeebf64a3b94ec9dacd, e428d6c365a44bfbb97901a4471ff5d4; no voters:
I20260810 15:28:27.921990 13970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9f44ebef32d4d4a9739647fea1da822" candidate_uuid: "e428d6c365a44bfbb97901a4471ff5d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dee73ad54e7740bbbbfaafc864b08b64" is_pre_election: true
I20260810 15:28:27.922180 13970 raft_consensus.cc:2454] T e9f44ebef32d4d4a9739647fea1da822 P dee73ad54e7740bbbbfaafc864b08b64 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e428d6c365a44bfbb97901a4471ff5d4 in term 0.
I20260810 15:28:27.922302 14086 raft_consensus.cc:2781] T e9f44ebef32d4d4a9739647fea1da822 P e428d6c365a44bfbb97901a4471ff5d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 15:28:27.922391 14086 raft_consensus.cc:482] T e9f44ebef32d4d4a9739647fea1da822 P e428d6c365a44bfbb97901a4471ff5d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 15:28:27.922418 14086 raft_consensus.cc:3037] T e9f44ebef32d4d4a9739647fea1da822 P e428d6c365a44bfbb97901a4471ff5d4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:28:27.923131 14086 raft_consensus.cc:504] T e9f44ebef32d4d4a9739647fea1da822 P e428d6c365a44bfbb97901a4471ff5d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2504da2f74754aeebf64a3b94ec9dacd" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 38391 } } peers { permanent_uuid: "dee73ad54e7740bbbbfaafc864b08b64" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37887 } } peers { permanent_uuid: "e428d6c365a44bfbb97901a4471ff5d4" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 39415 } }
I20260810 15:28:27.923275 14086 leader_election.cc:288] T e9f44ebef32d4d4a9739647fea1da822 P e428d6c365a44bfbb97901a4471ff5d4 [CANDIDATE]: Term 1 election: Requested vote from peers 2504da2f74754aeebf64a3b94ec9dacd (127.18.68.129:38391), dee73ad54e7740bbbbfaafc864b08b64 (127.18.68.131:37887)
I20260810 15:28:27.923487 13970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9f44ebef32d4d4a9739647fea1da822" candidate_uuid: "e428d6c365a44bfbb97901a4471ff5d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dee73ad54e7740bbbbfaafc864b08b64"
I20260810 15:28:27.923552 13970 raft_consensus.cc:3037] T e9f44ebef32d4d4a9739647fea1da822 P dee73ad54e7740bbbbfaafc864b08b64 [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:28:27.923652 13517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9f44ebef32d4d4a9739647fea1da822" candidate_uuid: "e428d6c365a44bfbb97901a4471ff5d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2504da2f74754aeebf64a3b94ec9dacd"
I20260810 15:28:27.923745 13517 raft_consensus.cc:3037] T e9f44ebef32d4d4a9739647fea1da822 P 2504da2f74754aeebf64a3b94ec9dacd [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:28:27.924530 13970 raft_consensus.cc:2454] T e9f44ebef32d4d4a9739647fea1da822 P dee73ad54e7740bbbbfaafc864b08b64 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e428d6c365a44bfbb97901a4471ff5d4 in term 1.
I20260810 15:28:27.924728 13517 raft_consensus.cc:2454] T e9f44ebef32d4d4a9739647fea1da822 P 2504da2f74754aeebf64a3b94ec9dacd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e428d6c365a44bfbb97901a4471ff5d4 in term 1.
I20260810 15:28:27.924783 13629 leader_election.cc:302] T e9f44ebef32d4d4a9739647fea1da822 P e428d6c365a44bfbb97901a4471ff5d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dee73ad54e7740bbbbfaafc864b08b64, e428d6c365a44bfbb97901a4471ff5d4; no voters:
I20260810 15:28:27.924858 14086 raft_consensus.cc:2781] T e9f44ebef32d4d4a9739647fea1da822 P e428d6c365a44bfbb97901a4471ff5d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 15:28:27.924993 14086 raft_consensus.cc:686] T e9f44ebef32d4d4a9739647fea1da822 P e428d6c365a44bfbb97901a4471ff5d4 [term 1 LEADER]: Becoming Leader. State: Replica: e428d6c365a44bfbb97901a4471ff5d4, State: Running, Role: LEADER
I20260810 15:28:27.925096 14086 consensus_queue.cc:237] T e9f44ebef32d4d4a9739647fea1da822 P e428d6c365a44bfbb97901a4471ff5d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2504da2f74754aeebf64a3b94ec9dacd" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 38391 } } peers { permanent_uuid: "dee73ad54e7740bbbbfaafc864b08b64" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37887 } } peers { permanent_uuid: "e428d6c365a44bfbb97901a4471ff5d4" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 39415 } }
I20260810 15:28:27.925961 13262 catalog_manager.cc:5495] T e9f44ebef32d4d4a9739647fea1da822 P e428d6c365a44bfbb97901a4471ff5d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to e428d6c365a44bfbb97901a4471ff5d4 (127.18.68.130). New cstate: current_term: 1 leader_uuid: "e428d6c365a44bfbb97901a4471ff5d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2504da2f74754aeebf64a3b94ec9dacd" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 38391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dee73ad54e7740bbbbfaafc864b08b64" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e428d6c365a44bfbb97901a4471ff5d4" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 39415 } health_report { overall_health: HEALTHY } } }
I20260810 15:28:27.934476 14073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:27.932005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43862 (local address 127.18.68.130:39415)
0810 15:28:27.932066 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0810 15:28:27.932069 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 15:28:27.932078 (+ 9us) server_negotiation.cc:407] Connection header received
0810 15:28:27.932135 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:28:27.932136 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:28:27.932162 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:28:27.932237 (+ 75us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 15:28:27.932389 (+ 152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:27.932861 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:27.933627 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:27.933828 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:27.933900 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:27.934100 (+ 200us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 15:28:27.934213 (+ 113us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 15:28:27.934305 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0810 15:28:27.934347 (+ 42us) server_negotiation.cc:299] Negotiation successful
0810 15:28:27.934367 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260810 15:28:27.936314 13517 raft_consensus.cc:1261] T e9f44ebef32d4d4a9739647fea1da822 P 2504da2f74754aeebf64a3b94ec9dacd [term 1 FOLLOWER]: Refusing update from remote peer e428d6c365a44bfbb97901a4471ff5d4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 15:28:27.936316 13970 raft_consensus.cc:1261] T e9f44ebef32d4d4a9739647fea1da822 P dee73ad54e7740bbbbfaafc864b08b64 [term 1 FOLLOWER]: Refusing update from remote peer e428d6c365a44bfbb97901a4471ff5d4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 15:28:27.936699 14092 consensus_queue.cc:1035] T e9f44ebef32d4d4a9739647fea1da822 P e428d6c365a44bfbb97901a4471ff5d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2504da2f74754aeebf64a3b94ec9dacd" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 38391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 15:28:27.936815 14086 consensus_queue.cc:1035] T e9f44ebef32d4d4a9739647fea1da822 P e428d6c365a44bfbb97901a4471ff5d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dee73ad54e7740bbbbfaafc864b08b64" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 15:28:27.939435 14095 mvcc.cc:205] Tried to move back new op lower bound from 7316994899704414208 to 7316994899661651968. Current Snapshot: MvccSnapshot[applied={T|T < 7316994899704414208}]
I20260810 15:28:27.939877 14098 mvcc.cc:205] Tried to move back new op lower bound from 7316994899704414208 to 7316994899661651968. Current Snapshot: MvccSnapshot[applied={T|T < 7316994899704414208}]
I20260810 15:28:27.940312 14096 mvcc.cc:205] Tried to move back new op lower bound from 7316994899704414208 to 7316994899661651968. Current Snapshot: MvccSnapshot[applied={T|T < 7316994899704414208}]
I20260810 15:28:27.941829 13265 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33964:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 15:28:27.941947 13265 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33964:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 15:28:27.942778 13265 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 963e2863e7434f1c9258598c51d06dfd: Sending DeleteTablet for 3 replicas of tablet e9f44ebef32d4d4a9739647fea1da822
I20260810 15:28:27.943120 13486 tablet_service.cc:1514] Processing DeleteTablet for tablet e9f44ebef32d4d4a9739647fea1da822 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 15:28:27 UTC) from {username='kudu', principal='kudu/127.18.68.190@KRBTEST.COM'} at 127.0.0.1:56952
I20260810 15:28:27.943194 13941 tablet_service.cc:1514] Processing DeleteTablet for tablet e9f44ebef32d4d4a9739647fea1da822 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 15:28:27 UTC) from {username='kudu', principal='kudu/127.18.68.190@KRBTEST.COM'} at 127.0.0.1:39182
I20260810 15:28:27.943218 13719 tablet_service.cc:1514] Processing DeleteTablet for tablet e9f44ebef32d4d4a9739647fea1da822 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 15:28:27 UTC) from {username='kudu', principal='kudu/127.18.68.190@KRBTEST.COM'} at 127.0.0.1:43852
I20260810 15:28:27.943356 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 13381
I20260810 15:28:27.943487 14115 tablet_replica.cc:330] T e9f44ebef32d4d4a9739647fea1da822 P e428d6c365a44bfbb97901a4471ff5d4: stopping tablet replica
I20260810 15:28:27.943604 14115 raft_consensus.cc:2229] T e9f44ebef32d4d4a9739647fea1da822 P e428d6c365a44bfbb97901a4471ff5d4 [term 1 LEADER]: Raft consensus shutting down.
I20260810 15:28:27.943674 14114 tablet_replica.cc:330] T e9f44ebef32d4d4a9739647fea1da822 P dee73ad54e7740bbbbfaafc864b08b64: stopping tablet replica
I20260810 15:28:27.943708 14115 raft_consensus.cc:2258] T e9f44ebef32d4d4a9739647fea1da822 P e428d6c365a44bfbb97901a4471ff5d4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 15:28:27.944018 14114 raft_consensus.cc:2229] T e9f44ebef32d4d4a9739647fea1da822 P dee73ad54e7740bbbbfaafc864b08b64 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 15:28:27.944427 14115 ts_tablet_manager.cc:1905] T e9f44ebef32d4d4a9739647fea1da822 P e428d6c365a44bfbb97901a4471ff5d4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 15:28:27.944710 14114 raft_consensus.cc:2258] T e9f44ebef32d4d4a9739647fea1da822 P dee73ad54e7740bbbbfaafc864b08b64 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 15:28:27.947455 14115 ts_tablet_manager.cc:1918] T e9f44ebef32d4d4a9739647fea1da822 P e428d6c365a44bfbb97901a4471ff5d4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 15:28:27.947659 14115 log.cc:1196] T e9f44ebef32d4d4a9739647fea1da822 P e428d6c365a44bfbb97901a4471ff5d4: Deleting WAL directory at /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-1/wal/wals/e9f44ebef32d4d4a9739647fea1da822
I20260810 15:28:27.948103 14115 ts_tablet_manager.cc:1939] T e9f44ebef32d4d4a9739647fea1da822 P e428d6c365a44bfbb97901a4471ff5d4: Deleting consensus metadata
I20260810 15:28:27.948776 13245 catalog_manager.cc:4841] TS e428d6c365a44bfbb97901a4471ff5d4 (127.18.68.130:39415): tablet e9f44ebef32d4d4a9739647fea1da822 (table test-table [id=a37779c4a0e748d892bd58f471bca96d]) successfully deleted
I20260810 15:28:27.950968 14114 ts_tablet_manager.cc:1905] T e9f44ebef32d4d4a9739647fea1da822 P dee73ad54e7740bbbbfaafc864b08b64: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 15:28:27.952679 14114 ts_tablet_manager.cc:1918] T e9f44ebef32d4d4a9739647fea1da822 P dee73ad54e7740bbbbfaafc864b08b64: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 15:28:27.952796 14114 log.cc:1196] T e9f44ebef32d4d4a9739647fea1da822 P dee73ad54e7740bbbbfaafc864b08b64: Deleting WAL directory at /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-2/wal/wals/e9f44ebef32d4d4a9739647fea1da822
I20260810 15:28:27.953115 14114 ts_tablet_manager.cc:1939] T e9f44ebef32d4d4a9739647fea1da822 P dee73ad54e7740bbbbfaafc864b08b64: Deleting consensus metadata
I20260810 15:28:27.954108 13243 catalog_manager.cc:4841] TS dee73ad54e7740bbbbfaafc864b08b64 (127.18.68.131:37887): tablet e9f44ebef32d4d4a9739647fea1da822 (table test-table [id=a37779c4a0e748d892bd58f471bca96d]) successfully deleted
W20260810 15:28:27.960891 13246 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.18.68.129:38391 (error 108)
I20260810 15:28:27.961558 14068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:27.961377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.129:38391 (local address 127.0.0.1:56966)
0810 15:28:27.961449 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:27.961500 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.129:38391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260810 15:28:27.961611 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 13595
W20260810 15:28:27.972719 13246 catalog_manager.cc:4584] TS 2504da2f74754aeebf64a3b94ec9dacd (127.18.68.129:38391): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet e9f44ebef32d4d4a9739647fea1da822: Network error: Client connection negotiation failed: client connection to 127.18.68.129:38391: connect: Connection refused (error 111)
I20260810 15:28:27.979440 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 13843
I20260810 15:28:27.988408 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 13212
I20260810 15:28:48.003623 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.190:42677
--webserver_interface=127.18.68.190
--webserver_port=35787
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab
--principal=kudu/127.18.68.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:36547
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.68.190:42677
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:28:48.089361 14118 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:28:48.089635 14118 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:28:48.089672 14118 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:28:48.090871 14118 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260810 15:28:48.090943 14118 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260810 15:28:48.090967 14118 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260810 15:28:48.090986 14118 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 15:28:48.091017 14118 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:28:48.091075 14118 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:28:48.091107 14118 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 15:28:48.091136 14118 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 15:28:48.092700 14118 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:36547
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.18.68.190:42677
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab
--principal=kudu/127.18.68.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.190:42677
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.68.190
--webserver_port=35787
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14118
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:28:48.093004 14118 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:28:48.093253 14118 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:28:48.102880 14131 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:28:48.102880 14127 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:28:48.102895 14129 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:28:48.103274 14118 server_base.cc:1034] running on GCE node
I20260810 15:28:48.103528 14118 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:28:48.103870 14118 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:28:48.105074 14118 hybrid_clock.cc:648] HybridClock initialized: now 1786375728105058 us; error 32 us; skew 500 ppm
Aug 10 15:28:48 dist-test-slave-2p8l krb5kdc[13190](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375728, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:28:48.112064 14118 init.cc:377] Logged in from keytab as kudu/127.18.68.190@KRBTEST.COM (short username kudu)
I20260810 15:28:48.112537 14118 webserver.cc:460] Webserver started at http://127.18.68.190:35787/ using document root <none> and password file <none>
I20260810 15:28:48.112771 14118 fs_manager.cc:359] Metadata directory not provided
I20260810 15:28:48.112829 14118 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:28:48.114353 14118 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.001s
I20260810 15:28:48.115127 14145 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:28:48.115348 14118 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260810 15:28:48.115449 14118 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/master-0/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/master-0/wal
uuid: "963e2863e7434f1c9258598c51d06dfd"
format_stamp: "Formatted at 2026-08-10 15:28:27 on dist-test-slave-2p8l"
server_key: "9516f1afec1008f72c46ea43258b581e"
server_key_iv: "453dfdec05cdbfce41f584edcf6b5cc4"
server_key_version: "encryptionkey@0"
I20260810 15:28:48.115881 14118 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:28:48.140511 14118 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:28:48.142885 14118 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:28:48.143007 14118 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:28:48.147311 14118 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.190:42677
I20260810 15:28:48.147347 14232 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.190:42677 every 8 connection(s)
I20260810 15:28:48.147782 14118 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
I20260810 15:28:48.149408 14235 sys_catalog.cc:263] Verifying existing consensus state
I20260810 15:28:48.150179 14235 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 963e2863e7434f1c9258598c51d06dfd: Bootstrap starting.
I20260810 15:28:48.150614 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 14118
I20260810 15:28:48.150946 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.68.129:38391
--local_ip_for_outbound_sockets=127.18.68.129
--tserver_master_addrs=127.18.68.190:42677
--webserver_port=39509
--webserver_interface=127.18.68.129
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.129.keytab
--principal=kudu/127.18.68.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:36547
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 15:28:48.160069 14235 log.cc:824] T 00000000000000000000000000000000 P 963e2863e7434f1c9258598c51d06dfd: Log is configured to *not* fsync() on all Append() calls
I20260810 15:28:48.162351 14235 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 963e2863e7434f1c9258598c51d06dfd: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 15:28:48.162675 14235 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 963e2863e7434f1c9258598c51d06dfd: Bootstrap complete.
I20260810 15:28:48.165071 14235 raft_consensus.cc:348] T 00000000000000000000000000000000 P 963e2863e7434f1c9258598c51d06dfd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "963e2863e7434f1c9258598c51d06dfd" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 42677 } }
I20260810 15:28:48.165343 14235 raft_consensus.cc:729] T 00000000000000000000000000000000 P 963e2863e7434f1c9258598c51d06dfd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 963e2863e7434f1c9258598c51d06dfd, State: Initialized, Role: FOLLOWER
I20260810 15:28:48.165575 14235 consensus_queue.cc:260] T 00000000000000000000000000000000 P 963e2863e7434f1c9258598c51d06dfd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "963e2863e7434f1c9258598c51d06dfd" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 42677 } }
I20260810 15:28:48.165673 14235 raft_consensus.cc:388] T 00000000000000000000000000000000 P 963e2863e7434f1c9258598c51d06dfd [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 15:28:48.165733 14235 raft_consensus.cc:482] T 00000000000000000000000000000000 P 963e2863e7434f1c9258598c51d06dfd [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 15:28:48.165784 14235 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 963e2863e7434f1c9258598c51d06dfd [term 1 FOLLOWER]: Advancing to term 2
I20260810 15:28:48.166909 14235 raft_consensus.cc:504] T 00000000000000000000000000000000 P 963e2863e7434f1c9258598c51d06dfd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "963e2863e7434f1c9258598c51d06dfd" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 42677 } }
I20260810 15:28:48.167039 14235 leader_election.cc:302] T 00000000000000000000000000000000 P 963e2863e7434f1c9258598c51d06dfd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 963e2863e7434f1c9258598c51d06dfd; no voters:
I20260810 15:28:48.167261 14235 leader_election.cc:288] T 00000000000000000000000000000000 P 963e2863e7434f1c9258598c51d06dfd [CANDIDATE]: Term 2 election: Requested vote from peers
I20260810 15:28:48.167292 14241 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 963e2863e7434f1c9258598c51d06dfd [term 2 FOLLOWER]: Leader election won for term 2
I20260810 15:28:48.167418 14241 raft_consensus.cc:686] T 00000000000000000000000000000000 P 963e2863e7434f1c9258598c51d06dfd [term 2 LEADER]: Becoming Leader. State: Replica: 963e2863e7434f1c9258598c51d06dfd, State: Running, Role: LEADER
I20260810 15:28:48.167559 14235 sys_catalog.cc:564] T 00000000000000000000000000000000 P 963e2863e7434f1c9258598c51d06dfd [sys.catalog]: configured and running, proceeding with master startup.
I20260810 15:28:48.167577 14241 consensus_queue.cc:237] T 00000000000000000000000000000000 P 963e2863e7434f1c9258598c51d06dfd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "963e2863e7434f1c9258598c51d06dfd" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 42677 } }
I20260810 15:28:48.167928 14242 sys_catalog.cc:455] T 00000000000000000000000000000000 P 963e2863e7434f1c9258598c51d06dfd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "963e2863e7434f1c9258598c51d06dfd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "963e2863e7434f1c9258598c51d06dfd" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 42677 } } }
I20260810 15:28:48.168107 14242 sys_catalog.cc:458] T 00000000000000000000000000000000 P 963e2863e7434f1c9258598c51d06dfd [sys.catalog]: This master's current role is: LEADER
I20260810 15:28:48.167929 14241 sys_catalog.cc:455] T 00000000000000000000000000000000 P 963e2863e7434f1c9258598c51d06dfd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 963e2863e7434f1c9258598c51d06dfd. Latest consensus state: current_term: 2 leader_uuid: "963e2863e7434f1c9258598c51d06dfd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "963e2863e7434f1c9258598c51d06dfd" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 42677 } } }
I20260810 15:28:48.168478 14241 sys_catalog.cc:458] T 00000000000000000000000000000000 P 963e2863e7434f1c9258598c51d06dfd [sys.catalog]: This master's current role is: LEADER
I20260810 15:28:48.168505 14255 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 15:28:48.169384 14255 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 15:28:48.169620 14255 catalog_manager.cc:1259] Loaded cluster ID: 737dd647fa494222aa9b63c4ee84d527
I20260810 15:28:48.169770 14255 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 15:28:48.170974 14255 catalog_manager.cc:1504] Loading token signing keys...
I20260810 15:28:48.171141 14255 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 963e2863e7434f1c9258598c51d06dfd: Loaded TSK: 0
I20260810 15:28:48.181130 14255 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 963e2863e7434f1c9258598c51d06dfd: Generated new TSK 1
I20260810 15:28:48.181232 14255 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260810 15:28:48.242973 14237 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:28:48.243242 14237 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:28:48.243286 14237 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:28:48.244570 14237 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:28:48.244643 14237 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:28:48.244693 14237 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.68.129
I20260810 15:28:48.246476 14237 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:36547
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.129.keytab
--principal=kudu/127.18.68.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.68.129:38391
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.68.129
--webserver_port=39509
--tserver_master_addrs=127.18.68.190:42677
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14237
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.68.129
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:28:48.246799 14237 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:28:48.247103 14237 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:28:48.253244 14278 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:28:48.253312 14287 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:28:48.253255 14280 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:28:48.253736 14237 server_base.cc:1034] running on GCE node
I20260810 15:28:48.253955 14237 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:28:48.254266 14237 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:28:48.255477 14237 hybrid_clock.cc:648] HybridClock initialized: now 1786375728255457 us; error 36 us; skew 500 ppm
Aug 10 15:28:48 dist-test-slave-2p8l krb5kdc[13190](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375728, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:28:48.258641 14237 init.cc:377] Logged in from keytab as kudu/127.18.68.129@KRBTEST.COM (short username kudu)
I20260810 15:28:48.259093 14237 webserver.cc:460] Webserver started at http://127.18.68.129:39509/ using document root <none> and password file <none>
I20260810 15:28:48.259353 14237 fs_manager.cc:359] Metadata directory not provided
I20260810 15:28:48.259442 14237 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:28:48.260921 14237 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:28:48.261693 14302 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:28:48.261883 14237 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:28:48.261976 14237 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-0/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-0/wal
uuid: "2504da2f74754aeebf64a3b94ec9dacd"
format_stamp: "Formatted at 2026-08-10 15:28:27 on dist-test-slave-2p8l"
server_key: "adebe38f8ed45961c99c83118f43d2bd"
server_key_iv: "8ac6acd1909b685c9b0d855989fd33d2"
server_key_version: "encryptionkey@0"
I20260810 15:28:48.262378 14237 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:28:48.289726 14237 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:28:48.292055 14237 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:28:48.292207 14237 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:28:48.292483 14237 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 15:28:48.293108 14313 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260810 15:28:48.295056 14237 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260810 15:28:48.295121 14237 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260810 15:28:48.295166 14237 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260810 15:28:48.295867 14237 ts_tablet_manager.cc:610] Registered 1 tablets
I20260810 15:28:48.295923 14237 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260810 15:28:48.295979 14313 tablet_bootstrap.cc:492] T e9f44ebef32d4d4a9739647fea1da822 P 2504da2f74754aeebf64a3b94ec9dacd: Bootstrap starting.
I20260810 15:28:48.303462 14237 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.129:38391
I20260810 15:28:48.303509 14480 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.129:38391 every 8 connection(s)
I20260810 15:28:48.303951 14237 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-0/data/info.pb
I20260810 15:28:48.307852 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 14237
I20260810 15:28:48.308177 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.68.130:39415
--local_ip_for_outbound_sockets=127.18.68.130
--tserver_master_addrs=127.18.68.190:42677
--webserver_port=40625
--webserver_interface=127.18.68.130
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.130.keytab
--principal=kudu/127.18.68.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:36547
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 15:28:48.308192 14313 log.cc:824] T e9f44ebef32d4d4a9739647fea1da822 P 2504da2f74754aeebf64a3b94ec9dacd: Log is configured to *not* fsync() on all Append() calls
I20260810 15:28:48.310947 14313 tablet_bootstrap.cc:492] T e9f44ebef32d4d4a9739647fea1da822 P 2504da2f74754aeebf64a3b94ec9dacd: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 15:28:48.311293 14313 tablet_bootstrap.cc:492] T e9f44ebef32d4d4a9739647fea1da822 P 2504da2f74754aeebf64a3b94ec9dacd: Bootstrap complete.
Aug 10 15:28:48 dist-test-slave-2p8l krb5kdc[13190](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375728, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.129@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
I20260810 15:28:48.312793 14313 ts_tablet_manager.cc:1397] T e9f44ebef32d4d4a9739647fea1da822 P 2504da2f74754aeebf64a3b94ec9dacd: Time spent bootstrapping tablet: real 0.017s user 0.005s sys 0.008s
I20260810 15:28:48.314246 14313 raft_consensus.cc:348] T e9f44ebef32d4d4a9739647fea1da822 P 2504da2f74754aeebf64a3b94ec9dacd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2504da2f74754aeebf64a3b94ec9dacd" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 38391 } } peers { permanent_uuid: "dee73ad54e7740bbbbfaafc864b08b64" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37887 } } peers { permanent_uuid: "e428d6c365a44bfbb97901a4471ff5d4" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 39415 } }
I20260810 15:28:48.314664 14313 raft_consensus.cc:729] T e9f44ebef32d4d4a9739647fea1da822 P 2504da2f74754aeebf64a3b94ec9dacd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2504da2f74754aeebf64a3b94ec9dacd, State: Initialized, Role: FOLLOWER
I20260810 15:28:48.314864 14313 consensus_queue.cc:260] T e9f44ebef32d4d4a9739647fea1da822 P 2504da2f74754aeebf64a3b94ec9dacd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2504da2f74754aeebf64a3b94ec9dacd" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 38391 } } peers { permanent_uuid: "dee73ad54e7740bbbbfaafc864b08b64" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37887 } } peers { permanent_uuid: "e428d6c365a44bfbb97901a4471ff5d4" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 39415 } }
I20260810 15:28:48.315215 14313 ts_tablet_manager.cc:1428] T e9f44ebef32d4d4a9739647fea1da822 P 2504da2f74754aeebf64a3b94ec9dacd: Time spent starting tablet: real 0.002s user 0.005s sys 0.000s
I20260810 15:28:48.321633 14491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:48.304818 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.129:49335 (local address 127.18.68.190:42677)
0810 15:28:48.305032 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0810 15:28:48.305043 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 15:28:48.305094 (+ 51us) server_negotiation.cc:407] Connection header received
0810 15:28:48.305710 (+ 616us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:28:48.305719 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:28:48.305796 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:28:48.305979 (+ 183us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:28:48.306687 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:48.308182 (+ 1495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:48.309450 (+ 1268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:48.309850 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:48.310000 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:48.313153 (+ 3153us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:28:48.313158 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:28:48.313158 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:28:48.313173 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:28:48.319037 (+ 5864us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:28:48.319751 (+ 714us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:28:48.319756 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:28:48.319756 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:28:48.319907 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:28:48.320252 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:28:48.320253 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:28:48.320254 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:28:48.320639 (+ 385us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:28:48.320753 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0810 15:28:48.321184 (+ 431us) server_negotiation.cc:299] Negotiation successful
0810 15:28:48.321361 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":164,"thread_start_us":99,"threads_started":1}
I20260810 15:28:48.322448 14490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:48.304728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42677 (local address 127.18.68.129:49335)
0810 15:28:48.304938 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:48.304983 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0810 15:28:48.305448 (+ 465us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:28:48.305999 (+ 551us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:28:48.306002 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:28:48.306353 (+ 351us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:28:48.306540 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:28:48.306545 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:28:48.308361 (+ 1816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:28:48.308362 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:28:48.309344 (+ 982us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:28:48.309347 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:28:48.310157 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:28:48.310158 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:28:48.310346 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:48.311012 (+ 666us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:28:48.311023 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:28:48.313016 (+ 1993us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:28:48.319226 (+ 6210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:28:48.319235 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:28:48.319237 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:28:48.319611 (+ 374us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:28:48.319992 (+ 381us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:28:48.319993 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:28:48.319994 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:28:48.320150 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:28:48.320746 (+ 596us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:28:48.320754 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:28:48.320958 (+ 204us) client_negotiation.cc:769] Sending connection context
0810 15:28:48.321920 (+ 962us) client_negotiation.cc:240] Negotiation successful
0810 15:28:48.322182 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":127,"threads_started":1}
I20260810 15:28:48.323369 14484 heartbeater.cc:347] Connected to a master server at 127.18.68.190:42677
I20260810 15:28:48.323472 14484 heartbeater.cc:464] Registering TS with master...
I20260810 15:28:48.323696 14484 heartbeater.cc:511] Master 127.18.68.190:42677 requested a full tablet report, sending...
I20260810 15:28:48.324529 14180 ts_manager.cc:194] Registered new tserver with Master: 2504da2f74754aeebf64a3b94ec9dacd (127.18.68.129:38391)
I20260810 15:28:48.325824 14180 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.68.129@KRBTEST.COM'} at 127.18.68.129:49335
I20260810 15:28:48.329317 14484 heartbeater.cc:503] Master 127.18.68.190:42677 was elected leader, sending a full tablet report...
Aug 10 15:28:48 dist-test-slave-2p8l krb5kdc[13190](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375728, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.190@KRBTEST.COM for kudu/127.18.68.129@KRBTEST.COM
I20260810 15:28:48.338722 14498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:48.325254 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.129:38391 (local address 127.0.0.1:48756)
0810 15:28:48.325532 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:48.325559 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0810 15:28:48.325658 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:28:48.325835 (+ 177us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:28:48.325841 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:28:48.326277 (+ 436us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:28:48.326351 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:28:48.326355 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:28:48.327654 (+ 1299us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:28:48.327655 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:28:48.328629 (+ 974us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:28:48.328632 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:28:48.330866 (+ 2234us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:28:48.330867 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:28:48.330975 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:48.331598 (+ 623us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:28:48.331605 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:28:48.333263 (+ 1658us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:28:48.337349 (+ 4086us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:28:48.337360 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:28:48.337362 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:28:48.337590 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:28:48.337838 (+ 248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:28:48.337839 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:28:48.337840 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:28:48.337905 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:28:48.338292 (+ 387us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:28:48.338300 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:28:48.338361 (+ 61us) client_negotiation.cc:769] Sending connection context
0810 15:28:48.338467 (+ 106us) client_negotiation.cc:240] Negotiation successful
0810 15:28:48.338623 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":242,"thread_start_us":101,"threads_started":1}
I20260810 15:28:48.338722 14501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:48.325314 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48756 (local address 127.18.68.129:38391)
0810 15:28:48.325457 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0810 15:28:48.325461 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 15:28:48.325637 (+ 176us) server_negotiation.cc:407] Connection header received
0810 15:28:48.325735 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:28:48.325738 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:28:48.325754 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:28:48.325821 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:28:48.326453 (+ 632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:48.327557 (+ 1104us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:48.330145 (+ 2588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:48.330691 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:48.330782 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:48.333355 (+ 2573us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:28:48.333363 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:28:48.333363 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:28:48.333370 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:28:48.337246 (+ 3876us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:28:48.337692 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:28:48.337696 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:28:48.337696 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:28:48.337766 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:28:48.337977 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:28:48.337978 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:28:48.337978 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:28:48.338214 (+ 236us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:28:48.338313 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0810 15:28:48.338505 (+ 192us) server_negotiation.cc:299] Negotiation successful
0810 15:28:48.338614 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":113,"thread_start_us":61,"threads_started":1}
I20260810 15:28:48.339567 14374 tablet_service.cc:1514] Processing DeleteTablet for tablet e9f44ebef32d4d4a9739647fea1da822 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 15:28:27 UTC) from {username='kudu', principal='kudu/127.18.68.190@KRBTEST.COM'} at 127.0.0.1:48756
I20260810 15:28:48.340135 14503 tablet_replica.cc:330] stopping tablet replica
I20260810 15:28:48.340265 14503 raft_consensus.cc:2229] T e9f44ebef32d4d4a9739647fea1da822 P 2504da2f74754aeebf64a3b94ec9dacd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 15:28:48.340342 14503 raft_consensus.cc:2258] T e9f44ebef32d4d4a9739647fea1da822 P 2504da2f74754aeebf64a3b94ec9dacd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 15:28:48.340713 14503 ts_tablet_manager.cc:1905] T e9f44ebef32d4d4a9739647fea1da822 P 2504da2f74754aeebf64a3b94ec9dacd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 15:28:48.343281 14503 ts_tablet_manager.cc:1918] T e9f44ebef32d4d4a9739647fea1da822 P 2504da2f74754aeebf64a3b94ec9dacd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 15:28:48.343374 14503 log.cc:1196] T e9f44ebef32d4d4a9739647fea1da822 P 2504da2f74754aeebf64a3b94ec9dacd: Deleting WAL directory at /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-0/wal/wals/e9f44ebef32d4d4a9739647fea1da822
I20260810 15:28:48.343621 14503 ts_tablet_manager.cc:1939] T e9f44ebef32d4d4a9739647fea1da822 P 2504da2f74754aeebf64a3b94ec9dacd: Deleting consensus metadata
I20260810 15:28:48.344162 14150 catalog_manager.cc:4841] TS 2504da2f74754aeebf64a3b94ec9dacd (127.18.68.129:38391): tablet e9f44ebef32d4d4a9739647fea1da822 (table test-table [id=a37779c4a0e748d892bd58f471bca96d]) successfully deleted
W20260810 15:28:48.424170 14495 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:28:48.424429 14495 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:28:48.424460 14495 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:28:48.425910 14495 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:28:48.425971 14495 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:28:48.426003 14495 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.68.130
I20260810 15:28:48.427858 14495 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:36547
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.130.keytab
--principal=kudu/127.18.68.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.68.130:39415
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.68.130
--webserver_port=40625
--tserver_master_addrs=127.18.68.190:42677
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14495
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.68.130
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:28:48.428136 14495 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:28:48.428429 14495 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:28:48.434144 14508 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:28:48.434172 14510 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:28:48.434172 14518 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:28:48.434850 14495 server_base.cc:1034] running on GCE node
I20260810 15:28:48.435045 14495 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:28:48.435273 14495 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:28:48.436424 14495 hybrid_clock.cc:648] HybridClock initialized: now 1786375728436412 us; error 27 us; skew 500 ppm
Aug 10 15:28:48 dist-test-slave-2p8l krb5kdc[13190](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375728, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:28:48.439424 14495 init.cc:377] Logged in from keytab as kudu/127.18.68.130@KRBTEST.COM (short username kudu)
I20260810 15:28:48.439954 14495 webserver.cc:460] Webserver started at http://127.18.68.130:40625/ using document root <none> and password file <none>
I20260810 15:28:48.440212 14495 fs_manager.cc:359] Metadata directory not provided
I20260810 15:28:48.440306 14495 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:28:48.442127 14495 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 15:28:48.442956 14533 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:28:48.443177 14495 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:28:48.443291 14495 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-1/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-1/wal
uuid: "e428d6c365a44bfbb97901a4471ff5d4"
format_stamp: "Formatted at 2026-08-10 15:28:27 on dist-test-slave-2p8l"
server_key: "9266be9fcf01d29b16c55ff0be3adb03"
server_key_iv: "714f39bd16dfa992d21402416c6bb8ea"
server_key_version: "encryptionkey@0"
I20260810 15:28:48.443722 14495 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:28:48.460095 14495 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:28:48.462834 14495 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:28:48.463011 14495 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:28:48.463292 14495 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 15:28:48.463634 14495 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 15:28:48.463692 14495 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 15:28:48.463726 14495 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 15:28:48.463754 14495 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 15:28:48.470206 14495 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.130:39415
I20260810 15:28:48.470247 14721 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.130:39415 every 8 connection(s)
I20260810 15:28:48.470614 14495 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-1/data/info.pb
Aug 10 15:28:48 dist-test-slave-2p8l krb5kdc[13190](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375728, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.130@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
I20260810 15:28:48.478371 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 14495
I20260810 15:28:48.478727 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.68.131:37887
--local_ip_for_outbound_sockets=127.18.68.131
--tserver_master_addrs=127.18.68.190:42677
--webserver_port=34127
--webserver_interface=127.18.68.131
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.131.keytab
--principal=kudu/127.18.68.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:36547
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 15:28:48.480829 14491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:48.471507 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.130:34107 (local address 127.18.68.190:42677)
0810 15:28:48.471571 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0810 15:28:48.471573 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:28:48.471859 (+ 286us) server_negotiation.cc:407] Connection header received
0810 15:28:48.472341 (+ 482us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:28:48.472343 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:28:48.472357 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:28:48.472413 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:28:48.473494 (+ 1081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:48.473994 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:48.475038 (+ 1044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:48.475252 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:48.475346 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:48.477611 (+ 2265us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:28:48.477612 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:28:48.477613 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:28:48.477619 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:28:48.479181 (+ 1562us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:28:48.479708 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:28:48.479709 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:28:48.479709 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:28:48.479778 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:28:48.480062 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:28:48.480063 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:28:48.480063 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:28:48.480169 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:28:48.480224 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0810 15:28:48.480557 (+ 333us) server_negotiation.cc:299] Negotiation successful
0810 15:28:48.480677 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260810 15:28:48.481001 14724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:48.471495 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42677 (local address 127.18.68.130:34107)
0810 15:28:48.471711 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:48.471747 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0810 15:28:48.472227 (+ 480us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:28:48.472562 (+ 335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:28:48.472566 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:28:48.473175 (+ 609us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:28:48.473393 (+ 218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:28:48.473398 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:28:48.474136 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:28:48.474137 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:28:48.474960 (+ 823us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:28:48.474962 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:28:48.475354 (+ 392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:28:48.475355 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:28:48.475507 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:48.475991 (+ 484us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:28:48.475999 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:28:48.477480 (+ 1481us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:28:48.479281 (+ 1801us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:28:48.479288 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:28:48.479290 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:28:48.479623 (+ 333us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:28:48.479842 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:28:48.479843 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:28:48.479843 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:28:48.479993 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:28:48.480239 (+ 246us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:28:48.480245 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:28:48.480420 (+ 175us) client_negotiation.cc:769] Sending connection context
0810 15:28:48.480537 (+ 117us) client_negotiation.cc:240] Negotiation successful
0810 15:28:48.480729 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":106,"threads_started":1}
I20260810 15:28:48.481567 14722 heartbeater.cc:347] Connected to a master server at 127.18.68.190:42677
I20260810 15:28:48.481691 14722 heartbeater.cc:464] Registering TS with master...
I20260810 15:28:48.481899 14722 heartbeater.cc:511] Master 127.18.68.190:42677 requested a full tablet report, sending...
I20260810 15:28:48.482295 14180 ts_manager.cc:194] Registered new tserver with Master: e428d6c365a44bfbb97901a4471ff5d4 (127.18.68.130:39415)
I20260810 15:28:48.482637 14180 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.68.130@KRBTEST.COM'} at 127.18.68.130:34107
W20260810 15:28:48.565595 14727 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:28:48.565830 14727 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:28:48.565871 14727 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:28:48.567127 14727 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:28:48.567194 14727 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:28:48.567238 14727 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.68.131
I20260810 15:28:48.568977 14727 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:36547
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.131.keytab
--principal=kudu/127.18.68.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.68.131:37887
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.68.131
--webserver_port=34127
--tserver_master_addrs=127.18.68.190:42677
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14727
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.68.131
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:28:48.569270 14727 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:28:48.569515 14727 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:28:48.574862 14733 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:28:48.574935 14727 server_base.cc:1034] running on GCE node
W20260810 15:28:48.574867 14738 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:28:48.574872 14735 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:28:48.575304 14727 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:28:48.575591 14727 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:28:48.576756 14727 hybrid_clock.cc:648] HybridClock initialized: now 1786375728576745 us; error 28 us; skew 500 ppm
Aug 10 15:28:48 dist-test-slave-2p8l krb5kdc[13190](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375728, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:28:48.579310 14727 init.cc:377] Logged in from keytab as kudu/127.18.68.131@KRBTEST.COM (short username kudu)
I20260810 15:28:48.579753 14727 webserver.cc:460] Webserver started at http://127.18.68.131:34127/ using document root <none> and password file <none>
I20260810 15:28:48.580004 14727 fs_manager.cc:359] Metadata directory not provided
I20260810 15:28:48.580097 14727 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:28:48.581476 14727 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:28:48.582108 14754 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:28:48.582297 14727 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:28:48.582401 14727 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-2/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-2/wal
uuid: "dee73ad54e7740bbbbfaafc864b08b64"
format_stamp: "Formatted at 2026-08-10 15:28:27 on dist-test-slave-2p8l"
server_key: "718e8cf954b3db2511b8fe7f447cc26e"
server_key_iv: "c32aeeb9dda9391caddb0986649d7164"
server_key_version: "encryptionkey@0"
I20260810 15:28:48.582753 14727 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:28:48.599824 14727 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:28:48.601902 14727 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:28:48.602165 14727 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:28:48.602437 14727 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 15:28:48.602782 14727 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 15:28:48.602839 14727 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 15:28:48.602874 14727 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 15:28:48.602916 14727 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 15:28:48.609395 14727 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.131:37887
I20260810 15:28:48.609450 14951 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.131:37887 every 8 connection(s)
I20260810 15:28:48.609813 14727 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-2/data/info.pb
I20260810 15:28:48.615970 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 14727
Aug 10 15:28:48 dist-test-slave-2p8l krb5kdc[13190](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375728, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.131@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
I20260810 15:28:48.619567 14491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:48.610598 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.131:59297 (local address 127.18.68.190:42677)
0810 15:28:48.610697 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0810 15:28:48.610700 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 15:28:48.610894 (+ 194us) server_negotiation.cc:407] Connection header received
0810 15:28:48.611367 (+ 473us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:28:48.611369 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:28:48.611379 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:28:48.611436 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:28:48.612370 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:48.612850 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:48.613847 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:48.614029 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:48.614169 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:48.616615 (+ 2446us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:28:48.616616 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:28:48.616616 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:28:48.616624 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:28:48.618159 (+ 1535us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:28:48.618579 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:28:48.618580 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:28:48.618580 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:28:48.618646 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:28:48.618901 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:28:48.618902 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:28:48.618902 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:28:48.619019 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:28:48.619099 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0810 15:28:48.619384 (+ 285us) server_negotiation.cc:299] Negotiation successful
0810 15:28:48.619473 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260810 15:28:48.619799 14961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:48.610560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42677 (local address 127.18.68.131:59297)
0810 15:28:48.610762 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:48.610803 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0810 15:28:48.611283 (+ 480us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:28:48.611489 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:28:48.611492 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:28:48.612084 (+ 592us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:28:48.612286 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:28:48.612291 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:28:48.612939 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:28:48.612940 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:28:48.613767 (+ 827us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:28:48.613769 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:28:48.614186 (+ 417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:28:48.614188 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:28:48.614359 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:48.614857 (+ 498us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:28:48.614866 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:28:48.616529 (+ 1663us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:28:48.618251 (+ 1722us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:28:48.618261 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:28:48.618263 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:28:48.618495 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:28:48.618706 (+ 211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:28:48.618706 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:28:48.618707 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:28:48.618820 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:28:48.619090 (+ 270us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:28:48.619098 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:28:48.619238 (+ 140us) client_negotiation.cc:769] Sending connection context
0810 15:28:48.619360 (+ 122us) client_negotiation.cc:240] Negotiation successful
0810 15:28:48.619531 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":114,"threads_started":1}
I20260810 15:28:48.620343 14954 heartbeater.cc:347] Connected to a master server at 127.18.68.190:42677
I20260810 15:28:48.620450 14954 heartbeater.cc:464] Registering TS with master...
I20260810 15:28:48.620666 14954 heartbeater.cc:511] Master 127.18.68.190:42677 requested a full tablet report, sending...
I20260810 15:28:48.621183 14180 ts_manager.cc:194] Registered new tserver with Master: dee73ad54e7740bbbbfaafc864b08b64 (127.18.68.131:37887)
I20260810 15:28:48.621726 14180 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.68.131@KRBTEST.COM'} at 127.18.68.131:59297
I20260810 15:28:48.624372 14963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:48.616435 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46280 (local address 127.18.68.190:42677)
0810 15:28:48.616587 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0810 15:28:48.616589 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:28:48.616705 (+ 116us) server_negotiation.cc:407] Connection header received
0810 15:28:48.616785 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:28:48.616786 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:28:48.616798 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:28:48.616875 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:28:48.617682 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:48.618243 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:48.619184 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:48.619845 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:48.619926 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:48.621637 (+ 1711us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:28:48.621638 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:28:48.621638 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:28:48.621645 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:28:48.623232 (+ 1587us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:28:48.623629 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:28:48.623630 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:28:48.623630 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:28:48.623684 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:28:48.623894 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:28:48.623895 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:28:48.623896 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:28:48.624006 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:28:48.624139 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0810 15:28:48.624238 (+ 99us) server_negotiation.cc:299] Negotiation successful
0810 15:28:48.624304 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":77,"threads_started":1}
I20260810 15:28:48.625337 18706 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 15:28:48.628134 14963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:48.625720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46294 (local address 127.18.68.190:42677)
0810 15:28:48.625776 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0810 15:28:48.625778 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:28:48.625936 (+ 158us) server_negotiation.cc:407] Connection header received
0810 15:28:48.625973 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:28:48.625973 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:28:48.626003 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:28:48.626161 (+ 158us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 15:28:48.626277 (+ 116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:48.626740 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:48.627523 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:48.627719 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:48.627772 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:48.627922 (+ 150us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 15:28:48.627963 (+ 41us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0810 15:28:48.628091 (+ 128us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:46294: token expired
Metrics: {"server-negotiator.queue_time_us":35}
W20260810 15:28:48.628204 14963 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:46294: token expired
W20260810 15:28:48.628388 14057 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.18.68.190:42677)
I20260810 15:28:48.634429 14963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:48.628723 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46296 (local address 127.18.68.190:42677)
0810 15:28:48.628806 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0810 15:28:48.628808 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:28:48.628816 (+ 8us) server_negotiation.cc:407] Connection header received
0810 15:28:48.628835 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:28:48.628835 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:28:48.628844 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:28:48.628909 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:28:48.629398 (+ 489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:48.629912 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:48.630761 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:48.630936 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:48.630996 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:48.632152 (+ 1156us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:28:48.632153 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:28:48.632153 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:28:48.632157 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:28:48.633359 (+ 1202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:28:48.633692 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:28:48.633693 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:28:48.633693 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:28:48.633743 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:28:48.633910 (+ 167us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:28:48.633911 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:28:48.633911 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:28:48.634002 (+ 91us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:28:48.634148 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0810 15:28:48.634310 (+ 162us) server_negotiation.cc:299] Negotiation successful
0810 15:28:48.634373 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260810 15:28:48.635741 14180 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46296:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 15:28:48.637372 14180 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 15:28:48.639828 14374 tablet_service.cc:1467] Processing CreateTablet for tablet 2a409dd036e348fbac8545b0465aae11 (DEFAULT_TABLE table=test-table [id=5f5d3cc7bf8a4d3bbc251133c99f1869]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 15:28:48.640087 14374 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2a409dd036e348fbac8545b0465aae11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:28:48.641928 14313 tablet_bootstrap.cc:492] T 2a409dd036e348fbac8545b0465aae11 P 2504da2f74754aeebf64a3b94ec9dacd: Bootstrap starting.
I20260810 15:28:48.642347 14313 tablet_bootstrap.cc:654] T 2a409dd036e348fbac8545b0465aae11 P 2504da2f74754aeebf64a3b94ec9dacd: Neither blocks nor log segments found. Creating new log.
I20260810 15:28:48.642917 14313 tablet_bootstrap.cc:492] T 2a409dd036e348fbac8545b0465aae11 P 2504da2f74754aeebf64a3b94ec9dacd: No bootstrap required, opened a new log
I20260810 15:28:48.642987 14313 ts_tablet_manager.cc:1397] T 2a409dd036e348fbac8545b0465aae11 P 2504da2f74754aeebf64a3b94ec9dacd: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260810 15:28:48.643354 14313 raft_consensus.cc:348] T 2a409dd036e348fbac8545b0465aae11 P 2504da2f74754aeebf64a3b94ec9dacd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dee73ad54e7740bbbbfaafc864b08b64" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37887 } } peers { permanent_uuid: "e428d6c365a44bfbb97901a4471ff5d4" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 39415 } } peers { permanent_uuid: "2504da2f74754aeebf64a3b94ec9dacd" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 38391 } }
I20260810 15:28:48.643441 14313 raft_consensus.cc:374] T 2a409dd036e348fbac8545b0465aae11 P 2504da2f74754aeebf64a3b94ec9dacd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:28:48.643502 14313 raft_consensus.cc:729] T 2a409dd036e348fbac8545b0465aae11 P 2504da2f74754aeebf64a3b94ec9dacd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2504da2f74754aeebf64a3b94ec9dacd, State: Initialized, Role: FOLLOWER
I20260810 15:28:48.643550 14313 consensus_queue.cc:260] T 2a409dd036e348fbac8545b0465aae11 P 2504da2f74754aeebf64a3b94ec9dacd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dee73ad54e7740bbbbfaafc864b08b64" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37887 } } peers { permanent_uuid: "e428d6c365a44bfbb97901a4471ff5d4" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 39415 } } peers { permanent_uuid: "2504da2f74754aeebf64a3b94ec9dacd" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 38391 } }
I20260810 15:28:48.643654 14313 ts_tablet_manager.cc:1428] T 2a409dd036e348fbac8545b0465aae11 P 2504da2f74754aeebf64a3b94ec9dacd: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260810 15:28:48.643807 14969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:48.639518 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.130:39415 (local address 127.0.0.1:37176)
0810 15:28:48.639667 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:48.639677 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 15:28:48.639731 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:28:48.640301 (+ 570us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:28:48.640303 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:28:48.640306 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:28:48.640356 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:28:48.640358 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:28:48.641318 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:28:48.641319 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:28:48.642365 (+ 1046us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:28:48.642368 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:28:48.643519 (+ 1151us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:28:48.643520 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:28:48.643601 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:48.643627 (+ 26us) client_negotiation.cc:769] Sending connection context
0810 15:28:48.643669 (+ 42us) client_negotiation.cc:240] Negotiation successful
0810 15:28:48.643721 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":93,"threads_started":1}
I20260810 15:28:48.644222 14975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:48.639766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37176 (local address 127.18.68.130:39415)
0810 15:28:48.640001 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0810 15:28:48.640007 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 15:28:48.640018 (+ 11us) server_negotiation.cc:407] Connection header received
0810 15:28:48.640061 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:28:48.640063 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:28:48.640079 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:28:48.640190 (+ 111us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:28:48.640427 (+ 237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:48.641217 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:48.642580 (+ 1363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:48.643414 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:48.643968 (+ 554us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:48.644051 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0810 15:28:48.644084 (+ 33us) server_negotiation.cc:299] Negotiation successful
0810 15:28:48.644130 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":189,"thread_start_us":124,"threads_started":1}
I20260810 15:28:48.644702 14498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:48.639436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.131:37887 (local address 127.0.0.1:36706)
0810 15:28:48.639485 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:48.639496 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 15:28:48.639532 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:28:48.640284 (+ 752us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:28:48.640285 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:28:48.640287 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:28:48.640345 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:28:48.640347 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:28:48.641961 (+ 1614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:28:48.641962 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:28:48.643199 (+ 1237us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:28:48.643202 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:28:48.644378 (+ 1176us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:28:48.644379 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:28:48.644471 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:48.644482 (+ 11us) client_negotiation.cc:769] Sending connection context
0810 15:28:48.644587 (+ 105us) client_negotiation.cc:240] Negotiation successful
0810 15:28:48.644637 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260810 15:28:48.645031 14619 tablet_service.cc:1467] Processing CreateTablet for tablet 2a409dd036e348fbac8545b0465aae11 (DEFAULT_TABLE table=test-table [id=5f5d3cc7bf8a4d3bbc251133c99f1869]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 15:28:48.645361 14619 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2a409dd036e348fbac8545b0465aae11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:28:48.648594 14982 tablet_bootstrap.cc:492] T 2a409dd036e348fbac8545b0465aae11 P e428d6c365a44bfbb97901a4471ff5d4: Bootstrap starting.
I20260810 15:28:48.648747 14972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:48.639646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36706 (local address 127.18.68.131:37887)
0810 15:28:48.640041 (+ 395us) server_negotiation.cc:206] Beginning negotiation
0810 15:28:48.640046 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 15:28:48.640072 (+ 26us) server_negotiation.cc:407] Connection header received
0810 15:28:48.640121 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:28:48.640123 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:28:48.640142 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:28:48.640505 (+ 363us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:28:48.640662 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:48.641837 (+ 1175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:48.643386 (+ 1549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:48.644299 (+ 913us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:48.644378 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:48.644435 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0810 15:28:48.648574 (+ 4139us) server_negotiation.cc:299] Negotiation successful
0810 15:28:48.648657 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":346,"thread_start_us":108,"threads_started":1}
I20260810 15:28:48.649376 14982 tablet_bootstrap.cc:654] T 2a409dd036e348fbac8545b0465aae11 P e428d6c365a44bfbb97901a4471ff5d4: Neither blocks nor log segments found. Creating new log.
I20260810 15:28:48.649490 14839 tablet_service.cc:1467] Processing CreateTablet for tablet 2a409dd036e348fbac8545b0465aae11 (DEFAULT_TABLE table=test-table [id=5f5d3cc7bf8a4d3bbc251133c99f1869]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 15:28:48.649830 14839 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2a409dd036e348fbac8545b0465aae11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:28:48.650005 14982 log.cc:824] T 2a409dd036e348fbac8545b0465aae11 P e428d6c365a44bfbb97901a4471ff5d4: Log is configured to *not* fsync() on all Append() calls
I20260810 15:28:48.650774 14982 tablet_bootstrap.cc:492] T 2a409dd036e348fbac8545b0465aae11 P e428d6c365a44bfbb97901a4471ff5d4: No bootstrap required, opened a new log
I20260810 15:28:48.650861 14982 ts_tablet_manager.cc:1397] T 2a409dd036e348fbac8545b0465aae11 P e428d6c365a44bfbb97901a4471ff5d4: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260810 15:28:48.652213 14982 raft_consensus.cc:348] T 2a409dd036e348fbac8545b0465aae11 P e428d6c365a44bfbb97901a4471ff5d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dee73ad54e7740bbbbfaafc864b08b64" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37887 } } peers { permanent_uuid: "e428d6c365a44bfbb97901a4471ff5d4" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 39415 } } peers { permanent_uuid: "2504da2f74754aeebf64a3b94ec9dacd" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 38391 } }
I20260810 15:28:48.652379 14982 raft_consensus.cc:374] T 2a409dd036e348fbac8545b0465aae11 P e428d6c365a44bfbb97901a4471ff5d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:28:48.652428 14982 raft_consensus.cc:729] T 2a409dd036e348fbac8545b0465aae11 P e428d6c365a44bfbb97901a4471ff5d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e428d6c365a44bfbb97901a4471ff5d4, State: Initialized, Role: FOLLOWER
I20260810 15:28:48.652570 14982 consensus_queue.cc:260] T 2a409dd036e348fbac8545b0465aae11 P e428d6c365a44bfbb97901a4471ff5d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dee73ad54e7740bbbbfaafc864b08b64" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37887 } } peers { permanent_uuid: "e428d6c365a44bfbb97901a4471ff5d4" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 39415 } } peers { permanent_uuid: "2504da2f74754aeebf64a3b94ec9dacd" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 38391 } }
I20260810 15:28:48.652885 14722 heartbeater.cc:503] Master 127.18.68.190:42677 was elected leader, sending a full tablet report...
I20260810 15:28:48.652884 14982 ts_tablet_manager.cc:1428] T 2a409dd036e348fbac8545b0465aae11 P e428d6c365a44bfbb97901a4471ff5d4: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260810 15:28:48.652959 14985 tablet_bootstrap.cc:492] T 2a409dd036e348fbac8545b0465aae11 P dee73ad54e7740bbbbfaafc864b08b64: Bootstrap starting.
I20260810 15:28:48.653797 14985 tablet_bootstrap.cc:654] T 2a409dd036e348fbac8545b0465aae11 P dee73ad54e7740bbbbfaafc864b08b64: Neither blocks nor log segments found. Creating new log.
I20260810 15:28:48.654485 14985 log.cc:824] T 2a409dd036e348fbac8545b0465aae11 P dee73ad54e7740bbbbfaafc864b08b64: Log is configured to *not* fsync() on all Append() calls
I20260810 15:28:48.655191 14985 tablet_bootstrap.cc:492] T 2a409dd036e348fbac8545b0465aae11 P dee73ad54e7740bbbbfaafc864b08b64: No bootstrap required, opened a new log
I20260810 15:28:48.655252 14985 ts_tablet_manager.cc:1397] T 2a409dd036e348fbac8545b0465aae11 P dee73ad54e7740bbbbfaafc864b08b64: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 15:28:48.656757 14985 raft_consensus.cc:348] T 2a409dd036e348fbac8545b0465aae11 P dee73ad54e7740bbbbfaafc864b08b64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dee73ad54e7740bbbbfaafc864b08b64" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37887 } } peers { permanent_uuid: "e428d6c365a44bfbb97901a4471ff5d4" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 39415 } } peers { permanent_uuid: "2504da2f74754aeebf64a3b94ec9dacd" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 38391 } }
I20260810 15:28:48.656908 14985 raft_consensus.cc:374] T 2a409dd036e348fbac8545b0465aae11 P dee73ad54e7740bbbbfaafc864b08b64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:28:48.656932 14985 raft_consensus.cc:729] T 2a409dd036e348fbac8545b0465aae11 P dee73ad54e7740bbbbfaafc864b08b64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dee73ad54e7740bbbbfaafc864b08b64, State: Initialized, Role: FOLLOWER
I20260810 15:28:48.657061 14985 consensus_queue.cc:260] T 2a409dd036e348fbac8545b0465aae11 P dee73ad54e7740bbbbfaafc864b08b64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dee73ad54e7740bbbbfaafc864b08b64" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37887 } } peers { permanent_uuid: "e428d6c365a44bfbb97901a4471ff5d4" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 39415 } } peers { permanent_uuid: "2504da2f74754aeebf64a3b94ec9dacd" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 38391 } }
I20260810 15:28:48.657390 14985 ts_tablet_manager.cc:1428] T 2a409dd036e348fbac8545b0465aae11 P dee73ad54e7740bbbbfaafc864b08b64: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 15:28:48.657418 14954 heartbeater.cc:503] Master 127.18.68.190:42677 was elected leader, sending a full tablet report...
W20260810 15:28:48.721244 14723 tablet.cc:2369] T 2a409dd036e348fbac8545b0465aae11 P e428d6c365a44bfbb97901a4471ff5d4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 15:28:48.724689 14989 raft_consensus.cc:482] T 2a409dd036e348fbac8545b0465aae11 P dee73ad54e7740bbbbfaafc864b08b64 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 15:28:48.724850 14989 raft_consensus.cc:504] T 2a409dd036e348fbac8545b0465aae11 P dee73ad54e7740bbbbfaafc864b08b64 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dee73ad54e7740bbbbfaafc864b08b64" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37887 } } peers { permanent_uuid: "e428d6c365a44bfbb97901a4471ff5d4" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 39415 } } peers { permanent_uuid: "2504da2f74754aeebf64a3b94ec9dacd" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 38391 } }
I20260810 15:28:48.725229 14989 leader_election.cc:288] T 2a409dd036e348fbac8545b0465aae11 P dee73ad54e7740bbbbfaafc864b08b64 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e428d6c365a44bfbb97901a4471ff5d4 (127.18.68.130:39415), 2504da2f74754aeebf64a3b94ec9dacd (127.18.68.129:38391)
I20260810 15:28:48.728561 14961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:48.725456 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.130:39415 (local address 127.18.68.131:44363)
0810 15:28:48.725526 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:48.725540 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 15:28:48.725615 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:28:48.725801 (+ 186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:28:48.725801 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:28:48.725803 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:28:48.725895 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:28:48.725897 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:28:48.726678 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:28:48.726679 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:28:48.727629 (+ 950us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:28:48.727632 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:28:48.728265 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:28:48.728266 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:28:48.728358 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:48.728362 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 15:28:48.728431 (+ 69us) client_negotiation.cc:240] Negotiation successful
0810 15:28:48.728479 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49}
I20260810 15:28:48.728566 14975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:48.725570 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.131:44363 (local address 127.18.68.130:39415)
0810 15:28:48.725645 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0810 15:28:48.725648 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 15:28:48.725660 (+ 12us) server_negotiation.cc:407] Connection header received
0810 15:28:48.725690 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:28:48.725691 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:28:48.725702 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:28:48.725779 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:28:48.725985 (+ 206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:48.726584 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:48.727727 (+ 1143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:48.728172 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:48.728258 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:48.728266 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0810 15:28:48.728442 (+ 176us) server_negotiation.cc:299] Negotiation successful
0810 15:28:48.728476 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260810 15:28:48.728828 14501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:48.725644 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.131:43943 (local address 127.18.68.129:38391)
0810 15:28:48.725710 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0810 15:28:48.725712 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:28:48.725891 (+ 179us) server_negotiation.cc:407] Connection header received
0810 15:28:48.725926 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:28:48.725927 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:28:48.725958 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:28:48.726033 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:28:48.726232 (+ 199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:48.726944 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:48.727911 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:48.728458 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:48.728527 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:48.728651 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0810 15:28:48.728688 (+ 37us) server_negotiation.cc:299] Negotiation successful
0810 15:28:48.728741 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260810 15:28:48.728844 14991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:48.725456 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.129:38391 (local address 127.18.68.131:43943)
0810 15:28:48.725799 (+ 343us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:48.725811 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 15:28:48.725871 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:28:48.726052 (+ 181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:28:48.726052 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:28:48.726082 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:28:48.726152 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:28:48.726154 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:28:48.727038 (+ 884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:28:48.727038 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:28:48.727817 (+ 779us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:28:48.727820 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:28:48.728546 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:28:48.728547 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:28:48.728626 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:48.728630 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 15:28:48.728684 (+ 54us) client_negotiation.cc:240] Negotiation successful
0810 15:28:48.728728 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":322,"mutex_wait_us":17,"thread_start_us":195,"threads_started":1}
I20260810 15:28:48.728942 14644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2a409dd036e348fbac8545b0465aae11" candidate_uuid: "dee73ad54e7740bbbbfaafc864b08b64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e428d6c365a44bfbb97901a4471ff5d4" is_pre_election: true
I20260810 15:28:48.729118 14644 raft_consensus.cc:2454] T 2a409dd036e348fbac8545b0465aae11 P e428d6c365a44bfbb97901a4471ff5d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dee73ad54e7740bbbbfaafc864b08b64 in term 0.
I20260810 15:28:48.729123 14414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2a409dd036e348fbac8545b0465aae11" candidate_uuid: "dee73ad54e7740bbbbfaafc864b08b64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2504da2f74754aeebf64a3b94ec9dacd" is_pre_election: true
I20260810 15:28:48.729264 14414 raft_consensus.cc:2454] T 2a409dd036e348fbac8545b0465aae11 P 2504da2f74754aeebf64a3b94ec9dacd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dee73ad54e7740bbbbfaafc864b08b64 in term 0.
I20260810 15:28:48.729408 14758 leader_election.cc:302] T 2a409dd036e348fbac8545b0465aae11 P dee73ad54e7740bbbbfaafc864b08b64 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dee73ad54e7740bbbbfaafc864b08b64, e428d6c365a44bfbb97901a4471ff5d4; no voters:
I20260810 15:28:48.729565 14989 raft_consensus.cc:2781] T 2a409dd036e348fbac8545b0465aae11 P dee73ad54e7740bbbbfaafc864b08b64 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 15:28:48.729624 14989 raft_consensus.cc:482] T 2a409dd036e348fbac8545b0465aae11 P dee73ad54e7740bbbbfaafc864b08b64 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 15:28:48.729661 14989 raft_consensus.cc:3037] T 2a409dd036e348fbac8545b0465aae11 P dee73ad54e7740bbbbfaafc864b08b64 [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:28:48.730485 14989 raft_consensus.cc:504] T 2a409dd036e348fbac8545b0465aae11 P dee73ad54e7740bbbbfaafc864b08b64 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dee73ad54e7740bbbbfaafc864b08b64" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37887 } } peers { permanent_uuid: "e428d6c365a44bfbb97901a4471ff5d4" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 39415 } } peers { permanent_uuid: "2504da2f74754aeebf64a3b94ec9dacd" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 38391 } }
I20260810 15:28:48.730657 14989 leader_election.cc:288] T 2a409dd036e348fbac8545b0465aae11 P dee73ad54e7740bbbbfaafc864b08b64 [CANDIDATE]: Term 1 election: Requested vote from peers e428d6c365a44bfbb97901a4471ff5d4 (127.18.68.130:39415), 2504da2f74754aeebf64a3b94ec9dacd (127.18.68.129:38391)
I20260810 15:28:48.730842 14414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2a409dd036e348fbac8545b0465aae11" candidate_uuid: "dee73ad54e7740bbbbfaafc864b08b64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2504da2f74754aeebf64a3b94ec9dacd"
I20260810 15:28:48.730880 14644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2a409dd036e348fbac8545b0465aae11" candidate_uuid: "dee73ad54e7740bbbbfaafc864b08b64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e428d6c365a44bfbb97901a4471ff5d4"
I20260810 15:28:48.730945 14414 raft_consensus.cc:3037] T 2a409dd036e348fbac8545b0465aae11 P 2504da2f74754aeebf64a3b94ec9dacd [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:28:48.730942 14644 raft_consensus.cc:3037] T 2a409dd036e348fbac8545b0465aae11 P e428d6c365a44bfbb97901a4471ff5d4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:28:48.731734 14644 raft_consensus.cc:2454] T 2a409dd036e348fbac8545b0465aae11 P e428d6c365a44bfbb97901a4471ff5d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dee73ad54e7740bbbbfaafc864b08b64 in term 1.
I20260810 15:28:48.731745 14414 raft_consensus.cc:2454] T 2a409dd036e348fbac8545b0465aae11 P 2504da2f74754aeebf64a3b94ec9dacd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dee73ad54e7740bbbbfaafc864b08b64 in term 1.
I20260810 15:28:48.731921 14758 leader_election.cc:302] T 2a409dd036e348fbac8545b0465aae11 P dee73ad54e7740bbbbfaafc864b08b64 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dee73ad54e7740bbbbfaafc864b08b64, e428d6c365a44bfbb97901a4471ff5d4; no voters:
I20260810 15:28:48.732033 14989 raft_consensus.cc:2781] T 2a409dd036e348fbac8545b0465aae11 P dee73ad54e7740bbbbfaafc864b08b64 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 15:28:48.732196 14989 raft_consensus.cc:686] T 2a409dd036e348fbac8545b0465aae11 P dee73ad54e7740bbbbfaafc864b08b64 [term 1 LEADER]: Becoming Leader. State: Replica: dee73ad54e7740bbbbfaafc864b08b64, State: Running, Role: LEADER
I20260810 15:28:48.732297 14989 consensus_queue.cc:237] T 2a409dd036e348fbac8545b0465aae11 P dee73ad54e7740bbbbfaafc864b08b64 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dee73ad54e7740bbbbfaafc864b08b64" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37887 } } peers { permanent_uuid: "e428d6c365a44bfbb97901a4471ff5d4" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 39415 } } peers { permanent_uuid: "2504da2f74754aeebf64a3b94ec9dacd" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 38391 } }
I20260810 15:28:48.733259 14180 catalog_manager.cc:5495] T 2a409dd036e348fbac8545b0465aae11 P dee73ad54e7740bbbbfaafc864b08b64 reported cstate change: term changed from 0 to 1, leader changed from <none> to dee73ad54e7740bbbbfaafc864b08b64 (127.18.68.131). New cstate: current_term: 1 leader_uuid: "dee73ad54e7740bbbbfaafc864b08b64" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dee73ad54e7740bbbbfaafc864b08b64" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e428d6c365a44bfbb97901a4471ff5d4" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 39415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2504da2f74754aeebf64a3b94ec9dacd" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 38391 } health_report { overall_health: UNKNOWN } } }
I20260810 15:28:48.740631 14972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:48.738083 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36720 (local address 127.18.68.131:37887)
0810 15:28:48.738147 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0810 15:28:48.738149 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:28:48.738163 (+ 14us) server_negotiation.cc:407] Connection header received
0810 15:28:48.738231 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:28:48.738231 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:28:48.738250 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:28:48.738314 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 15:28:48.738433 (+ 119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:48.738989 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:48.739793 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:28:48.739992 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:28:48.740054 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:28:48.740264 (+ 210us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 15:28:48.740371 (+ 107us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 15:28:48.740440 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0810 15:28:48.740477 (+ 37us) server_negotiation.cc:299] Negotiation successful
0810 15:28:48.740495 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260810 15:28:48.742645 14414 raft_consensus.cc:1261] T 2a409dd036e348fbac8545b0465aae11 P 2504da2f74754aeebf64a3b94ec9dacd [term 1 FOLLOWER]: Refusing update from remote peer dee73ad54e7740bbbbfaafc864b08b64: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 15:28:48.742660 14644 raft_consensus.cc:1261] T 2a409dd036e348fbac8545b0465aae11 P e428d6c365a44bfbb97901a4471ff5d4 [term 1 FOLLOWER]: Refusing update from remote peer dee73ad54e7740bbbbfaafc864b08b64: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 15:28:48.743001 14989 consensus_queue.cc:1035] T 2a409dd036e348fbac8545b0465aae11 P dee73ad54e7740bbbbfaafc864b08b64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2504da2f74754aeebf64a3b94ec9dacd" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 38391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 15:28:48.743185 14992 consensus_queue.cc:1035] T 2a409dd036e348fbac8545b0465aae11 P dee73ad54e7740bbbbfaafc864b08b64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e428d6c365a44bfbb97901a4471ff5d4" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 39415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 15:28:48.745610 14999 mvcc.cc:205] Tried to move back new op lower bound from 7316994984926797824 to 7316994984888348672. Current Snapshot: MvccSnapshot[applied={T|T < 7316994984926797824}]
I20260810 15:28:48.746310 15001 mvcc.cc:205] Tried to move back new op lower bound from 7316994984926797824 to 7316994984888348672. Current Snapshot: MvccSnapshot[applied={T|T < 7316994984926797824}]
I20260810 15:28:48.749137 14180 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46296:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 15:28:48.749238 14180 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46296:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 15:28:48.750015 14180 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 963e2863e7434f1c9258598c51d06dfd: Sending DeleteTablet for 3 replicas of tablet 2a409dd036e348fbac8545b0465aae11
I20260810 15:28:48.750438 14374 tablet_service.cc:1514] Processing DeleteTablet for tablet 2a409dd036e348fbac8545b0465aae11 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 15:28:48 UTC) from {username='kudu', principal='kudu/127.18.68.190@KRBTEST.COM'} at 127.0.0.1:48756
I20260810 15:28:48.750443 14619 tablet_service.cc:1514] Processing DeleteTablet for tablet 2a409dd036e348fbac8545b0465aae11 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 15:28:48 UTC) from {username='kudu', principal='kudu/127.18.68.190@KRBTEST.COM'} at 127.0.0.1:37176
I20260810 15:28:48.750654 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 14237
I20260810 15:28:48.750659 14503 tablet_replica.cc:330] T 2a409dd036e348fbac8545b0465aae11 P 2504da2f74754aeebf64a3b94ec9dacd: stopping tablet replica
I20260810 15:28:48.750640 14839 tablet_service.cc:1514] Processing DeleteTablet for tablet 2a409dd036e348fbac8545b0465aae11 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 15:28:48 UTC) from {username='kudu', principal='kudu/127.18.68.190@KRBTEST.COM'} at 127.0.0.1:36706
I20260810 15:28:48.750725 14503 raft_consensus.cc:2229] T 2a409dd036e348fbac8545b0465aae11 P 2504da2f74754aeebf64a3b94ec9dacd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 15:28:48.750785 14503 raft_consensus.cc:2258] T 2a409dd036e348fbac8545b0465aae11 P 2504da2f74754aeebf64a3b94ec9dacd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 15:28:48.750870 15013 tablet_replica.cc:330] T 2a409dd036e348fbac8545b0465aae11 P dee73ad54e7740bbbbfaafc864b08b64: stopping tablet replica
I20260810 15:28:48.750967 15013 raft_consensus.cc:2229] T 2a409dd036e348fbac8545b0465aae11 P dee73ad54e7740bbbbfaafc864b08b64 [term 1 LEADER]: Raft consensus shutting down.
I20260810 15:28:48.751107 15013 raft_consensus.cc:2258] T 2a409dd036e348fbac8545b0465aae11 P dee73ad54e7740bbbbfaafc864b08b64 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 15:28:48.761152 15012 tablet_replica.cc:330] T 2a409dd036e348fbac8545b0465aae11 P e428d6c365a44bfbb97901a4471ff5d4: stopping tablet replica
I20260810 15:28:48.761356 15012 raft_consensus.cc:2229] T 2a409dd036e348fbac8545b0465aae11 P e428d6c365a44bfbb97901a4471ff5d4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 15:28:48.761547 15012 raft_consensus.cc:2258] T 2a409dd036e348fbac8545b0465aae11 P e428d6c365a44bfbb97901a4471ff5d4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 15:28:48.763698 15013 ts_tablet_manager.cc:1905] T 2a409dd036e348fbac8545b0465aae11 P dee73ad54e7740bbbbfaafc864b08b64: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 15:28:48.763804 15012 ts_tablet_manager.cc:1905] T 2a409dd036e348fbac8545b0465aae11 P e428d6c365a44bfbb97901a4471ff5d4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 15:28:48.765363 15013 ts_tablet_manager.cc:1918] T 2a409dd036e348fbac8545b0465aae11 P dee73ad54e7740bbbbfaafc864b08b64: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 15:28:48.765448 15013 log.cc:1196] T 2a409dd036e348fbac8545b0465aae11 P dee73ad54e7740bbbbfaafc864b08b64: Deleting WAL directory at /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-2/wal/wals/2a409dd036e348fbac8545b0465aae11
I20260810 15:28:48.765756 15013 ts_tablet_manager.cc:1939] T 2a409dd036e348fbac8545b0465aae11 P dee73ad54e7740bbbbfaafc864b08b64: Deleting consensus metadata
I20260810 15:28:48.766335 14146 catalog_manager.cc:4841] TS dee73ad54e7740bbbbfaafc864b08b64 (127.18.68.131:37887): tablet 2a409dd036e348fbac8545b0465aae11 (table test-table [id=5f5d3cc7bf8a4d3bbc251133c99f1869]) successfully deleted
I20260810 15:28:48.766115 15012 ts_tablet_manager.cc:1918] T 2a409dd036e348fbac8545b0465aae11 P e428d6c365a44bfbb97901a4471ff5d4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 15:28:48.766503 15012 log.cc:1196] T 2a409dd036e348fbac8545b0465aae11 P e428d6c365a44bfbb97901a4471ff5d4: Deleting WAL directory at /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-1/wal/wals/2a409dd036e348fbac8545b0465aae11
I20260810 15:28:48.766914 15012 ts_tablet_manager.cc:1939] T 2a409dd036e348fbac8545b0465aae11 P e428d6c365a44bfbb97901a4471ff5d4: Deleting consensus metadata
I20260810 15:28:48.767518 14148 catalog_manager.cc:4841] TS e428d6c365a44bfbb97901a4471ff5d4 (127.18.68.130:39415): tablet 2a409dd036e348fbac8545b0465aae11 (table test-table [id=5f5d3cc7bf8a4d3bbc251133c99f1869]) successfully deleted
W20260810 15:28:48.777132 14150 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.18.68.129:38391 (error 108)
I20260810 15:28:48.777555 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 14495
I20260810 15:28:48.782285 14498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:28:48.777661 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.129:38391 (local address 127.0.0.1:48770)
0810 15:28:48.782157 (+ 4496us) negotiation.cc:107] Waiting for socket to connect
0810 15:28:48.782240 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.129:38391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":4464}
W20260810 15:28:48.790226 14150 catalog_manager.cc:4584] TS 2504da2f74754aeebf64a3b94ec9dacd (127.18.68.129:38391): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 2a409dd036e348fbac8545b0465aae11: Network error: Client connection negotiation failed: client connection to 127.18.68.129:38391: connect: Connection refused (error 111)
I20260810 15:28:48.806394 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 14727
I20260810 15:28:48.818508 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 14118
I20260810 15:29:08.832654 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.190:42677
--webserver_interface=127.18.68.190
--webserver_port=35787
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab
--principal=kudu/127.18.68.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:36547
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.68.190:42677
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:29:08.918814 15015 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:29:08.919025 15015 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:29:08.919047 15015 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:29:08.920145 15015 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260810 15:29:08.920207 15015 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260810 15:29:08.920220 15015 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260810 15:29:08.920233 15015 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 15:29:08.920245 15015 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:29:08.920258 15015 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:29:08.920270 15015 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 15:29:08.920282 15015 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 15:29:08.921765 15015 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:36547
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.18.68.190:42677
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab
--principal=kudu/127.18.68.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.190:42677
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.68.190
--webserver_port=35787
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15015
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:29:08.921980 15015 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:29:08.922240 15015 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:29:08.927881 15022 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:29:08.927881 15027 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:29:08.927917 15023 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:29:08.928088 15015 server_base.cc:1034] running on GCE node
I20260810 15:29:08.928586 15015 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:29:08.928974 15015 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:29:08.930150 15015 hybrid_clock.cc:648] HybridClock initialized: now 1786375748930116 us; error 50 us; skew 500 ppm
Aug 10 15:29:08 dist-test-slave-2p8l krb5kdc[13190](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375748, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:29:08.933024 15015 init.cc:377] Logged in from keytab as kudu/127.18.68.190@KRBTEST.COM (short username kudu)
I20260810 15:29:08.933691 15015 webserver.cc:460] Webserver started at http://127.18.68.190:35787/ using document root <none> and password file <none>
I20260810 15:29:08.933959 15015 fs_manager.cc:359] Metadata directory not provided
I20260810 15:29:08.934010 15015 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:29:08.935546 15015 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260810 15:29:08.936354 15039 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:29:08.936589 15015 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 15:29:08.936722 15015 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/master-0/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/master-0/wal
uuid: "963e2863e7434f1c9258598c51d06dfd"
format_stamp: "Formatted at 2026-08-10 15:28:27 on dist-test-slave-2p8l"
server_key: "9516f1afec1008f72c46ea43258b581e"
server_key_iv: "453dfdec05cdbfce41f584edcf6b5cc4"
server_key_version: "encryptionkey@0"
I20260810 15:29:08.937121 15015 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:29:08.963991 15015 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:29:08.966187 15015 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:29:08.966360 15015 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:29:08.970989 15015 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.190:42677
I20260810 15:29:08.971163 15138 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.190:42677 every 8 connection(s)
I20260810 15:29:08.971565 15015 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
I20260810 15:29:08.973129 15139 sys_catalog.cc:263] Verifying existing consensus state
I20260810 15:29:08.973820 15139 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 963e2863e7434f1c9258598c51d06dfd: Bootstrap starting.
I20260810 15:29:08.979799 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 15015
I20260810 15:29:08.980165 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.68.129:38391
--local_ip_for_outbound_sockets=127.18.68.129
--tserver_master_addrs=127.18.68.190:42677
--webserver_port=39509
--webserver_interface=127.18.68.129
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.129.keytab
--principal=kudu/127.18.68.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:36547
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 15:29:08.983140 15139 log.cc:824] T 00000000000000000000000000000000 P 963e2863e7434f1c9258598c51d06dfd: Log is configured to *not* fsync() on all Append() calls
I20260810 15:29:08.985436 15139 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 963e2863e7434f1c9258598c51d06dfd: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 15:29:08.985759 15139 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 963e2863e7434f1c9258598c51d06dfd: Bootstrap complete.
I20260810 15:29:08.988083 15139 raft_consensus.cc:348] T 00000000000000000000000000000000 P 963e2863e7434f1c9258598c51d06dfd [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "963e2863e7434f1c9258598c51d06dfd" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 42677 } }
I20260810 15:29:08.988329 15139 raft_consensus.cc:729] T 00000000000000000000000000000000 P 963e2863e7434f1c9258598c51d06dfd [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 963e2863e7434f1c9258598c51d06dfd, State: Initialized, Role: FOLLOWER
I20260810 15:29:08.988533 15139 consensus_queue.cc:260] T 00000000000000000000000000000000 P 963e2863e7434f1c9258598c51d06dfd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "963e2863e7434f1c9258598c51d06dfd" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 42677 } }
I20260810 15:29:08.988636 15139 raft_consensus.cc:388] T 00000000000000000000000000000000 P 963e2863e7434f1c9258598c51d06dfd [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 15:29:08.988692 15139 raft_consensus.cc:482] T 00000000000000000000000000000000 P 963e2863e7434f1c9258598c51d06dfd [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 15:29:08.988740 15139 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 963e2863e7434f1c9258598c51d06dfd [term 2 FOLLOWER]: Advancing to term 3
I20260810 15:29:08.989713 15139 raft_consensus.cc:504] T 00000000000000000000000000000000 P 963e2863e7434f1c9258598c51d06dfd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "963e2863e7434f1c9258598c51d06dfd" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 42677 } }
I20260810 15:29:08.989833 15139 leader_election.cc:302] T 00000000000000000000000000000000 P 963e2863e7434f1c9258598c51d06dfd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 963e2863e7434f1c9258598c51d06dfd; no voters:
I20260810 15:29:08.990018 15139 leader_election.cc:288] T 00000000000000000000000000000000 P 963e2863e7434f1c9258598c51d06dfd [CANDIDATE]: Term 3 election: Requested vote from peers
I20260810 15:29:08.990126 15147 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 963e2863e7434f1c9258598c51d06dfd [term 3 FOLLOWER]: Leader election won for term 3
I20260810 15:29:08.990325 15139 sys_catalog.cc:564] T 00000000000000000000000000000000 P 963e2863e7434f1c9258598c51d06dfd [sys.catalog]: configured and running, proceeding with master startup.
I20260810 15:29:08.990355 15147 raft_consensus.cc:686] T 00000000000000000000000000000000 P 963e2863e7434f1c9258598c51d06dfd [term 3 LEADER]: Becoming Leader. State: Replica: 963e2863e7434f1c9258598c51d06dfd, State: Running, Role: LEADER
I20260810 15:29:08.990470 15147 consensus_queue.cc:237] T 00000000000000000000000000000000 P 963e2863e7434f1c9258598c51d06dfd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "963e2863e7434f1c9258598c51d06dfd" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 42677 } }
I20260810 15:29:08.990824 15150 sys_catalog.cc:455] T 00000000000000000000000000000000 P 963e2863e7434f1c9258598c51d06dfd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "963e2863e7434f1c9258598c51d06dfd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "963e2863e7434f1c9258598c51d06dfd" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 42677 } } }
I20260810 15:29:08.990926 15150 sys_catalog.cc:458] T 00000000000000000000000000000000 P 963e2863e7434f1c9258598c51d06dfd [sys.catalog]: This master's current role is: LEADER
I20260810 15:29:08.991109 15150 sys_catalog.cc:455] T 00000000000000000000000000000000 P 963e2863e7434f1c9258598c51d06dfd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 963e2863e7434f1c9258598c51d06dfd. Latest consensus state: current_term: 3 leader_uuid: "963e2863e7434f1c9258598c51d06dfd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "963e2863e7434f1c9258598c51d06dfd" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 42677 } } }
I20260810 15:29:08.991191 15150 sys_catalog.cc:458] T 00000000000000000000000000000000 P 963e2863e7434f1c9258598c51d06dfd [sys.catalog]: This master's current role is: LEADER
I20260810 15:29:08.991612 15160 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 15:29:08.992939 15160 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 15:29:08.993055 15160 catalog_manager.cc:1259] Loaded cluster ID: 737dd647fa494222aa9b63c4ee84d527
I20260810 15:29:08.993093 15160 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 15:29:08.994481 15160 catalog_manager.cc:1504] Loading token signing keys...
I20260810 15:29:08.994680 15160 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 963e2863e7434f1c9258598c51d06dfd: Loaded TSK: 0
I20260810 15:29:08.994750 15160 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 963e2863e7434f1c9258598c51d06dfd: Loaded TSK: 1
F20260810 15:29:08.995023 15160 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f164453a9ad google::LogMessage::Fail() at ??:0
@ 0x7f164453d88a google::LogMessage::SendToLog() at ??:0
@ 0x7f164453a4de google::LogMessage::Flush() at ??:0
@ 0x7f164453ba19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f1646ca7104 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f1646ca4d41 kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7f164c4941cd kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7f164c49448e kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7f164c494594 _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f164c45ac48 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7f164c464ad0 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f16464080d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f16463fd954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f16472616db start_thread at ??:0
@ 0x7f164303861f clone at ??:0
W20260810 15:29:09.103926 15141 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:29:09.104223 15141 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:29:09.104274 15141 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:29:09.105615 15141 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:29:09.105696 15141 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:29:09.105747 15141 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.68.129
I20260810 15:29:09.107519 15141 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:36547
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.129.keytab
--principal=kudu/127.18.68.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.68.129:38391
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.68.129
--webserver_port=39509
--tserver_master_addrs=127.18.68.190:42677
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15141
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.68.129
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:29:09.107842 15141 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:29:09.108119 15141 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:29:09.114605 15217 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:29:09.114823 15219 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:29:09.114609 15216 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:29:09.115496 15141 server_base.cc:1034] running on GCE node
I20260810 15:29:09.115744 15141 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:29:09.116035 15141 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:29:09.117231 15141 hybrid_clock.cc:648] HybridClock initialized: now 1786375749117208 us; error 29 us; skew 500 ppm
Aug 10 15:29:09 dist-test-slave-2p8l krb5kdc[13190](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375749, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:29:09.120638 15141 init.cc:377] Logged in from keytab as kudu/127.18.68.129@KRBTEST.COM (short username kudu)
I20260810 15:29:09.121233 15141 webserver.cc:460] Webserver started at http://127.18.68.129:39509/ using document root <none> and password file <none>
I20260810 15:29:09.121529 15141 fs_manager.cc:359] Metadata directory not provided
I20260810 15:29:09.121634 15141 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:29:09.123524 15141 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:29:09.124441 15241 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:29:09.124708 15141 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:29:09.124809 15141 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-0/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-0/wal
uuid: "2504da2f74754aeebf64a3b94ec9dacd"
format_stamp: "Formatted at 2026-08-10 15:28:27 on dist-test-slave-2p8l"
server_key: "adebe38f8ed45961c99c83118f43d2bd"
server_key_iv: "8ac6acd1909b685c9b0d855989fd33d2"
server_key_version: "encryptionkey@0"
I20260810 15:29:09.125260 15141 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:29:09.147197 15141 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:29:09.149927 15141 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:29:09.150123 15141 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:29:09.150398 15141 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 15:29:09.150942 15256 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260810 15:29:09.152617 15141 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260810 15:29:09.152679 15141 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260810 15:29:09.152714 15141 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260810 15:29:09.153582 15141 ts_tablet_manager.cc:610] Registered 1 tablets
I20260810 15:29:09.153630 15141 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260810 15:29:09.153745 15256 tablet_bootstrap.cc:492] T 2a409dd036e348fbac8545b0465aae11 P 2504da2f74754aeebf64a3b94ec9dacd: Bootstrap starting.
I20260810 15:29:09.161188 15141 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.129:38391
I20260810 15:29:09.161252 15438 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.129:38391 every 8 connection(s)
I20260810 15:29:09.161687 15141 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-0/data/info.pb
I20260810 15:29:09.166474 15256 log.cc:824] T 2a409dd036e348fbac8545b0465aae11 P 2504da2f74754aeebf64a3b94ec9dacd: Log is configured to *not* fsync() on all Append() calls
I20260810 15:29:09.167390 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 15141
I20260810 15:29:09.167716 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.68.130:39415
--local_ip_for_outbound_sockets=127.18.68.130
--tserver_master_addrs=127.18.68.190:42677
--webserver_port=40625
--webserver_interface=127.18.68.130
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.130.keytab
--principal=kudu/127.18.68.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:36547
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 15:29:09.169029 15256 tablet_bootstrap.cc:492] T 2a409dd036e348fbac8545b0465aae11 P 2504da2f74754aeebf64a3b94ec9dacd: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 15:29:09.169425 15256 tablet_bootstrap.cc:492] T 2a409dd036e348fbac8545b0465aae11 P 2504da2f74754aeebf64a3b94ec9dacd: Bootstrap complete.
I20260810 15:29:09.171054 15256 ts_tablet_manager.cc:1397] T 2a409dd036e348fbac8545b0465aae11 P 2504da2f74754aeebf64a3b94ec9dacd: Time spent bootstrapping tablet: real 0.017s user 0.006s sys 0.011s
I20260810 15:29:09.172189 15256 raft_consensus.cc:348] T 2a409dd036e348fbac8545b0465aae11 P 2504da2f74754aeebf64a3b94ec9dacd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dee73ad54e7740bbbbfaafc864b08b64" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37887 } } peers { permanent_uuid: "e428d6c365a44bfbb97901a4471ff5d4" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 39415 } } peers { permanent_uuid: "2504da2f74754aeebf64a3b94ec9dacd" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 38391 } }
I20260810 15:29:09.172463 15256 raft_consensus.cc:729] T 2a409dd036e348fbac8545b0465aae11 P 2504da2f74754aeebf64a3b94ec9dacd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2504da2f74754aeebf64a3b94ec9dacd, State: Initialized, Role: FOLLOWER
I20260810 15:29:09.172672 15256 consensus_queue.cc:260] T 2a409dd036e348fbac8545b0465aae11 P 2504da2f74754aeebf64a3b94ec9dacd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dee73ad54e7740bbbbfaafc864b08b64" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37887 } } peers { permanent_uuid: "e428d6c365a44bfbb97901a4471ff5d4" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 39415 } } peers { permanent_uuid: "2504da2f74754aeebf64a3b94ec9dacd" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 38391 } }
I20260810 15:29:09.172984 15256 ts_tablet_manager.cc:1428] T 2a409dd036e348fbac8545b0465aae11 P 2504da2f74754aeebf64a3b94ec9dacd: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
W20260810 15:29:09.226630 15441 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 15:29:09.162546 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42677 (local address 127.18.68.129:57347)
0810 15:29:09.162788 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:09.162850 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0810 15:29:09.163654 (+ 804us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:29:09.226399 (+ 62745us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42677: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":114,"threads_started":1}
W20260810 15:29:09.226950 15439 heartbeater.cc:644] Failed to heartbeat to 127.18.68.190:42677 (0 consecutive failures): Network error: Failed to ping master at 127.18.68.190:42677: Client connection negotiation failed: client connection to 127.18.68.190:42677: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260810 15:29:09.227329 15441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:09.227202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42677 (local address 127.18.68.129:43541)
0810 15:29:09.227263 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:09.227308 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260810 15:29:09.227707 15441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:09.227611 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42677 (local address 127.18.68.129:47797)
0810 15:29:09.227661 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:09.227687 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260810 15:29:09.227871 15439 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260810 15:29:09.267244 15446 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:29:09.267511 15446 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:29:09.267557 15446 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:29:09.268837 15446 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:29:09.268913 15446 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:29:09.268963 15446 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.68.130
I20260810 15:29:09.270727 15446 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:36547
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.130.keytab
--principal=kudu/127.18.68.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.68.130:39415
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.68.130
--webserver_port=40625
--tserver_master_addrs=127.18.68.190:42677
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15446
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.68.130
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:29:09.271014 15446 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:29:09.271279 15446 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:29:09.277118 15460 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:29:09.277107 15459 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:29:09.277159 15446 server_base.cc:1034] running on GCE node
W20260810 15:29:09.277107 15463 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:29:09.277593 15446 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:29:09.277976 15446 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:29:09.279176 15446 hybrid_clock.cc:648] HybridClock initialized: now 1786375749279172 us; error 56 us; skew 500 ppm
Aug 10 15:29:09 dist-test-slave-2p8l krb5kdc[13190](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375749, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:29:09.281883 15446 init.cc:377] Logged in from keytab as kudu/127.18.68.130@KRBTEST.COM (short username kudu)
I20260810 15:29:09.282433 15446 webserver.cc:460] Webserver started at http://127.18.68.130:40625/ using document root <none> and password file <none>
I20260810 15:29:09.282677 15446 fs_manager.cc:359] Metadata directory not provided
I20260810 15:29:09.282750 15446 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:29:09.284237 15446 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260810 15:29:09.284992 15473 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:29:09.285218 15446 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 15:29:09.285337 15446 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-1/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-1/wal
uuid: "e428d6c365a44bfbb97901a4471ff5d4"
format_stamp: "Formatted at 2026-08-10 15:28:27 on dist-test-slave-2p8l"
server_key: "9266be9fcf01d29b16c55ff0be3adb03"
server_key_iv: "714f39bd16dfa992d21402416c6bb8ea"
server_key_version: "encryptionkey@0"
I20260810 15:29:09.285722 15446 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:29:09.303375 15446 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:29:09.305706 15446 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:29:09.305884 15446 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:29:09.306195 15446 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 15:29:09.306536 15446 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 15:29:09.306593 15446 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 15:29:09.306636 15446 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 15:29:09.306690 15446 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 15:29:09.312948 15446 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.130:39415
I20260810 15:29:09.313071 15682 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.130:39415 every 8 connection(s)
I20260810 15:29:09.313391 15446 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-1/data/info.pb
I20260810 15:29:09.314626 15687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:09.314224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42677 (local address 127.18.68.130:38609)
0810 15:29:09.314399 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:09.314470 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":88,"threads_started":1}
W20260810 15:29:09.315042 15683 heartbeater.cc:644] Failed to heartbeat to 127.18.68.190:42677 (0 consecutive failures): Network error: Failed to ping master at 127.18.68.190:42677: Client connection negotiation failed: client connection to 127.18.68.190:42677: connect: Connection refused (error 111)
I20260810 15:29:09.315335 15687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:09.315228 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42677 (local address 127.18.68.130:59051)
0810 15:29:09.315280 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:09.315304 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260810 15:29:09.315614 15687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:09.315529 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42677 (local address 127.18.68.130:52689)
0810 15:29:09.315573 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:09.315594 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260810 15:29:09.315743 15683 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260810 15:29:09.322304 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 15446
I20260810 15:29:09.322569 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.68.131:37887
--local_ip_for_outbound_sockets=127.18.68.131
--tserver_master_addrs=127.18.68.190:42677
--webserver_port=34127
--webserver_interface=127.18.68.131
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.131.keytab
--principal=kudu/127.18.68.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:36547
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:29:09.408433 15690 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:29:09.408682 15690 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:29:09.408723 15690 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:29:09.409899 15690 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:29:09.409976 15690 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:29:09.410022 15690 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.68.131
I20260810 15:29:09.411572 15690 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:36547
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.131.keytab
--principal=kudu/127.18.68.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.68.131:37887
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.68.131
--webserver_port=34127
--tserver_master_addrs=127.18.68.190:42677
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15690
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.68.131
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:29:09.411851 15690 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:29:09.412103 15690 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:29:09.417500 15698 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:29:09.417491 15702 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:29:09.417487 15697 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:29:09.417805 15690 server_base.cc:1034] running on GCE node
I20260810 15:29:09.417984 15690 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:29:09.418265 15690 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:29:09.419440 15690 hybrid_clock.cc:648] HybridClock initialized: now 1786375749419424 us; error 30 us; skew 500 ppm
Aug 10 15:29:09 dist-test-slave-2p8l krb5kdc[13190](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375749, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:29:09.422230 15690 init.cc:377] Logged in from keytab as kudu/127.18.68.131@KRBTEST.COM (short username kudu)
I20260810 15:29:09.422727 15690 webserver.cc:460] Webserver started at http://127.18.68.131:34127/ using document root <none> and password file <none>
I20260810 15:29:09.422964 15690 fs_manager.cc:359] Metadata directory not provided
I20260810 15:29:09.423012 15690 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:29:09.424642 15690 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 15:29:09.425387 15713 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:29:09.425577 15690 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:29:09.425725 15690 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-2/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-2/wal
uuid: "dee73ad54e7740bbbbfaafc864b08b64"
format_stamp: "Formatted at 2026-08-10 15:28:27 on dist-test-slave-2p8l"
server_key: "718e8cf954b3db2511b8fe7f447cc26e"
server_key_iv: "c32aeeb9dda9391caddb0986649d7164"
server_key_version: "encryptionkey@0"
I20260810 15:29:09.426112 15690 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:29:09.442700 15690 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:29:09.445158 15690 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:29:09.445381 15690 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:29:09.445701 15690 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 15:29:09.446106 15690 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 15:29:09.446175 15690 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 15:29:09.446220 15690 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 15:29:09.446261 15690 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 15:29:09.452246 15690 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.131:37887
I20260810 15:29:09.452327 15912 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.131:37887 every 8 connection(s)
I20260810 15:29:09.452703 15690 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786375520124696-18706-0/minicluster-data/ts-2/data/info.pb
I20260810 15:29:09.453907 15915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:09.453477 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42677 (local address 127.18.68.131:56603)
0810 15:29:09.453686 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:09.453762 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":88,"threads_started":1}
W20260810 15:29:09.454406 15913 heartbeater.cc:644] Failed to heartbeat to 127.18.68.190:42677 (0 consecutive failures): Network error: Failed to ping master at 127.18.68.190:42677: Client connection negotiation failed: client connection to 127.18.68.190:42677: connect: Connection refused (error 111)
I20260810 15:29:09.454788 15915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:09.454686 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42677 (local address 127.18.68.131:56665)
0810 15:29:09.454739 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:09.454768 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260810 15:29:09.455052 15915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:09.455005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42677 (local address 127.18.68.131:40513)
0810 15:29:09.455024 (+ 19us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:09.455041 (+ 17us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":11}
W20260810 15:29:09.455174 15913 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260810 15:29:09.458866 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 15690
I20260810 15:29:10.228581 15918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:10.228300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42677 (local address 127.18.68.129:38875)
0810 15:29:10.228452 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:10.228497 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":73,"threads_started":1}
I20260810 15:29:10.316251 15919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:10.316030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42677 (local address 127.18.68.130:53797)
0810 15:29:10.316150 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:10.316183 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":60,"threads_started":1}
I20260810 15:29:10.350175 15920 raft_consensus.cc:482] T 2a409dd036e348fbac8545b0465aae11 P 2504da2f74754aeebf64a3b94ec9dacd [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 15:29:10.350302 15920 raft_consensus.cc:504] T 2a409dd036e348fbac8545b0465aae11 P 2504da2f74754aeebf64a3b94ec9dacd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dee73ad54e7740bbbbfaafc864b08b64" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37887 } } peers { permanent_uuid: "e428d6c365a44bfbb97901a4471ff5d4" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 39415 } } peers { permanent_uuid: "2504da2f74754aeebf64a3b94ec9dacd" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 38391 } }
I20260810 15:29:10.350740 15920 leader_election.cc:288] T 2a409dd036e348fbac8545b0465aae11 P 2504da2f74754aeebf64a3b94ec9dacd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dee73ad54e7740bbbbfaafc864b08b64 (127.18.68.131:37887), e428d6c365a44bfbb97901a4471ff5d4 (127.18.68.130:39415)
Aug 10 15:29:10 dist-test-slave-2p8l krb5kdc[13190](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375749, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.129@KRBTEST.COM for kudu/127.18.68.131@KRBTEST.COM
Aug 10 15:29:10 dist-test-slave-2p8l krb5kdc[13190](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375749, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.129@KRBTEST.COM for kudu/127.18.68.130@KRBTEST.COM
I20260810 15:29:10.362144 15923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:10.350980 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.131:37887 (local address 127.18.68.129:45145)
0810 15:29:10.351122 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:10.351131 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 15:29:10.351181 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:29:10.351975 (+ 794us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:29:10.351976 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:29:10.352380 (+ 404us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:29:10.352572 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:29:10.352578 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:29:10.353751 (+ 1173us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:29:10.353752 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:29:10.354527 (+ 775us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:29:10.354529 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:29:10.355130 (+ 601us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:29:10.355131 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:29:10.355282 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:10.355876 (+ 594us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:29:10.355884 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:29:10.357473 (+ 1589us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:29:10.359946 (+ 2473us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:29:10.359956 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:29:10.359959 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:29:10.360404 (+ 445us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:29:10.360729 (+ 325us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:29:10.360730 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:29:10.360730 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:29:10.360918 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:29:10.361494 (+ 576us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:29:10.361503 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:29:10.361666 (+ 163us) client_negotiation.cc:769] Sending connection context
0810 15:29:10.361785 (+ 119us) client_negotiation.cc:240] Negotiation successful
0810 15:29:10.361997 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"mutex_wait_us":52,"thread_start_us":86,"threads_started":1}
I20260810 15:29:10.362185 15928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:10.351193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.129:45145 (local address 127.18.68.131:37887)
0810 15:29:10.351314 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0810 15:29:10.351325 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 15:29:10.351347 (+ 22us) server_negotiation.cc:407] Connection header received
0810 15:29:10.351763 (+ 416us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:29:10.351765 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:29:10.351815 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:29:10.351972 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:29:10.352699 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:10.353621 (+ 922us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:10.354616 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:10.355038 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:10.355140 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:10.357632 (+ 2492us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:29:10.357635 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:29:10.357636 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:29:10.357646 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:29:10.359848 (+ 2202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:29:10.360504 (+ 656us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:29:10.360507 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:29:10.360508 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:29:10.360655 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:29:10.361029 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:29:10.361030 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:29:10.361031 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:29:10.361413 (+ 382us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:29:10.361518 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0810 15:29:10.361880 (+ 362us) server_negotiation.cc:299] Negotiation successful
0810 15:29:10.362037 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87,"thread_start_us":63,"threads_started":1}
I20260810 15:29:10.362224 15918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:10.350932 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.130:39415 (local address 127.18.68.129:40293)
0810 15:29:10.350995 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:10.351010 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 15:29:10.351077 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:29:10.351962 (+ 885us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:29:10.351965 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:29:10.352380 (+ 415us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:29:10.352572 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:29:10.352578 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:29:10.353715 (+ 1137us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:29:10.353717 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:29:10.354581 (+ 864us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:29:10.354584 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:29:10.355166 (+ 582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:29:10.355167 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:29:10.355274 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:10.355937 (+ 663us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:29:10.355942 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:29:10.357861 (+ 1919us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:29:10.359946 (+ 2085us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:29:10.359956 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:29:10.359959 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:29:10.360404 (+ 445us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:29:10.360729 (+ 325us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:29:10.360730 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:29:10.360730 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:29:10.360918 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:29:10.361494 (+ 576us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:29:10.361503 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:29:10.361688 (+ 185us) client_negotiation.cc:769] Sending connection context
0810 15:29:10.361785 (+ 97us) client_negotiation.cc:240] Negotiation successful
0810 15:29:10.362054 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38,"mutex_wait_us":179}
I20260810 15:29:10.362216 15925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:10.351015 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.129:40293 (local address 127.18.68.130:39415)
0810 15:29:10.351211 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0810 15:29:10.351223 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 15:29:10.351264 (+ 41us) server_negotiation.cc:407] Connection header received
0810 15:29:10.351724 (+ 460us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:29:10.351727 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:29:10.351769 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:29:10.351889 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:29:10.352766 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:10.353611 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:10.354681 (+ 1070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:10.355059 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:10.355188 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:10.357974 (+ 2786us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:29:10.357978 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:29:10.357978 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:29:10.357990 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:29:10.359848 (+ 1858us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:29:10.360504 (+ 656us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:29:10.360507 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:29:10.360508 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:29:10.360631 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:29:10.361029 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:29:10.361030 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:29:10.361031 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:29:10.361402 (+ 371us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:29:10.361512 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0810 15:29:10.361880 (+ 368us) server_negotiation.cc:299] Negotiation successful
0810 15:29:10.362037 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":158,"thread_start_us":85,"threads_started":1}
W20260810 15:29:10.363304 15251 leader_election.cc:341] T 2a409dd036e348fbac8545b0465aae11 P 2504da2f74754aeebf64a3b94ec9dacd [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e428d6c365a44bfbb97901a4471ff5d4 (127.18.68.130:39415): Not found: Tablet not found: 2a409dd036e348fbac8545b0465aae11
W20260810 15:29:10.363432 15244 leader_election.cc:341] T 2a409dd036e348fbac8545b0465aae11 P 2504da2f74754aeebf64a3b94ec9dacd [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer dee73ad54e7740bbbbfaafc864b08b64 (127.18.68.131:37887): Not found: Tablet not found: 2a409dd036e348fbac8545b0465aae11
I20260810 15:29:10.363533 15244 leader_election.cc:302] T 2a409dd036e348fbac8545b0465aae11 P 2504da2f74754aeebf64a3b94ec9dacd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2504da2f74754aeebf64a3b94ec9dacd; no voters: dee73ad54e7740bbbbfaafc864b08b64, e428d6c365a44bfbb97901a4471ff5d4
I20260810 15:29:10.363675 15920 raft_consensus.cc:2726] T 2a409dd036e348fbac8545b0465aae11 P 2504da2f74754aeebf64a3b94ec9dacd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 15:29:10.455783 15930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:10.455527 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42677 (local address 127.18.68.131:44419)
0810 15:29:10.455698 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:10.455745 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":93,"threads_started":1}
I20260810 15:29:11.229434 15931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:11.229191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42677 (local address 127.18.68.129:57155)
0810 15:29:11.229331 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:11.229375 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":70,"threads_started":1}
I20260810 15:29:11.316921 15932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:11.316712 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42677 (local address 127.18.68.130:47457)
0810 15:29:11.316839 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:11.316880 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":64,"threads_started":1}
I20260810 15:29:11.456496 15934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:11.456258 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42677 (local address 127.18.68.131:45143)
0810 15:29:11.456410 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:11.456454 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":65,"threads_started":1}
I20260810 15:29:11.884788 15935 raft_consensus.cc:482] T 2a409dd036e348fbac8545b0465aae11 P 2504da2f74754aeebf64a3b94ec9dacd [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 15:29:11.884922 15935 raft_consensus.cc:504] T 2a409dd036e348fbac8545b0465aae11 P 2504da2f74754aeebf64a3b94ec9dacd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dee73ad54e7740bbbbfaafc864b08b64" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37887 } } peers { permanent_uuid: "e428d6c365a44bfbb97901a4471ff5d4" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 39415 } } peers { permanent_uuid: "2504da2f74754aeebf64a3b94ec9dacd" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 38391 } }
I20260810 15:29:11.885185 15935 leader_election.cc:288] T 2a409dd036e348fbac8545b0465aae11 P 2504da2f74754aeebf64a3b94ec9dacd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dee73ad54e7740bbbbfaafc864b08b64 (127.18.68.131:37887), e428d6c365a44bfbb97901a4471ff5d4 (127.18.68.130:39415)
W20260810 15:29:11.885638 15244 leader_election.cc:341] T 2a409dd036e348fbac8545b0465aae11 P 2504da2f74754aeebf64a3b94ec9dacd [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer dee73ad54e7740bbbbfaafc864b08b64 (127.18.68.131:37887): Not found: Tablet not found: 2a409dd036e348fbac8545b0465aae11
W20260810 15:29:11.885723 15251 leader_election.cc:341] T 2a409dd036e348fbac8545b0465aae11 P 2504da2f74754aeebf64a3b94ec9dacd [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e428d6c365a44bfbb97901a4471ff5d4 (127.18.68.130:39415): Not found: Tablet not found: 2a409dd036e348fbac8545b0465aae11
I20260810 15:29:11.885834 15251 leader_election.cc:302] T 2a409dd036e348fbac8545b0465aae11 P 2504da2f74754aeebf64a3b94ec9dacd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2504da2f74754aeebf64a3b94ec9dacd; no voters: dee73ad54e7740bbbbfaafc864b08b64, e428d6c365a44bfbb97901a4471ff5d4
I20260810 15:29:11.885939 15935 raft_consensus.cc:2726] T 2a409dd036e348fbac8545b0465aae11 P 2504da2f74754aeebf64a3b94ec9dacd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 15:29:12.230424 15936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:12.230157 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42677 (local address 127.18.68.129:58825)
0810 15:29:12.230298 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:12.230336 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":89,"threads_started":1}
I20260810 15:29:12.317631 15937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:12.317409 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42677 (local address 127.18.68.130:43179)
0810 15:29:12.317541 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:12.317586 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":64,"threads_started":1}
I20260810 15:29:12.457206 15938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:12.456988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42677 (local address 127.18.68.131:42843)
0810 15:29:12.457130 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:12.457167 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":68,"threads_started":1}
I20260810 15:29:13.231233 15941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:13.230973 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42677 (local address 127.18.68.129:44785)
0810 15:29:13.231123 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:13.231182 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":63,"threads_started":1}
I20260810 15:29:13.318429 15942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:13.318204 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42677 (local address 127.18.68.130:59705)
0810 15:29:13.318347 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:13.318386 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":79,"threads_started":1}
I20260810 15:29:13.458181 15943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:13.457853 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42677 (local address 127.18.68.131:54811)
0810 15:29:13.458016 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:13.458137 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":87,"threads_started":1}
I20260810 15:29:14.232178 15947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:14.231878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42677 (local address 127.18.68.129:39655)
0810 15:29:14.232072 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:14.232125 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":74,"threads_started":1}
I20260810 15:29:14.319234 15948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:14.318967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42677 (local address 127.18.68.130:33263)
0810 15:29:14.319134 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:14.319182 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":88,"threads_started":1}
I20260810 15:29:14.458949 15953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:14.458691 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42677 (local address 127.18.68.131:43249)
0810 15:29:14.458853 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:14.458901 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":86,"threads_started":1}
I20260810 15:29:14.944552 15955 raft_consensus.cc:482] T 2a409dd036e348fbac8545b0465aae11 P 2504da2f74754aeebf64a3b94ec9dacd [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 15:29:14.944708 15955 raft_consensus.cc:504] T 2a409dd036e348fbac8545b0465aae11 P 2504da2f74754aeebf64a3b94ec9dacd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dee73ad54e7740bbbbfaafc864b08b64" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37887 } } peers { permanent_uuid: "e428d6c365a44bfbb97901a4471ff5d4" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 39415 } } peers { permanent_uuid: "2504da2f74754aeebf64a3b94ec9dacd" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 38391 } }
I20260810 15:29:14.944918 15955 leader_election.cc:288] T 2a409dd036e348fbac8545b0465aae11 P 2504da2f74754aeebf64a3b94ec9dacd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dee73ad54e7740bbbbfaafc864b08b64 (127.18.68.131:37887), e428d6c365a44bfbb97901a4471ff5d4 (127.18.68.130:39415)
W20260810 15:29:14.945389 15244 leader_election.cc:341] T 2a409dd036e348fbac8545b0465aae11 P 2504da2f74754aeebf64a3b94ec9dacd [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer dee73ad54e7740bbbbfaafc864b08b64 (127.18.68.131:37887): Not found: Tablet not found: 2a409dd036e348fbac8545b0465aae11
W20260810 15:29:14.945473 15251 leader_election.cc:341] T 2a409dd036e348fbac8545b0465aae11 P 2504da2f74754aeebf64a3b94ec9dacd [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e428d6c365a44bfbb97901a4471ff5d4 (127.18.68.130:39415): Not found: Tablet not found: 2a409dd036e348fbac8545b0465aae11
I20260810 15:29:14.945542 15251 leader_election.cc:302] T 2a409dd036e348fbac8545b0465aae11 P 2504da2f74754aeebf64a3b94ec9dacd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2504da2f74754aeebf64a3b94ec9dacd; no voters: dee73ad54e7740bbbbfaafc864b08b64, e428d6c365a44bfbb97901a4471ff5d4
I20260810 15:29:14.945607 15955 raft_consensus.cc:2726] T 2a409dd036e348fbac8545b0465aae11 P 2504da2f74754aeebf64a3b94ec9dacd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 15:29:15.233062 15956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:15.232784 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42677 (local address 127.18.68.129:43617)
0810 15:29:15.232955 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:15.232999 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":70,"threads_started":1}
I20260810 15:29:15.320091 15957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:15.319832 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42677 (local address 127.18.68.130:58819)
0810 15:29:15.319999 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:15.320041 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":116,"threads_started":1}
I20260810 15:29:15.459740 15959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:15.459501 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42677 (local address 127.18.68.131:54077)
0810 15:29:15.459651 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:15.459692 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":62,"threads_started":1}
I20260810 15:29:16.233987 15960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:16.233717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42677 (local address 127.18.68.129:35349)
0810 15:29:16.233880 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:16.233926 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":81,"threads_started":1}
I20260810 15:29:16.320784 15963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:16.320556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42677 (local address 127.18.68.130:36101)
0810 15:29:16.320696 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:16.320738 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":64,"threads_started":1}
I20260810 15:29:16.460556 15965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:16.460289 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42677 (local address 127.18.68.131:44579)
0810 15:29:16.460470 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:16.460510 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":92,"threads_started":1}
I20260810 15:29:16.624949 15967 raft_consensus.cc:482] T 2a409dd036e348fbac8545b0465aae11 P 2504da2f74754aeebf64a3b94ec9dacd [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 15:29:16.625047 15967 raft_consensus.cc:504] T 2a409dd036e348fbac8545b0465aae11 P 2504da2f74754aeebf64a3b94ec9dacd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dee73ad54e7740bbbbfaafc864b08b64" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37887 } } peers { permanent_uuid: "e428d6c365a44bfbb97901a4471ff5d4" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 39415 } } peers { permanent_uuid: "2504da2f74754aeebf64a3b94ec9dacd" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 38391 } }
I20260810 15:29:16.625205 15967 leader_election.cc:288] T 2a409dd036e348fbac8545b0465aae11 P 2504da2f74754aeebf64a3b94ec9dacd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dee73ad54e7740bbbbfaafc864b08b64 (127.18.68.131:37887), e428d6c365a44bfbb97901a4471ff5d4 (127.18.68.130:39415)
W20260810 15:29:16.625663 15251 leader_election.cc:341] T 2a409dd036e348fbac8545b0465aae11 P 2504da2f74754aeebf64a3b94ec9dacd [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e428d6c365a44bfbb97901a4471ff5d4 (127.18.68.130:39415): Not found: Tablet not found: 2a409dd036e348fbac8545b0465aae11
W20260810 15:29:16.625739 15244 leader_election.cc:341] T 2a409dd036e348fbac8545b0465aae11 P 2504da2f74754aeebf64a3b94ec9dacd [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer dee73ad54e7740bbbbfaafc864b08b64 (127.18.68.131:37887): Not found: Tablet not found: 2a409dd036e348fbac8545b0465aae11
I20260810 15:29:16.625824 15244 leader_election.cc:302] T 2a409dd036e348fbac8545b0465aae11 P 2504da2f74754aeebf64a3b94ec9dacd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2504da2f74754aeebf64a3b94ec9dacd; no voters: dee73ad54e7740bbbbfaafc864b08b64, e428d6c365a44bfbb97901a4471ff5d4
I20260810 15:29:16.625913 15967 raft_consensus.cc:2726] T 2a409dd036e348fbac8545b0465aae11 P 2504da2f74754aeebf64a3b94ec9dacd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 15:29:17.234766 15969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:17.234528 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42677 (local address 127.18.68.129:41357)
0810 15:29:17.234679 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:17.234717 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":76,"threads_started":1}
I20260810 15:29:17.321630 15971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:17.321390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42677 (local address 127.18.68.130:47219)
0810 15:29:17.321536 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:17.321578 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":83,"threads_started":1}
I20260810 15:29:17.461324 15972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:17.461066 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42677 (local address 127.18.68.131:32833)
0810 15:29:17.461243 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:17.461281 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":64,"threads_started":1}
I20260810 15:29:18.235538 15977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:18.235271 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42677 (local address 127.18.68.129:59713)
0810 15:29:18.235439 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:18.235482 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":89,"threads_started":1}
I20260810 15:29:18.322422 15982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:18.322171 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42677 (local address 127.18.68.130:58661)
0810 15:29:18.322328 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:18.322373 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":83,"threads_started":1}
I20260810 15:29:18.462160 15983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:18.461850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42677 (local address 127.18.68.131:36333)
0810 15:29:18.461994 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:18.462049 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":73,"threads_started":1}
I20260810 15:29:19.236268 15984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:19.236045 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42677 (local address 127.18.68.129:50511)
0810 15:29:19.236178 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:19.236219 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":84,"threads_started":1}
I20260810 15:29:19.323309 15986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:19.323049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42677 (local address 127.18.68.130:57869)
0810 15:29:19.323196 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:19.323247 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":65,"threads_started":1}
I20260810 15:29:19.463007 15987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:19.462748 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42677 (local address 127.18.68.131:38571)
0810 15:29:19.462900 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:19.462954 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":78,"threads_started":1}
I20260810 15:29:19.794934 15988 raft_consensus.cc:482] T 2a409dd036e348fbac8545b0465aae11 P 2504da2f74754aeebf64a3b94ec9dacd [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 15:29:19.795056 15988 raft_consensus.cc:504] T 2a409dd036e348fbac8545b0465aae11 P 2504da2f74754aeebf64a3b94ec9dacd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dee73ad54e7740bbbbfaafc864b08b64" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37887 } } peers { permanent_uuid: "e428d6c365a44bfbb97901a4471ff5d4" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 39415 } } peers { permanent_uuid: "2504da2f74754aeebf64a3b94ec9dacd" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 38391 } }
I20260810 15:29:19.795270 15988 leader_election.cc:288] T 2a409dd036e348fbac8545b0465aae11 P 2504da2f74754aeebf64a3b94ec9dacd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dee73ad54e7740bbbbfaafc864b08b64 (127.18.68.131:37887), e428d6c365a44bfbb97901a4471ff5d4 (127.18.68.130:39415)
W20260810 15:29:19.795620 15244 leader_election.cc:341] T 2a409dd036e348fbac8545b0465aae11 P 2504da2f74754aeebf64a3b94ec9dacd [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer dee73ad54e7740bbbbfaafc864b08b64 (127.18.68.131:37887): Not found: Tablet not found: 2a409dd036e348fbac8545b0465aae11
W20260810 15:29:19.795802 15251 leader_election.cc:341] T 2a409dd036e348fbac8545b0465aae11 P 2504da2f74754aeebf64a3b94ec9dacd [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e428d6c365a44bfbb97901a4471ff5d4 (127.18.68.130:39415): Not found: Tablet not found: 2a409dd036e348fbac8545b0465aae11
I20260810 15:29:19.795864 15251 leader_election.cc:302] T 2a409dd036e348fbac8545b0465aae11 P 2504da2f74754aeebf64a3b94ec9dacd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2504da2f74754aeebf64a3b94ec9dacd; no voters: dee73ad54e7740bbbbfaafc864b08b64, e428d6c365a44bfbb97901a4471ff5d4
I20260810 15:29:19.795966 15988 raft_consensus.cc:2726] T 2a409dd036e348fbac8545b0465aae11 P 2504da2f74754aeebf64a3b94ec9dacd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 15:29:20.236967 15991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:20.236753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42677 (local address 127.18.68.129:54451)
0810 15:29:20.236880 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:20.236918 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":63,"threads_started":1}
I20260810 15:29:20.324079 15992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:20.323820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42677 (local address 127.18.68.130:40575)
0810 15:29:20.323995 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:20.324029 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":117,"threads_started":1}
I20260810 15:29:20.463673 15993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:20.463461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42677 (local address 127.18.68.131:49081)
0810 15:29:20.463588 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:20.463627 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":68,"threads_started":1}
I20260810 15:29:21.237730 15994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:21.237474 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42677 (local address 127.18.68.129:45037)
0810 15:29:21.237624 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:21.237666 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":65,"threads_started":1}
I20260810 15:29:21.324851 15995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:21.324600 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42677 (local address 127.18.68.130:49425)
0810 15:29:21.324757 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:21.324800 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":62,"threads_started":1}
I20260810 15:29:21.464361 15997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:21.464150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42677 (local address 127.18.68.131:39603)
0810 15:29:21.464282 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:21.464316 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":66,"threads_started":1}
I20260810 15:29:22.238574 15998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:22.238309 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42677 (local address 127.18.68.129:40689)
0810 15:29:22.238471 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:22.238523 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":100,"threads_started":1}
I20260810 15:29:22.325650 15999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:22.325397 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42677 (local address 127.18.68.130:52543)
0810 15:29:22.325547 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:22.325592 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":76,"threads_started":1}
I20260810 15:29:22.465073 16001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:22.464846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42677 (local address 127.18.68.131:54589)
0810 15:29:22.464993 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:22.465029 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":88,"threads_started":1}
I20260810 15:29:23.239337 16003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:23.239093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42677 (local address 127.18.68.129:46149)
0810 15:29:23.239239 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:23.239288 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":79,"threads_started":1}
I20260810 15:29:23.326514 16004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:23.326222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42677 (local address 127.18.68.130:36097)
0810 15:29:23.326417 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:23.326459 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":84,"threads_started":1}
I20260810 15:29:23.465843 16006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:23.465577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42677 (local address 127.18.68.131:38409)
0810 15:29:23.465741 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:23.465786 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":68,"threads_started":1}
I20260810 15:29:24.240212 16007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:24.239964 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42677 (local address 127.18.68.129:43881)
0810 15:29:24.240112 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:24.240163 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":77,"threads_started":1}
I20260810 15:29:24.327414 16009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:24.327168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42677 (local address 127.18.68.130:35031)
0810 15:29:24.327318 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:24.327362 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":65,"threads_started":1}
I20260810 15:29:24.459824 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 15141
I20260810 15:29:24.469687 16015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:24.468145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:42677 (local address 127.18.68.131:50669)
0810 15:29:24.469583 (+ 1438us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:24.469625 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.190:42677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1415,"thread_start_us":62,"threads_started":1}
I20260810 15:29:24.478013 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 15446
I20260810 15:29:24.490762 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 15690
2026-08-10T15:29:24Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (58856 ms)
[----------] 30 tests from SecurityITest (244380 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786375520124696-18706-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 15:29:24 dist-test-slave-2p8l krb5kdc[16019](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 15:29:24 dist-test-slave-2p8l krb5kdc[16019](info): set up 2 sockets
Aug 10 15:29:24 dist-test-slave-2p8l krb5kdc[16019](info): commencing operation
krb5kdc: starting...
W20260810 15:29:25.798641 18706 mini_kdc.cc:121] Time spent starting KDC: real 1.280s user 0.005s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786375520124696-18706-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786375520124696-18706-0/krb5kdc/test-user.keytab.
Aug 10 15:29:25 dist-test-slave-2p8l krb5kdc[16019](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375765, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T15:29:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T15:29:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.68.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.68.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.68.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab.
Entry for principal kudu/127.18.68.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab.
I20260810 15:29:25.920886 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786375520124696-18706-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786375520124696-18706-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786375520124696-18706-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.190:39879
--webserver_interface=127.18.68.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab
--principal=kudu/127.18.68.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:45571
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.68.190:39879
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:29:26.004483 16036 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:29:26.004733 16036 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:29:26.004756 16036 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:29:26.005942 16036 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 15:29:26.005990 16036 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:29:26.006006 16036 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:29:26.006018 16036 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 15:29:26.006031 16036 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 15:29:26.007578 16036 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:45571
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786375520124696-18706-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786375520124696-18706-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.68.190:39879
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab
--principal=kudu/127.18.68.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.190:39879
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.68.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16036
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786375520124696-18706-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:29:26.007784 16036 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:29:26.007961 16036 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:29:26.013500 16042 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:29:26.013469 16043 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:29:26.013549 16036 server_base.cc:1034] running on GCE node
W20260810 15:29:26.013492 16046 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:29:26.014036 16036 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:29:26.014469 16036 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:29:26.015657 16036 hybrid_clock.cc:648] HybridClock initialized: now 1786375766015642 us; error 34 us; skew 500 ppm
Aug 10 15:29:26 dist-test-slave-2p8l krb5kdc[16019](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375766, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:29:26.018496 16036 init.cc:377] Logged in from keytab as kudu/127.18.68.190@KRBTEST.COM (short username kudu)
I20260810 15:29:26.019074 16036 webserver.cc:460] Webserver started at http://127.18.68.190:36045/ using document root <none> and password file <none>
I20260810 15:29:26.019333 16036 fs_manager.cc:359] Metadata directory not provided
I20260810 15:29:26.019411 16036 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:29:26.019618 16036 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:29:26.020815 16036 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786375520124696-18706-0/minicluster-data/master-0/data/instance:
uuid: "0191c87ecd4b4b5a8dfb1c943df40418"
format_stamp: "Formatted at 2026-08-10 15:29:26 on dist-test-slave-2p8l"
server_key: "2518c2fccddf8456e7fd25390af1fe27"
server_key_iv: "73f4ee43829820a67e73423897fc4a89"
server_key_version: "encryptionkey@0"
I20260810 15:29:26.021232 16036 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786375520124696-18706-0/minicluster-data/master-0/wal/instance:
uuid: "0191c87ecd4b4b5a8dfb1c943df40418"
format_stamp: "Formatted at 2026-08-10 15:29:26 on dist-test-slave-2p8l"
server_key: "2518c2fccddf8456e7fd25390af1fe27"
server_key_iv: "73f4ee43829820a67e73423897fc4a89"
server_key_version: "encryptionkey@0"
I20260810 15:29:26.022879 16036 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 15:29:26.023829 16059 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:29:26.024076 16036 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 15:29:26.024206 16036 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786375520124696-18706-0/minicluster-data/master-0/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786375520124696-18706-0/minicluster-data/master-0/wal
uuid: "0191c87ecd4b4b5a8dfb1c943df40418"
format_stamp: "Formatted at 2026-08-10 15:29:26 on dist-test-slave-2p8l"
server_key: "2518c2fccddf8456e7fd25390af1fe27"
server_key_iv: "73f4ee43829820a67e73423897fc4a89"
server_key_version: "encryptionkey@0"
I20260810 15:29:26.024294 16036 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786375520124696-18706-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786375520124696-18706-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786375520124696-18706-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:29:26.039717 16036 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:29:26.041935 16036 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:29:26.042168 16036 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:29:26.046710 16036 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.190:39879
I20260810 15:29:26.046748 16151 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.190:39879 every 8 connection(s)
I20260810 15:29:26.047155 16036 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
I20260810 15:29:26.048067 16153 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:29:26.050598 16153 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0191c87ecd4b4b5a8dfb1c943df40418: Bootstrap starting.
I20260810 15:29:26.051205 16153 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0191c87ecd4b4b5a8dfb1c943df40418: Neither blocks nor log segments found. Creating new log.
I20260810 15:29:26.051514 16153 log.cc:824] T 00000000000000000000000000000000 P 0191c87ecd4b4b5a8dfb1c943df40418: Log is configured to *not* fsync() on all Append() calls
I20260810 15:29:26.052312 16153 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0191c87ecd4b4b5a8dfb1c943df40418: No bootstrap required, opened a new log
I20260810 15:29:26.053887 16153 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0191c87ecd4b4b5a8dfb1c943df40418 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0191c87ecd4b4b5a8dfb1c943df40418" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 39879 } }
I20260810 15:29:26.054047 16153 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0191c87ecd4b4b5a8dfb1c943df40418 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:29:26.054121 16153 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0191c87ecd4b4b5a8dfb1c943df40418 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0191c87ecd4b4b5a8dfb1c943df40418, State: Initialized, Role: FOLLOWER
I20260810 15:29:26.054267 16153 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0191c87ecd4b4b5a8dfb1c943df40418 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0191c87ecd4b4b5a8dfb1c943df40418" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 39879 } }
I20260810 15:29:26.054364 16153 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0191c87ecd4b4b5a8dfb1c943df40418 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 15:29:26.054409 16153 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0191c87ecd4b4b5a8dfb1c943df40418 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 15:29:26.054463 16153 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0191c87ecd4b4b5a8dfb1c943df40418 [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:29:26.055155 16153 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0191c87ecd4b4b5a8dfb1c943df40418 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0191c87ecd4b4b5a8dfb1c943df40418" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 39879 } }
I20260810 15:29:26.055277 16153 leader_election.cc:302] T 00000000000000000000000000000000 P 0191c87ecd4b4b5a8dfb1c943df40418 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0191c87ecd4b4b5a8dfb1c943df40418; no voters:
I20260810 15:29:26.055466 16153 leader_election.cc:288] T 00000000000000000000000000000000 P 0191c87ecd4b4b5a8dfb1c943df40418 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 15:29:26.055536 16157 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0191c87ecd4b4b5a8dfb1c943df40418 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 15:29:26.055738 16153 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0191c87ecd4b4b5a8dfb1c943df40418 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 15:29:26.055859 16157 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0191c87ecd4b4b5a8dfb1c943df40418 [term 1 LEADER]: Becoming Leader. State: Replica: 0191c87ecd4b4b5a8dfb1c943df40418, State: Running, Role: LEADER
I20260810 15:29:26.055850 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 16036
I20260810 15:29:26.055965 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786375520124696-18706-0/minicluster-data/master-0/wal/instance
I20260810 15:29:26.056015 16157 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0191c87ecd4b4b5a8dfb1c943df40418 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0191c87ecd4b4b5a8dfb1c943df40418" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 39879 } }
I20260810 15:29:26.056209 18706 external_mini_cluster.cc:1428] Setting key 0f32e8d6e7f5ae7ccdd70f1320dbd40d
I20260810 15:29:26.056427 16157 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0191c87ecd4b4b5a8dfb1c943df40418 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0191c87ecd4b4b5a8dfb1c943df40418. Latest consensus state: current_term: 1 leader_uuid: "0191c87ecd4b4b5a8dfb1c943df40418" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0191c87ecd4b4b5a8dfb1c943df40418" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 39879 } } }
I20260810 15:29:26.056509 16157 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0191c87ecd4b4b5a8dfb1c943df40418 [sys.catalog]: This master's current role is: LEADER
I20260810 15:29:26.056602 16159 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0191c87ecd4b4b5a8dfb1c943df40418 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0191c87ecd4b4b5a8dfb1c943df40418" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0191c87ecd4b4b5a8dfb1c943df40418" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 39879 } } }
I20260810 15:29:26.056674 16159 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0191c87ecd4b4b5a8dfb1c943df40418 [sys.catalog]: This master's current role is: LEADER
I20260810 15:29:26.056778 16181 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 15:29:26.057638 16181 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 15:29:26.059376 16181 catalog_manager.cc:1347] Generated new cluster ID: 6e791a5fd7c84209b92810d1d29d15f7
I20260810 15:29:26.059437 16181 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 15:29:26.064253 16181 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 15:29:26.065045 16181 catalog_manager.cc:1504] Loading token signing keys...
Aug 10 15:29:26 dist-test-slave-2p8l krb5kdc[16019](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375765, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
I20260810 15:29:26.069928 16191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:26.056916 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35508 (local address 127.18.68.190:39879)
0810 15:29:26.057315 (+ 399us) server_negotiation.cc:206] Beginning negotiation
0810 15:29:26.057378 (+ 63us) server_negotiation.cc:399] Waiting for connection header
0810 15:29:26.057440 (+ 62us) server_negotiation.cc:407] Connection header received
0810 15:29:26.057561 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:29:26.057568 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:29:26.057634 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:29:26.057778 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:29:26.059119 (+ 1341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:26.060676 (+ 1557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:26.061829 (+ 1153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:26.062550 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:26.062661 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:26.065691 (+ 3030us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:29:26.065695 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:29:26.065696 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:29:26.065709 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:29:26.067865 (+ 2156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:29:26.068289 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:29:26.068292 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:29:26.068293 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:29:26.068403 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:29:26.068603 (+ 200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:29:26.068603 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:29:26.068603 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:29:26.068868 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:29:26.069011 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0810 15:29:26.069515 (+ 504us) server_negotiation.cc:299] Negotiation successful
0810 15:29:26.069680 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":6,"server-negotiator.queue_time_us":351,"thread_start_us":103,"threads_started":1}
I20260810 15:29:26.072715 16181 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0191c87ecd4b4b5a8dfb1c943df40418: Generated new TSK 0
I20260810 15:29:26.072911 16181 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.18.68.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.68.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.68.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.129.keytab.
Entry for principal kudu/127.18.68.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.129.keytab.
I20260810 15:29:26.107383 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786375520124696-18706-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786375520124696-18706-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786375520124696-18706-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786375520124696-18706-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.68.129:0
--local_ip_for_outbound_sockets=127.18.68.129
--webserver_interface=127.18.68.129
--webserver_port=0
--tserver_master_addrs=127.18.68.190:39879
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.129.keytab
--principal=kudu/127.18.68.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:45571
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:29:26.192663 16203 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:29:26.192878 16203 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:29:26.192901 16203 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:29:26.194099 16203 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:29:26.194145 16203 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:29:26.194171 16203 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.68.129
I20260810 15:29:26.195676 16203 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:45571
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786375520124696-18706-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786375520124696-18706-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.129.keytab
--principal=kudu/127.18.68.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.68.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786375520124696-18706-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.68.129
--webserver_port=0
--tserver_master_addrs=127.18.68.190:39879
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16203
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.68.129
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786375520124696-18706-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:29:26.195945 16203 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:29:26.196194 16203 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:29:26.201318 16215 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:29:26.201339 16212 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:29:26.201333 16213 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:29:26.201511 16203 server_base.cc:1034] running on GCE node
I20260810 15:29:26.201776 16203 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:29:26.202036 16203 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:29:26.203246 16203 hybrid_clock.cc:648] HybridClock initialized: now 1786375766203237 us; error 36 us; skew 500 ppm
Aug 10 15:29:26 dist-test-slave-2p8l krb5kdc[16019](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375766, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:29:26.205945 16203 init.cc:377] Logged in from keytab as kudu/127.18.68.129@KRBTEST.COM (short username kudu)
I20260810 15:29:26.206413 16203 webserver.cc:460] Webserver started at http://127.18.68.129:34391/ using document root <none> and password file <none>
I20260810 15:29:26.206677 16203 fs_manager.cc:359] Metadata directory not provided
I20260810 15:29:26.206749 16203 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:29:26.206897 16203 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:29:26.208005 16203 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786375520124696-18706-0/minicluster-data/ts-0/data/instance:
uuid: "6dbf5c73bea74b73b95fd23a70357465"
format_stamp: "Formatted at 2026-08-10 15:29:26 on dist-test-slave-2p8l"
server_key: "aa0fc1dcdcc8afbe4f37de8b7419dae2"
server_key_iv: "db8aca109aa86dbec99c5ae18532369d"
server_key_version: "encryptionkey@0"
I20260810 15:29:26.208374 16203 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786375520124696-18706-0/minicluster-data/ts-0/wal/instance:
uuid: "6dbf5c73bea74b73b95fd23a70357465"
format_stamp: "Formatted at 2026-08-10 15:29:26 on dist-test-slave-2p8l"
server_key: "aa0fc1dcdcc8afbe4f37de8b7419dae2"
server_key_iv: "db8aca109aa86dbec99c5ae18532369d"
server_key_version: "encryptionkey@0"
I20260810 15:29:26.209726 16203 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 15:29:26.210525 16226 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:29:26.210736 16203 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260810 15:29:26.210879 16203 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786375520124696-18706-0/minicluster-data/ts-0/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786375520124696-18706-0/minicluster-data/ts-0/wal
uuid: "6dbf5c73bea74b73b95fd23a70357465"
format_stamp: "Formatted at 2026-08-10 15:29:26 on dist-test-slave-2p8l"
server_key: "aa0fc1dcdcc8afbe4f37de8b7419dae2"
server_key_iv: "db8aca109aa86dbec99c5ae18532369d"
server_key_version: "encryptionkey@0"
I20260810 15:29:26.210969 16203 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786375520124696-18706-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786375520124696-18706-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786375520124696-18706-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:29:26.222538 16203 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:29:26.224582 16203 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:29:26.224695 16203 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:29:26.224854 16203 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 15:29:26.225200 16203 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 15:29:26.225257 16203 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 15:29:26.225301 16203 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 15:29:26.225327 16203 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 15:29:26.231518 16203 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.129:40877
I20260810 15:29:26.231593 16423 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.129:40877 every 8 connection(s)
I20260810 15:29:26.231910 16203 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786375520124696-18706-0/minicluster-data/ts-0/data/info.pb
I20260810 15:29:26.233270 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 16203
I20260810 15:29:26.233361 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786375520124696-18706-0/minicluster-data/ts-0/wal/instance
I20260810 15:29:26.233594 18706 external_mini_cluster.cc:1428] Setting key 8025ebf6f6e28594651df4a15e33f0c8
Aug 10 15:29:26 dist-test-slave-2p8l krb5kdc[16019](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375766, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.129@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
I20260810 15:29:26.242854 16191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:26.232665 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.129:32863 (local address 127.18.68.190:39879)
0810 15:29:26.232719 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0810 15:29:26.232721 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:29:26.232991 (+ 270us) server_negotiation.cc:407] Connection header received
0810 15:29:26.233617 (+ 626us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:29:26.233618 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:29:26.233631 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:29:26.233696 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:29:26.234858 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:26.235372 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:26.236770 (+ 1398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:26.236967 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:26.237020 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:26.239638 (+ 2618us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:29:26.239639 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:29:26.239640 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:29:26.239648 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:29:26.241107 (+ 1459us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:29:26.241545 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:29:26.241546 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:29:26.241547 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:29:26.241622 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:29:26.241935 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:29:26.241936 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:29:26.241936 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:29:26.242119 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:29:26.242197 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0810 15:29:26.242579 (+ 382us) server_negotiation.cc:299] Negotiation successful
0810 15:29:26.242683 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260810 15:29:26.242928 16427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:26.232672 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:39879 (local address 127.18.68.129:32863)
0810 15:29:26.232863 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:26.232898 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0810 15:29:26.233506 (+ 608us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:29:26.233771 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:29:26.233775 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:29:26.234557 (+ 782us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:29:26.234754 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:29:26.234758 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:29:26.235475 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:29:26.235476 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:29:26.236665 (+ 1189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:29:26.236669 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:29:26.237053 (+ 384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:29:26.237054 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:29:26.237205 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:26.237765 (+ 560us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:29:26.237773 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:29:26.239511 (+ 1738us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:29:26.241214 (+ 1703us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:29:26.241221 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:29:26.241223 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:29:26.241445 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:29:26.241718 (+ 273us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:29:26.241720 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:29:26.241720 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:29:26.241864 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:29:26.242233 (+ 369us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:29:26.242240 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:29:26.242406 (+ 166us) client_negotiation.cc:769] Sending connection context
0810 15:29:26.242522 (+ 116us) client_negotiation.cc:240] Negotiation successful
0810 15:29:26.242692 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":106,"threads_started":1}
WARNING: no policy specified for kudu/127.18.68.130@KRBTEST.COM; defaulting to no policy
I20260810 15:29:26.243920 16424 heartbeater.cc:347] Connected to a master server at 127.18.68.190:39879
I20260810 15:29:26.244026 16424 heartbeater.cc:464] Registering TS with master...
I20260810 15:29:26.244179 16424 heartbeater.cc:511] Master 127.18.68.190:39879 requested a full tablet report, sending...
I20260810 15:29:26.244776 16095 ts_manager.cc:194] Registered new tserver with Master: 6dbf5c73bea74b73b95fd23a70357465 (127.18.68.129:40877)
I20260810 15:29:26.245347 16095 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.68.129@KRBTEST.COM'} at 127.18.68.129:32863
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.68.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.68.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.130.keytab.
Entry for principal kudu/127.18.68.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.130.keytab.
I20260810 15:29:26.264866 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786375520124696-18706-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786375520124696-18706-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786375520124696-18706-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786375520124696-18706-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.68.130:0
--local_ip_for_outbound_sockets=127.18.68.130
--webserver_interface=127.18.68.130
--webserver_port=0
--tserver_master_addrs=127.18.68.190:39879
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.130.keytab
--principal=kudu/127.18.68.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:45571
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:29:26.350839 16436 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:29:26.351053 16436 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:29:26.351078 16436 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:29:26.352224 16436 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:29:26.352267 16436 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:29:26.352293 16436 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.68.130
I20260810 15:29:26.353727 16436 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:45571
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786375520124696-18706-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786375520124696-18706-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.130.keytab
--principal=kudu/127.18.68.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.68.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786375520124696-18706-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.68.130
--webserver_port=0
--tserver_master_addrs=127.18.68.190:39879
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16436
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.68.130
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786375520124696-18706-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:29:26.353965 16436 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:29:26.354221 16436 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:29:26.359503 16454 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:29:26.359498 16447 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:29:26.359521 16449 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:29:26.359836 16436 server_base.cc:1034] running on GCE node
I20260810 15:29:26.360067 16436 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:29:26.360327 16436 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:29:26.361500 16436 hybrid_clock.cc:648] HybridClock initialized: now 1786375766361486 us; error 30 us; skew 500 ppm
Aug 10 15:29:26 dist-test-slave-2p8l krb5kdc[16019](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375766, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:29:26.364146 16436 init.cc:377] Logged in from keytab as kudu/127.18.68.130@KRBTEST.COM (short username kudu)
I20260810 15:29:26.364624 16436 webserver.cc:460] Webserver started at http://127.18.68.130:34957/ using document root <none> and password file <none>
I20260810 15:29:26.364866 16436 fs_manager.cc:359] Metadata directory not provided
I20260810 15:29:26.364943 16436 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:29:26.365120 16436 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:29:26.366304 16436 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786375520124696-18706-0/minicluster-data/ts-1/data/instance:
uuid: "0c29a81aac34492088d52604adcac4f7"
format_stamp: "Formatted at 2026-08-10 15:29:26 on dist-test-slave-2p8l"
server_key: "34041cf9df528c9b7650ff47dba2b8bb"
server_key_iv: "704c53ac841278469167546c2e810bae"
server_key_version: "encryptionkey@0"
I20260810 15:29:26.366696 16436 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786375520124696-18706-0/minicluster-data/ts-1/wal/instance:
uuid: "0c29a81aac34492088d52604adcac4f7"
format_stamp: "Formatted at 2026-08-10 15:29:26 on dist-test-slave-2p8l"
server_key: "34041cf9df528c9b7650ff47dba2b8bb"
server_key_iv: "704c53ac841278469167546c2e810bae"
server_key_version: "encryptionkey@0"
I20260810 15:29:26.368103 16436 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 15:29:26.368876 16465 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:29:26.369058 16436 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 15:29:26.369191 16436 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786375520124696-18706-0/minicluster-data/ts-1/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786375520124696-18706-0/minicluster-data/ts-1/wal
uuid: "0c29a81aac34492088d52604adcac4f7"
format_stamp: "Formatted at 2026-08-10 15:29:26 on dist-test-slave-2p8l"
server_key: "34041cf9df528c9b7650ff47dba2b8bb"
server_key_iv: "704c53ac841278469167546c2e810bae"
server_key_version: "encryptionkey@0"
I20260810 15:29:26.369278 16436 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786375520124696-18706-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786375520124696-18706-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786375520124696-18706-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:29:26.377573 16436 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:29:26.380168 16436 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:29:26.380358 16436 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:29:26.380636 16436 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 15:29:26.380972 16436 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 15:29:26.381034 16436 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 15:29:26.381094 16436 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 15:29:26.381130 16436 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 15:29:26.387810 16436 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.130:39397
I20260810 15:29:26.387853 16667 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.130:39397 every 8 connection(s)
I20260810 15:29:26.388216 16436 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786375520124696-18706-0/minicluster-data/ts-1/data/info.pb
I20260810 15:29:26.390580 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 16436
I20260810 15:29:26.390676 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786375520124696-18706-0/minicluster-data/ts-1/wal/instance
I20260810 15:29:26.390897 18706 external_mini_cluster.cc:1428] Setting key 1e2e36d3f578a6b15c7ad56df1889291
Aug 10 15:29:26 dist-test-slave-2p8l krb5kdc[16019](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375766, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.130@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
I20260810 15:29:26.399199 16191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:26.389098 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.130:39531 (local address 127.18.68.190:39879)
0810 15:29:26.389164 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0810 15:29:26.389167 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 15:29:26.389374 (+ 207us) server_negotiation.cc:407] Connection header received
0810 15:29:26.389898 (+ 524us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:29:26.389900 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:29:26.389914 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:29:26.389978 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:29:26.391218 (+ 1240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:26.391947 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:26.392983 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:26.393308 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:26.393394 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:26.395973 (+ 2579us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:29:26.395975 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:29:26.395975 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:29:26.395983 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:29:26.397570 (+ 1587us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:29:26.398117 (+ 547us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:29:26.398119 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:29:26.398119 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:29:26.398189 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:29:26.398483 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:29:26.398484 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:29:26.398485 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:29:26.398612 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:29:26.398691 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0810 15:29:26.399001 (+ 310us) server_negotiation.cc:299] Negotiation successful
0810 15:29:26.399100 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260810 15:29:26.399423 16672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:26.389039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:39879 (local address 127.18.68.130:39531)
0810 15:29:26.389232 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:26.389278 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0810 15:29:26.389785 (+ 507us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:29:26.390034 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:29:26.390038 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:29:26.390788 (+ 750us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:29:26.391053 (+ 265us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:29:26.391059 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:29:26.392085 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:29:26.392086 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:29:26.392880 (+ 794us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:29:26.392882 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:29:26.393451 (+ 569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:29:26.393453 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:29:26.393632 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:26.394254 (+ 622us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:29:26.394266 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:29:26.395872 (+ 1606us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:29:26.397714 (+ 1842us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:29:26.397723 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:29:26.397725 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:29:26.397976 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:29:26.398273 (+ 297us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:29:26.398274 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:29:26.398275 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:29:26.398398 (+ 123us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:29:26.398696 (+ 298us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:29:26.398704 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:29:26.398853 (+ 149us) client_negotiation.cc:769] Sending connection context
0810 15:29:26.398964 (+ 111us) client_negotiation.cc:240] Negotiation successful
0810 15:29:26.399139 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":102,"threads_started":1}
I20260810 15:29:26.400223 16668 heartbeater.cc:347] Connected to a master server at 127.18.68.190:39879
I20260810 15:29:26.400309 16668 heartbeater.cc:464] Registering TS with master...
I20260810 15:29:26.400496 16668 heartbeater.cc:511] Master 127.18.68.190:39879 requested a full tablet report, sending...
I20260810 15:29:26.400914 16095 ts_manager.cc:194] Registered new tserver with Master: 0c29a81aac34492088d52604adcac4f7 (127.18.68.130:39397)
WARNING: no policy specified for kudu/127.18.68.131@KRBTEST.COM; defaulting to no policy
I20260810 15:29:26.401305 16095 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.68.130@KRBTEST.COM'} at 127.18.68.130:39531
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.68.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.68.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.131.keytab.
Entry for principal kudu/127.18.68.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.131.keytab.
I20260810 15:29:26.420532 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786375520124696-18706-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786375520124696-18706-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786375520124696-18706-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786375520124696-18706-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.68.131:0
--local_ip_for_outbound_sockets=127.18.68.131
--webserver_interface=127.18.68.131
--webserver_port=0
--tserver_master_addrs=127.18.68.190:39879
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.131.keytab
--principal=kudu/127.18.68.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:45571
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:29:26.505442 16679 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:29:26.505654 16679 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:29:26.505678 16679 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:29:26.506927 16679 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:29:26.506973 16679 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:29:26.507000 16679 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.68.131
I20260810 15:29:26.508489 16679 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:45571
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786375520124696-18706-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786375520124696-18706-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.131.keytab
--principal=kudu/127.18.68.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.68.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786375520124696-18706-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.68.131
--webserver_port=0
--tserver_master_addrs=127.18.68.190:39879
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16679
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.68.131
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786375520124696-18706-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:29:26.508736 16679 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:29:26.508985 16679 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:29:26.514271 16693 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:29:26.514300 16696 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:29:26.514308 16692 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:29:26.514515 16679 server_base.cc:1034] running on GCE node
I20260810 15:29:26.514755 16679 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:29:26.514953 16679 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:29:26.516100 16679 hybrid_clock.cc:648] HybridClock initialized: now 1786375766516085 us; error 42 us; skew 500 ppm
Aug 10 15:29:26 dist-test-slave-2p8l krb5kdc[16019](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375766, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:29:26.518931 16679 init.cc:377] Logged in from keytab as kudu/127.18.68.131@KRBTEST.COM (short username kudu)
I20260810 15:29:26.519418 16679 webserver.cc:460] Webserver started at http://127.18.68.131:46101/ using document root <none> and password file <none>
I20260810 15:29:26.519696 16679 fs_manager.cc:359] Metadata directory not provided
I20260810 15:29:26.519744 16679 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:29:26.519894 16679 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:29:26.520926 16679 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786375520124696-18706-0/minicluster-data/ts-2/data/instance:
uuid: "feb436396f72499caee0ecdb01e44bf7"
format_stamp: "Formatted at 2026-08-10 15:29:26 on dist-test-slave-2p8l"
server_key: "2bedd6839ffd8d1dd92c8e8e901fe69e"
server_key_iv: "8e3698bdfa7fdf2abbd1cd7377ec317d"
server_key_version: "encryptionkey@0"
I20260810 15:29:26.521283 16679 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786375520124696-18706-0/minicluster-data/ts-2/wal/instance:
uuid: "feb436396f72499caee0ecdb01e44bf7"
format_stamp: "Formatted at 2026-08-10 15:29:26 on dist-test-slave-2p8l"
server_key: "2bedd6839ffd8d1dd92c8e8e901fe69e"
server_key_iv: "8e3698bdfa7fdf2abbd1cd7377ec317d"
server_key_version: "encryptionkey@0"
I20260810 15:29:26.522848 16679 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 15:29:26.523761 16710 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:29:26.523978 16679 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 15:29:26.524056 16679 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786375520124696-18706-0/minicluster-data/ts-2/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786375520124696-18706-0/minicluster-data/ts-2/wal
uuid: "feb436396f72499caee0ecdb01e44bf7"
format_stamp: "Formatted at 2026-08-10 15:29:26 on dist-test-slave-2p8l"
server_key: "2bedd6839ffd8d1dd92c8e8e901fe69e"
server_key_iv: "8e3698bdfa7fdf2abbd1cd7377ec317d"
server_key_version: "encryptionkey@0"
I20260810 15:29:26.524142 16679 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786375520124696-18706-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786375520124696-18706-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786375520124696-18706-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:29:26.554831 16679 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:29:26.557677 16679 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:29:26.557842 16679 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:29:26.558173 16679 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 15:29:26.558514 16679 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 15:29:26.558552 16679 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 15:29:26.558606 16679 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 15:29:26.558641 16679 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 15:29:26.565160 16679 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.131:37547
I20260810 15:29:26.565241 16912 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.131:37547 every 8 connection(s)
I20260810 15:29:26.565578 16679 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786375520124696-18706-0/minicluster-data/ts-2/data/info.pb
I20260810 15:29:26.566226 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 16679
I20260810 15:29:26.566349 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786375520124696-18706-0/minicluster-data/ts-2/wal/instance
I20260810 15:29:26.566581 18706 external_mini_cluster.cc:1428] Setting key 01c7fca9b5d7a737f306a4a4ba35ccb4
Aug 10 15:29:26 dist-test-slave-2p8l krb5kdc[16019](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375766, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.131@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
I20260810 15:29:26.576109 16191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:26.566413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.131:56343 (local address 127.18.68.190:39879)
0810 15:29:26.566472 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0810 15:29:26.566474 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:29:26.566723 (+ 249us) server_negotiation.cc:407] Connection header received
0810 15:29:26.567415 (+ 692us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:29:26.567416 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:29:26.567429 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:29:26.567474 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:29:26.568431 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:26.568940 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:26.570227 (+ 1287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:26.570442 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:26.570531 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:26.573047 (+ 2516us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:29:26.573048 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:29:26.573048 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:29:26.573056 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:29:26.574613 (+ 1557us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:29:26.575035 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:29:26.575037 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:29:26.575037 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:29:26.575105 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:29:26.575383 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:29:26.575385 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:29:26.575385 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:29:26.575510 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:29:26.575580 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0810 15:29:26.575952 (+ 372us) server_negotiation.cc:299] Negotiation successful
0810 15:29:26.576036 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260810 15:29:26.576241 16916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:26.566417 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:39879 (local address 127.18.68.131:56343)
0810 15:29:26.566600 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:26.566644 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0810 15:29:26.567315 (+ 671us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:29:26.567541 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:29:26.567545 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:29:26.568136 (+ 591us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:29:26.568331 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:29:26.568336 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:29:26.569043 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:29:26.569044 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:29:26.570116 (+ 1072us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:29:26.570119 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:29:26.570543 (+ 424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:29:26.570544 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:29:26.570685 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:26.571262 (+ 577us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:29:26.571271 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:29:26.572954 (+ 1683us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:29:26.574705 (+ 1751us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:29:26.574712 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:29:26.574714 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:29:26.574941 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:29:26.575180 (+ 239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:29:26.575181 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:29:26.575181 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:29:26.575288 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:29:26.575637 (+ 349us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:29:26.575644 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:29:26.575769 (+ 125us) client_negotiation.cc:769] Sending connection context
0810 15:29:26.575890 (+ 121us) client_negotiation.cc:240] Negotiation successful
0810 15:29:26.576019 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":115,"threads_started":1}
I20260810 15:29:26.576932 16913 heartbeater.cc:347] Connected to a master server at 127.18.68.190:39879
I20260810 15:29:26.577037 16913 heartbeater.cc:464] Registering TS with master...
I20260810 15:29:26.577278 16913 heartbeater.cc:511] Master 127.18.68.190:39879 requested a full tablet report, sending...
I20260810 15:29:26.577767 16095 ts_manager.cc:194] Registered new tserver with Master: feb436396f72499caee0ecdb01e44bf7 (127.18.68.131:37547)
I20260810 15:29:26.578397 16095 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.68.131@KRBTEST.COM'} at 127.18.68.131:56343
I20260810 15:29:26.578608 18706 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 15:29:26.586694 16191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:26.580203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50066 (local address 127.18.68.190:39879)
0810 15:29:26.580249 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0810 15:29:26.580251 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:29:26.580391 (+ 140us) server_negotiation.cc:407] Connection header received
0810 15:29:26.580430 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:29:26.580431 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:29:26.580440 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:29:26.580491 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:29:26.581065 (+ 574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:26.581551 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:26.582430 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:26.582637 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:26.582702 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:26.583987 (+ 1285us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:29:26.583988 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:29:26.583988 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:29:26.583994 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:29:26.585381 (+ 1387us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:29:26.585769 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:29:26.585770 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:29:26.585771 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:29:26.585831 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:29:26.586047 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:29:26.586048 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:29:26.586048 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:29:26.586283 (+ 235us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:29:26.586372 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0810 15:29:26.586498 (+ 126us) server_negotiation.cc:299] Negotiation successful
0810 15:29:26.586575 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260810 15:29:26.588495 16095 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50066:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 15:29:26.590046 16095 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 15:29:26.596764 16930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:26.592465 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.130:39397 (local address 127.0.0.1:47704)
0810 15:29:26.592624 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:26.592635 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 15:29:26.592693 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:29:26.593446 (+ 753us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:29:26.593447 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:29:26.593448 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:29:26.593490 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:29:26.593492 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:29:26.594884 (+ 1392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:29:26.594885 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:29:26.595801 (+ 916us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:29:26.595804 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:29:26.596471 (+ 667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:29:26.596472 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:29:26.596559 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:26.596573 (+ 14us) client_negotiation.cc:769] Sending connection context
0810 15:29:26.596639 (+ 66us) client_negotiation.cc:240] Negotiation successful
0810 15:29:26.596689 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":96,"threads_started":1}
I20260810 15:29:26.596776 16934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:26.592950 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47704 (local address 127.18.68.130:39397)
0810 15:29:26.593184 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0810 15:29:26.593190 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 15:29:26.593203 (+ 13us) server_negotiation.cc:407] Connection header received
0810 15:29:26.593254 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:29:26.593256 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:29:26.593273 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:29:26.593362 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:29:26.593580 (+ 218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:26.594773 (+ 1193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:26.595893 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:26.596383 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:26.596471 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:26.596538 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0810 15:29:26.596651 (+ 113us) server_negotiation.cc:299] Negotiation successful
0810 15:29:26.596691 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134,"thread_start_us":98,"threads_started":1}
I20260810 15:29:26.597196 16926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:26.592461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.129:40877 (local address 127.0.0.1:54936)
0810 15:29:26.592571 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:26.592612 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0810 15:29:26.592693 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:29:26.593389 (+ 696us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:29:26.593390 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:29:26.593392 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:29:26.593437 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:29:26.593439 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:29:26.594452 (+ 1013us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:29:26.594453 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:29:26.595835 (+ 1382us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:29:26.595838 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:29:26.596939 (+ 1101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:29:26.596940 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:29:26.596998 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:26.597002 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 15:29:26.597086 (+ 84us) client_negotiation.cc:240] Negotiation successful
0810 15:29:26.597129 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":84,"mutex_wait_us":36,"thread_start_us":64,"threads_started":1}
I20260810 15:29:26.597260 16933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:26.592777 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54936 (local address 127.18.68.129:40877)
0810 15:29:26.593207 (+ 430us) server_negotiation.cc:206] Beginning negotiation
0810 15:29:26.593211 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 15:29:26.593222 (+ 11us) server_negotiation.cc:407] Connection header received
0810 15:29:26.593258 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:29:26.593259 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:29:26.593273 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:29:26.593517 (+ 244us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:29:26.593596 (+ 79us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:26.594353 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:26.595944 (+ 1591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:26.596812 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:26.596930 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:26.596992 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0810 15:29:26.597113 (+ 121us) server_negotiation.cc:299] Negotiation successful
0810 15:29:26.597157 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":365,"thread_start_us":78,"threads_started":1}
I20260810 15:29:26.597345 16931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:26.592465 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.131:37547 (local address 127.0.0.1:55648)
0810 15:29:26.592793 (+ 328us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:26.592801 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0810 15:29:26.592836 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:29:26.593075 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:29:26.593078 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:29:26.593081 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:29:26.593160 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:29:26.593162 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:29:26.594642 (+ 1480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:29:26.594643 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:29:26.595851 (+ 1208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:29:26.595853 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:29:26.597090 (+ 1237us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:29:26.597091 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:29:26.597161 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:26.597166 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 15:29:26.597221 (+ 55us) client_negotiation.cc:240] Negotiation successful
0810 15:29:26.597265 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":315,"mutex_wait_us":38,"thread_start_us":103,"threads_started":1}
I20260810 15:29:26.597844 16932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:26.592713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55648 (local address 127.18.68.131:37547)
0810 15:29:26.592902 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0810 15:29:26.592906 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 15:29:26.592915 (+ 9us) server_negotiation.cc:407] Connection header received
0810 15:29:26.592958 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:29:26.592960 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:29:26.592972 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:29:26.593063 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:29:26.593251 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:26.594491 (+ 1240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:26.595943 (+ 1452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:26.596812 (+ 869us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:26.596967 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:26.597021 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0810 15:29:26.597499 (+ 478us) server_negotiation.cc:299] Negotiation successful
0810 15:29:26.597543 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":101,"threads_started":1}
I20260810 15:29:26.598039 16313 tablet_service.cc:1467] Processing CreateTablet for tablet 5ffcd0ec418045fb85ad4889b31c68b6 (DEFAULT_TABLE table=test-table [id=8af5c521396c4e87b8d5596416cbee6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 15:29:26.598052 16547 tablet_service.cc:1467] Processing CreateTablet for tablet 5ffcd0ec418045fb85ad4889b31c68b6 (DEFAULT_TABLE table=test-table [id=8af5c521396c4e87b8d5596416cbee6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 15:29:26.598460 16313 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5ffcd0ec418045fb85ad4889b31c68b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:29:26.598464 16547 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5ffcd0ec418045fb85ad4889b31c68b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:29:26.598595 16785 tablet_service.cc:1467] Processing CreateTablet for tablet 5ffcd0ec418045fb85ad4889b31c68b6 (DEFAULT_TABLE table=test-table [id=8af5c521396c4e87b8d5596416cbee6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 15:29:26.598906 16785 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5ffcd0ec418045fb85ad4889b31c68b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:29:26.601429 16935 tablet_bootstrap.cc:492] T 5ffcd0ec418045fb85ad4889b31c68b6 P 6dbf5c73bea74b73b95fd23a70357465: Bootstrap starting.
I20260810 15:29:26.602015 16936 tablet_bootstrap.cc:492] T 5ffcd0ec418045fb85ad4889b31c68b6 P 0c29a81aac34492088d52604adcac4f7: Bootstrap starting.
I20260810 15:29:26.602311 16935 tablet_bootstrap.cc:654] T 5ffcd0ec418045fb85ad4889b31c68b6 P 6dbf5c73bea74b73b95fd23a70357465: Neither blocks nor log segments found. Creating new log.
I20260810 15:29:26.602347 16937 tablet_bootstrap.cc:492] T 5ffcd0ec418045fb85ad4889b31c68b6 P feb436396f72499caee0ecdb01e44bf7: Bootstrap starting.
I20260810 15:29:26.602823 16936 tablet_bootstrap.cc:654] T 5ffcd0ec418045fb85ad4889b31c68b6 P 0c29a81aac34492088d52604adcac4f7: Neither blocks nor log segments found. Creating new log.
I20260810 15:29:26.602936 16937 tablet_bootstrap.cc:654] T 5ffcd0ec418045fb85ad4889b31c68b6 P feb436396f72499caee0ecdb01e44bf7: Neither blocks nor log segments found. Creating new log.
I20260810 15:29:26.603061 16935 log.cc:824] T 5ffcd0ec418045fb85ad4889b31c68b6 P 6dbf5c73bea74b73b95fd23a70357465: Log is configured to *not* fsync() on all Append() calls
I20260810 15:29:26.603415 16936 log.cc:824] T 5ffcd0ec418045fb85ad4889b31c68b6 P 0c29a81aac34492088d52604adcac4f7: Log is configured to *not* fsync() on all Append() calls
I20260810 15:29:26.603549 16937 log.cc:824] T 5ffcd0ec418045fb85ad4889b31c68b6 P feb436396f72499caee0ecdb01e44bf7: Log is configured to *not* fsync() on all Append() calls
I20260810 15:29:26.603986 16935 tablet_bootstrap.cc:492] T 5ffcd0ec418045fb85ad4889b31c68b6 P 6dbf5c73bea74b73b95fd23a70357465: No bootstrap required, opened a new log
I20260810 15:29:26.604060 16935 ts_tablet_manager.cc:1397] T 5ffcd0ec418045fb85ad4889b31c68b6 P 6dbf5c73bea74b73b95fd23a70357465: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260810 15:29:26.604367 16937 tablet_bootstrap.cc:492] T 5ffcd0ec418045fb85ad4889b31c68b6 P feb436396f72499caee0ecdb01e44bf7: No bootstrap required, opened a new log
I20260810 15:29:26.604439 16937 ts_tablet_manager.cc:1397] T 5ffcd0ec418045fb85ad4889b31c68b6 P feb436396f72499caee0ecdb01e44bf7: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 15:29:26.606168 16935 raft_consensus.cc:348] T 5ffcd0ec418045fb85ad4889b31c68b6 P 6dbf5c73bea74b73b95fd23a70357465 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "feb436396f72499caee0ecdb01e44bf7" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37547 } } peers { permanent_uuid: "6dbf5c73bea74b73b95fd23a70357465" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 40877 } } peers { permanent_uuid: "0c29a81aac34492088d52604adcac4f7" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 39397 } }
I20260810 15:29:26.606374 16935 raft_consensus.cc:374] T 5ffcd0ec418045fb85ad4889b31c68b6 P 6dbf5c73bea74b73b95fd23a70357465 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:29:26.606416 16935 raft_consensus.cc:729] T 5ffcd0ec418045fb85ad4889b31c68b6 P 6dbf5c73bea74b73b95fd23a70357465 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6dbf5c73bea74b73b95fd23a70357465, State: Initialized, Role: FOLLOWER
I20260810 15:29:26.606580 16935 consensus_queue.cc:260] T 5ffcd0ec418045fb85ad4889b31c68b6 P 6dbf5c73bea74b73b95fd23a70357465 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "feb436396f72499caee0ecdb01e44bf7" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37547 } } peers { permanent_uuid: "6dbf5c73bea74b73b95fd23a70357465" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 40877 } } peers { permanent_uuid: "0c29a81aac34492088d52604adcac4f7" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 39397 } }
I20260810 15:29:26.606513 16937 raft_consensus.cc:348] T 5ffcd0ec418045fb85ad4889b31c68b6 P feb436396f72499caee0ecdb01e44bf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "feb436396f72499caee0ecdb01e44bf7" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37547 } } peers { permanent_uuid: "6dbf5c73bea74b73b95fd23a70357465" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 40877 } } peers { permanent_uuid: "0c29a81aac34492088d52604adcac4f7" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 39397 } }
I20260810 15:29:26.606667 16937 raft_consensus.cc:374] T 5ffcd0ec418045fb85ad4889b31c68b6 P feb436396f72499caee0ecdb01e44bf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:29:26.606707 16937 raft_consensus.cc:729] T 5ffcd0ec418045fb85ad4889b31c68b6 P feb436396f72499caee0ecdb01e44bf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: feb436396f72499caee0ecdb01e44bf7, State: Initialized, Role: FOLLOWER
I20260810 15:29:26.606761 16936 tablet_bootstrap.cc:492] T 5ffcd0ec418045fb85ad4889b31c68b6 P 0c29a81aac34492088d52604adcac4f7: No bootstrap required, opened a new log
I20260810 15:29:26.606849 16936 ts_tablet_manager.cc:1397] T 5ffcd0ec418045fb85ad4889b31c68b6 P 0c29a81aac34492088d52604adcac4f7: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260810 15:29:26.606858 16937 consensus_queue.cc:260] T 5ffcd0ec418045fb85ad4889b31c68b6 P feb436396f72499caee0ecdb01e44bf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "feb436396f72499caee0ecdb01e44bf7" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37547 } } peers { permanent_uuid: "6dbf5c73bea74b73b95fd23a70357465" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 40877 } } peers { permanent_uuid: "0c29a81aac34492088d52604adcac4f7" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 39397 } }
I20260810 15:29:26.606968 16424 heartbeater.cc:503] Master 127.18.68.190:39879 was elected leader, sending a full tablet report...
I20260810 15:29:26.607188 16937 ts_tablet_manager.cc:1428] T 5ffcd0ec418045fb85ad4889b31c68b6 P feb436396f72499caee0ecdb01e44bf7: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 15:29:26.607266 16913 heartbeater.cc:503] Master 127.18.68.190:39879 was elected leader, sending a full tablet report...
I20260810 15:29:26.606956 16935 ts_tablet_manager.cc:1428] T 5ffcd0ec418045fb85ad4889b31c68b6 P 6dbf5c73bea74b73b95fd23a70357465: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260810 15:29:26.608944 16936 raft_consensus.cc:348] T 5ffcd0ec418045fb85ad4889b31c68b6 P 0c29a81aac34492088d52604adcac4f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "feb436396f72499caee0ecdb01e44bf7" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37547 } } peers { permanent_uuid: "6dbf5c73bea74b73b95fd23a70357465" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 40877 } } peers { permanent_uuid: "0c29a81aac34492088d52604adcac4f7" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 39397 } }
I20260810 15:29:26.609089 16936 raft_consensus.cc:374] T 5ffcd0ec418045fb85ad4889b31c68b6 P 0c29a81aac34492088d52604adcac4f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:29:26.609118 16936 raft_consensus.cc:729] T 5ffcd0ec418045fb85ad4889b31c68b6 P 0c29a81aac34492088d52604adcac4f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c29a81aac34492088d52604adcac4f7, State: Initialized, Role: FOLLOWER
I20260810 15:29:26.609251 16936 consensus_queue.cc:260] T 5ffcd0ec418045fb85ad4889b31c68b6 P 0c29a81aac34492088d52604adcac4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "feb436396f72499caee0ecdb01e44bf7" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37547 } } peers { permanent_uuid: "6dbf5c73bea74b73b95fd23a70357465" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 40877 } } peers { permanent_uuid: "0c29a81aac34492088d52604adcac4f7" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 39397 } }
I20260810 15:29:26.609506 16936 ts_tablet_manager.cc:1428] T 5ffcd0ec418045fb85ad4889b31c68b6 P 0c29a81aac34492088d52604adcac4f7: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 15:29:26.609584 16668 heartbeater.cc:503] Master 127.18.68.190:39879 was elected leader, sending a full tablet report...
W20260810 15:29:26.638895 16671 tablet.cc:2369] T 5ffcd0ec418045fb85ad4889b31c68b6 P 0c29a81aac34492088d52604adcac4f7: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 15:29:26.732628 16426 tablet.cc:2369] T 5ffcd0ec418045fb85ad4889b31c68b6 P 6dbf5c73bea74b73b95fd23a70357465: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 15:29:26.768642 16947 raft_consensus.cc:482] T 5ffcd0ec418045fb85ad4889b31c68b6 P feb436396f72499caee0ecdb01e44bf7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 15:29:26.768777 16947 raft_consensus.cc:504] T 5ffcd0ec418045fb85ad4889b31c68b6 P feb436396f72499caee0ecdb01e44bf7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "feb436396f72499caee0ecdb01e44bf7" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37547 } } peers { permanent_uuid: "6dbf5c73bea74b73b95fd23a70357465" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 40877 } } peers { permanent_uuid: "0c29a81aac34492088d52604adcac4f7" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 39397 } }
I20260810 15:29:26.769127 16947 leader_election.cc:288] T 5ffcd0ec418045fb85ad4889b31c68b6 P feb436396f72499caee0ecdb01e44bf7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6dbf5c73bea74b73b95fd23a70357465 (127.18.68.129:40877), 0c29a81aac34492088d52604adcac4f7 (127.18.68.130:39397)
I20260810 15:29:26.773296 16933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:26.769469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.131:43467 (local address 127.18.68.129:40877)
0810 15:29:26.769519 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0810 15:29:26.769521 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:29:26.769883 (+ 362us) server_negotiation.cc:407] Connection header received
0810 15:29:26.769981 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:29:26.769982 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:29:26.769994 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:29:26.770095 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:29:26.770256 (+ 161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:26.770930 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:26.772205 (+ 1275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:26.772820 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:26.772901 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:26.772910 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0810 15:29:26.773171 (+ 261us) server_negotiation.cc:299] Negotiation successful
0810 15:29:26.773235 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260810 15:29:26.773288 16934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:26.769452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.131:56663 (local address 127.18.68.130:39397)
0810 15:29:26.769530 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0810 15:29:26.769533 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 15:29:26.769546 (+ 13us) server_negotiation.cc:407] Connection header received
0810 15:29:26.769607 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:29:26.769608 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:29:26.769619 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:29:26.769675 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:29:26.769956 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:26.770786 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:26.772205 (+ 1419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:26.772823 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:26.772901 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:26.772910 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0810 15:29:26.773170 (+ 260us) server_negotiation.cc:299] Negotiation successful
0810 15:29:26.773215 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260810 15:29:26.773294 16916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:26.769366 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.130:39397 (local address 127.18.68.131:56663)
0810 15:29:26.769429 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:26.769441 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 15:29:26.769518 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:29:26.769696 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:29:26.769697 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:29:26.769699 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:29:26.769803 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:29:26.769805 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:29:26.770881 (+ 1076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:29:26.770881 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:29:26.772104 (+ 1223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:29:26.772108 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:29:26.772933 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:29:26.772935 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:29:26.773035 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:26.773036 (+ 1us) client_negotiation.cc:769] Sending connection context
0810 15:29:26.773111 (+ 75us) client_negotiation.cc:240] Negotiation successful
0810 15:29:26.773186 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40,"mutex_wait_us":5}
I20260810 15:29:26.773303 16949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:26.769375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.129:40877 (local address 127.18.68.131:43467)
0810 15:29:26.769792 (+ 417us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:26.769803 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 15:29:26.769874 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:29:26.770102 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:29:26.770103 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:29:26.770105 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:29:26.770180 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:29:26.770181 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:29:26.770998 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:29:26.770998 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:29:26.772123 (+ 1125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:29:26.772125 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:29:26.772939 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:29:26.772940 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:29:26.773030 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:26.773035 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 15:29:26.773111 (+ 76us) client_negotiation.cc:240] Negotiation successful
0810 15:29:26.773184 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":395,"mutex_wait_us":227,"thread_start_us":136,"threads_started":1}
I20260810 15:29:26.773756 16580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ffcd0ec418045fb85ad4889b31c68b6" candidate_uuid: "feb436396f72499caee0ecdb01e44bf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c29a81aac34492088d52604adcac4f7" is_pre_election: true
I20260810 15:29:26.773931 16580 raft_consensus.cc:2454] T 5ffcd0ec418045fb85ad4889b31c68b6 P 0c29a81aac34492088d52604adcac4f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate feb436396f72499caee0ecdb01e44bf7 in term 0.
I20260810 15:29:26.774216 16714 leader_election.cc:302] T 5ffcd0ec418045fb85ad4889b31c68b6 P feb436396f72499caee0ecdb01e44bf7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c29a81aac34492088d52604adcac4f7, feb436396f72499caee0ecdb01e44bf7; no voters:
I20260810 15:29:26.774390 16947 raft_consensus.cc:2781] T 5ffcd0ec418045fb85ad4889b31c68b6 P feb436396f72499caee0ecdb01e44bf7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 15:29:26.774452 16947 raft_consensus.cc:482] T 5ffcd0ec418045fb85ad4889b31c68b6 P feb436396f72499caee0ecdb01e44bf7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 15:29:26.774397 16348 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ffcd0ec418045fb85ad4889b31c68b6" candidate_uuid: "feb436396f72499caee0ecdb01e44bf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6dbf5c73bea74b73b95fd23a70357465" is_pre_election: true
I20260810 15:29:26.774489 16947 raft_consensus.cc:3037] T 5ffcd0ec418045fb85ad4889b31c68b6 P feb436396f72499caee0ecdb01e44bf7 [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:29:26.774577 16348 raft_consensus.cc:2454] T 5ffcd0ec418045fb85ad4889b31c68b6 P 6dbf5c73bea74b73b95fd23a70357465 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate feb436396f72499caee0ecdb01e44bf7 in term 0.
I20260810 15:29:26.775497 16947 raft_consensus.cc:504] T 5ffcd0ec418045fb85ad4889b31c68b6 P feb436396f72499caee0ecdb01e44bf7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "feb436396f72499caee0ecdb01e44bf7" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37547 } } peers { permanent_uuid: "6dbf5c73bea74b73b95fd23a70357465" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 40877 } } peers { permanent_uuid: "0c29a81aac34492088d52604adcac4f7" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 39397 } }
I20260810 15:29:26.775664 16947 leader_election.cc:288] T 5ffcd0ec418045fb85ad4889b31c68b6 P feb436396f72499caee0ecdb01e44bf7 [CANDIDATE]: Term 1 election: Requested vote from peers 6dbf5c73bea74b73b95fd23a70357465 (127.18.68.129:40877), 0c29a81aac34492088d52604adcac4f7 (127.18.68.130:39397)
I20260810 15:29:26.775838 16348 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ffcd0ec418045fb85ad4889b31c68b6" candidate_uuid: "feb436396f72499caee0ecdb01e44bf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6dbf5c73bea74b73b95fd23a70357465"
I20260810 15:29:26.775866 16580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ffcd0ec418045fb85ad4889b31c68b6" candidate_uuid: "feb436396f72499caee0ecdb01e44bf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c29a81aac34492088d52604adcac4f7"
I20260810 15:29:26.775946 16348 raft_consensus.cc:3037] T 5ffcd0ec418045fb85ad4889b31c68b6 P 6dbf5c73bea74b73b95fd23a70357465 [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:29:26.775949 16580 raft_consensus.cc:3037] T 5ffcd0ec418045fb85ad4889b31c68b6 P 0c29a81aac34492088d52604adcac4f7 [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:29:26.776708 16348 raft_consensus.cc:2454] T 5ffcd0ec418045fb85ad4889b31c68b6 P 6dbf5c73bea74b73b95fd23a70357465 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate feb436396f72499caee0ecdb01e44bf7 in term 1.
I20260810 15:29:26.776819 16580 raft_consensus.cc:2454] T 5ffcd0ec418045fb85ad4889b31c68b6 P 0c29a81aac34492088d52604adcac4f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate feb436396f72499caee0ecdb01e44bf7 in term 1.
I20260810 15:29:26.777034 16714 leader_election.cc:302] T 5ffcd0ec418045fb85ad4889b31c68b6 P feb436396f72499caee0ecdb01e44bf7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c29a81aac34492088d52604adcac4f7, feb436396f72499caee0ecdb01e44bf7; no voters:
I20260810 15:29:26.777185 16947 raft_consensus.cc:2781] T 5ffcd0ec418045fb85ad4889b31c68b6 P feb436396f72499caee0ecdb01e44bf7 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 15:29:26.777397 16947 raft_consensus.cc:686] T 5ffcd0ec418045fb85ad4889b31c68b6 P feb436396f72499caee0ecdb01e44bf7 [term 1 LEADER]: Becoming Leader. State: Replica: feb436396f72499caee0ecdb01e44bf7, State: Running, Role: LEADER
I20260810 15:29:26.777520 16947 consensus_queue.cc:237] T 5ffcd0ec418045fb85ad4889b31c68b6 P feb436396f72499caee0ecdb01e44bf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "feb436396f72499caee0ecdb01e44bf7" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37547 } } peers { permanent_uuid: "6dbf5c73bea74b73b95fd23a70357465" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 40877 } } peers { permanent_uuid: "0c29a81aac34492088d52604adcac4f7" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 39397 } }
I20260810 15:29:26.778496 16091 catalog_manager.cc:5495] T 5ffcd0ec418045fb85ad4889b31c68b6 P feb436396f72499caee0ecdb01e44bf7 reported cstate change: term changed from 0 to 1, leader changed from <none> to feb436396f72499caee0ecdb01e44bf7 (127.18.68.131). New cstate: current_term: 1 leader_uuid: "feb436396f72499caee0ecdb01e44bf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "feb436396f72499caee0ecdb01e44bf7" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6dbf5c73bea74b73b95fd23a70357465" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 40877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c29a81aac34492088d52604adcac4f7" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 39397 } health_report { overall_health: UNKNOWN } } }
W20260810 15:29:26.816217 16914 tablet.cc:2369] T 5ffcd0ec418045fb85ad4889b31c68b6 P feb436396f72499caee0ecdb01e44bf7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 15:29:26.825116 16932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:26.822482 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55652 (local address 127.18.68.131:37547)
0810 15:29:26.822591 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0810 15:29:26.822593 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:29:26.822602 (+ 9us) server_negotiation.cc:407] Connection header received
0810 15:29:26.822644 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:29:26.822645 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:29:26.822665 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:29:26.822745 (+ 80us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 15:29:26.823035 (+ 290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:26.823518 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:26.824290 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:26.824519 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:26.824595 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:26.824776 (+ 181us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 15:29:26.824900 (+ 124us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 15:29:26.824975 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0810 15:29:26.825026 (+ 51us) server_negotiation.cc:299] Negotiation successful
0810 15:29:26.825051 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260810 15:29:26.827186 16580 raft_consensus.cc:1261] T 5ffcd0ec418045fb85ad4889b31c68b6 P 0c29a81aac34492088d52604adcac4f7 [term 1 FOLLOWER]: Refusing update from remote peer feb436396f72499caee0ecdb01e44bf7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 15:29:26.827235 16348 raft_consensus.cc:1261] T 5ffcd0ec418045fb85ad4889b31c68b6 P 6dbf5c73bea74b73b95fd23a70357465 [term 1 FOLLOWER]: Refusing update from remote peer feb436396f72499caee0ecdb01e44bf7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 15:29:26.827570 16947 consensus_queue.cc:1035] T 5ffcd0ec418045fb85ad4889b31c68b6 P feb436396f72499caee0ecdb01e44bf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c29a81aac34492088d52604adcac4f7" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 39397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 15:29:26.827730 16952 consensus_queue.cc:1035] T 5ffcd0ec418045fb85ad4889b31c68b6 P feb436396f72499caee0ecdb01e44bf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6dbf5c73bea74b73b95fd23a70357465" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 40877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 15:29:26.830250 16959 mvcc.cc:205] Tried to move back new op lower bound from 7316995140921016320 to 7316995140721442816. Current Snapshot: MvccSnapshot[applied={T|T < 7316995140921016320}]
I20260810 15:29:26.830296 16961 mvcc.cc:205] Tried to move back new op lower bound from 7316995140921016320 to 7316995140721442816. Current Snapshot: MvccSnapshot[applied={T|T < 7316995140921016320}]
I20260810 15:29:26.830739 16960 mvcc.cc:205] Tried to move back new op lower bound from 7316995140921016320 to 7316995140721442816. Current Snapshot: MvccSnapshot[applied={T|T < 7316995140921016320}]
I20260810 15:29:26.832872 16090 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50066:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 15:29:26.832964 16090 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50066:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 15:29:26.833854 16090 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0191c87ecd4b4b5a8dfb1c943df40418: Sending DeleteTablet for 3 replicas of tablet 5ffcd0ec418045fb85ad4889b31c68b6
I20260810 15:29:26.834288 16785 tablet_service.cc:1514] Processing DeleteTablet for tablet 5ffcd0ec418045fb85ad4889b31c68b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 15:29:26 UTC) from {username='kudu', principal='kudu/127.18.68.190@KRBTEST.COM'} at 127.0.0.1:55648
I20260810 15:29:26.834321 16547 tablet_service.cc:1514] Processing DeleteTablet for tablet 5ffcd0ec418045fb85ad4889b31c68b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 15:29:26 UTC) from {username='kudu', principal='kudu/127.18.68.190@KRBTEST.COM'} at 127.0.0.1:47704
I20260810 15:29:26.834594 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 16203
I20260810 15:29:26.834663 16313 tablet_service.cc:1514] Processing DeleteTablet for tablet 5ffcd0ec418045fb85ad4889b31c68b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 15:29:26 UTC) from {username='kudu', principal='kudu/127.18.68.190@KRBTEST.COM'} at 127.0.0.1:54936
I20260810 15:29:26.837803 16972 tablet_replica.cc:330] T 5ffcd0ec418045fb85ad4889b31c68b6 P feb436396f72499caee0ecdb01e44bf7: stopping tablet replica
I20260810 15:29:26.837917 16972 raft_consensus.cc:2229] T 5ffcd0ec418045fb85ad4889b31c68b6 P feb436396f72499caee0ecdb01e44bf7 [term 1 LEADER]: Raft consensus shutting down.
I20260810 15:29:26.838078 16972 raft_consensus.cc:2258] T 5ffcd0ec418045fb85ad4889b31c68b6 P feb436396f72499caee0ecdb01e44bf7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 15:29:26.838266 16971 tablet_replica.cc:330] T 5ffcd0ec418045fb85ad4889b31c68b6 P 0c29a81aac34492088d52604adcac4f7: stopping tablet replica
I20260810 15:29:26.838388 16971 raft_consensus.cc:2229] T 5ffcd0ec418045fb85ad4889b31c68b6 P 0c29a81aac34492088d52604adcac4f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 15:29:26.838522 16971 raft_consensus.cc:2258] T 5ffcd0ec418045fb85ad4889b31c68b6 P 0c29a81aac34492088d52604adcac4f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 15:29:26.840708 16972 ts_tablet_manager.cc:1905] T 5ffcd0ec418045fb85ad4889b31c68b6 P feb436396f72499caee0ecdb01e44bf7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 15:29:26.843118 16972 ts_tablet_manager.cc:1918] T 5ffcd0ec418045fb85ad4889b31c68b6 P feb436396f72499caee0ecdb01e44bf7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 15:29:26.843212 16972 log.cc:1196] T 5ffcd0ec418045fb85ad4889b31c68b6 P feb436396f72499caee0ecdb01e44bf7: Deleting WAL directory at /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786375520124696-18706-0/minicluster-data/ts-2/wal/wals/5ffcd0ec418045fb85ad4889b31c68b6
I20260810 15:29:26.843611 16972 ts_tablet_manager.cc:1939] T 5ffcd0ec418045fb85ad4889b31c68b6 P feb436396f72499caee0ecdb01e44bf7: Deleting consensus metadata
I20260810 15:29:26.844128 16061 catalog_manager.cc:4841] TS feb436396f72499caee0ecdb01e44bf7 (127.18.68.131:37547): tablet 5ffcd0ec418045fb85ad4889b31c68b6 (table test-table [id=8af5c521396c4e87b8d5596416cbee6e]) successfully deleted
W20260810 15:29:26.847918 16064 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.18.68.129:40877 (error 108)
I20260810 15:29:26.848229 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 16436
I20260810 15:29:26.866701 16930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:26.866499 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.129:40877 (local address 127.0.0.1:54950)
0810 15:29:26.866577 (+ 78us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:26.866641 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.129:40877: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260810 15:29:26.866943 16064 catalog_manager.cc:4584] TS 6dbf5c73bea74b73b95fd23a70357465 (127.18.68.129:40877): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 5ffcd0ec418045fb85ad4889b31c68b6: Network error: Client connection negotiation failed: client connection to 127.18.68.129:40877: connect: Connection refused (error 111)
I20260810 15:29:26.870545 16930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:26.870401 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.130:39397 (local address 127.0.0.1:47718)
0810 15:29:26.870465 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:26.870500 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.130:39397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260810 15:29:26.870577 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 16679
I20260810 15:29:26.883306 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 16036
2026-08-10T15:29:26Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2390 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-10T15:29:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T15:29:26Z Disabled control of system clock
I20260810 15:29:26.917594 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786375520124696-18706-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786375520124696-18706-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786375520124696-18706-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.190:36327
--webserver_interface=127.18.68.190
--webserver_port=0
--builtin_ntp_servers=127.18.68.148:32819
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.68.190:36327
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260810 15:29:27.005107 16978 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:29:27.005339 16978 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:29:27.005362 16978 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:29:27.006579 16978 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 15:29:27.006623 16978 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:29:27.006636 16978 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:29:27.006649 16978 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 15:29:27.006668 16978 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 15:29:27.008066 16978 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:32819
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786375520124696-18706-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786375520124696-18706-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.68.190:36327
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.190:36327
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.68.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16978
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786375520124696-18706-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:29:27.008339 16978 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:29:27.008663 16978 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:29:27.013754 16992 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:29:27.013724 16991 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:29:27.013952 16978 server_base.cc:1034] running on GCE node
W20260810 15:29:27.013715 16999 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:29:27.014464 16978 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:29:27.014838 16978 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:29:27.016088 16978 hybrid_clock.cc:648] HybridClock initialized: now 1786375767016050 us; error 39 us; skew 500 ppm
I20260810 15:29:27.017395 16978 webserver.cc:460] Webserver started at http://127.18.68.190:39895/ using document root <none> and password file <none>
I20260810 15:29:27.017675 16978 fs_manager.cc:359] Metadata directory not provided
I20260810 15:29:27.017759 16978 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:29:27.017917 16978 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:29:27.019114 16978 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786375520124696-18706-0/minicluster-data/master-0/data/instance:
uuid: "b5bf34b5f2664243bf522ce119deae5b"
format_stamp: "Formatted at 2026-08-10 15:29:27 on dist-test-slave-2p8l"
server_key: "f9798d9a948e58ba1a83393a3b7ccead"
server_key_iv: "75757598172e4b48254dfc937d0142dc"
server_key_version: "encryptionkey@0"
I20260810 15:29:27.019484 16978 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786375520124696-18706-0/minicluster-data/master-0/wal/instance:
uuid: "b5bf34b5f2664243bf522ce119deae5b"
format_stamp: "Formatted at 2026-08-10 15:29:27 on dist-test-slave-2p8l"
server_key: "f9798d9a948e58ba1a83393a3b7ccead"
server_key_iv: "75757598172e4b48254dfc937d0142dc"
server_key_version: "encryptionkey@0"
I20260810 15:29:27.020807 16978 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 15:29:27.021625 17010 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:29:27.021842 16978 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:29:27.021945 16978 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786375520124696-18706-0/minicluster-data/master-0/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786375520124696-18706-0/minicluster-data/master-0/wal
uuid: "b5bf34b5f2664243bf522ce119deae5b"
format_stamp: "Formatted at 2026-08-10 15:29:27 on dist-test-slave-2p8l"
server_key: "f9798d9a948e58ba1a83393a3b7ccead"
server_key_iv: "75757598172e4b48254dfc937d0142dc"
server_key_version: "encryptionkey@0"
I20260810 15:29:27.022033 16978 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786375520124696-18706-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786375520124696-18706-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786375520124696-18706-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:29:27.034677 16978 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:29:27.035025 16978 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:29:27.035211 16978 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:29:27.039790 16978 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.190:36327
I20260810 15:29:27.039822 17099 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.190:36327 every 8 connection(s)
I20260810 15:29:27.040207 16978 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
I20260810 15:29:27.041251 17101 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:29:27.042313 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 16978
I20260810 15:29:27.042457 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786375520124696-18706-0/minicluster-data/master-0/wal/instance
I20260810 15:29:27.042656 18706 external_mini_cluster.cc:1428] Setting key d353a7b0bea4729030a913101156e487
I20260810 15:29:27.044026 17101 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b5bf34b5f2664243bf522ce119deae5b: Bootstrap starting.
I20260810 15:29:27.044668 17101 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b5bf34b5f2664243bf522ce119deae5b: Neither blocks nor log segments found. Creating new log.
I20260810 15:29:27.044981 17101 log.cc:824] T 00000000000000000000000000000000 P b5bf34b5f2664243bf522ce119deae5b: Log is configured to *not* fsync() on all Append() calls
I20260810 15:29:27.045750 17101 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b5bf34b5f2664243bf522ce119deae5b: No bootstrap required, opened a new log
I20260810 15:29:27.048257 17101 raft_consensus.cc:348] T 00000000000000000000000000000000 P b5bf34b5f2664243bf522ce119deae5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5bf34b5f2664243bf522ce119deae5b" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 36327 } }
I20260810 15:29:27.048444 17101 raft_consensus.cc:374] T 00000000000000000000000000000000 P b5bf34b5f2664243bf522ce119deae5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:29:27.048489 17101 raft_consensus.cc:729] T 00000000000000000000000000000000 P b5bf34b5f2664243bf522ce119deae5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5bf34b5f2664243bf522ce119deae5b, State: Initialized, Role: FOLLOWER
I20260810 15:29:27.048657 17101 consensus_queue.cc:260] T 00000000000000000000000000000000 P b5bf34b5f2664243bf522ce119deae5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5bf34b5f2664243bf522ce119deae5b" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 36327 } }
I20260810 15:29:27.048765 17101 raft_consensus.cc:388] T 00000000000000000000000000000000 P b5bf34b5f2664243bf522ce119deae5b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 15:29:27.048805 17101 raft_consensus.cc:482] T 00000000000000000000000000000000 P b5bf34b5f2664243bf522ce119deae5b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 15:29:27.048849 17101 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b5bf34b5f2664243bf522ce119deae5b [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:29:27.049614 17105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:27.043276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45296 (local address 127.18.68.190:36327)
0810 15:29:27.043513 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0810 15:29:27.043522 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 15:29:27.043548 (+ 26us) server_negotiation.cc:407] Connection header received
0810 15:29:27.043976 (+ 428us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:29:27.043983 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:29:27.044045 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:29:27.044239 (+ 194us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:29:27.044473 (+ 234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:27.045764 (+ 1291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:27.046984 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:27.047610 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:27.047765 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:27.048614 (+ 849us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:29:27.048618 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:29:27.048619 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 15:29:27.048872 (+ 253us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:29:27.048922 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 15:29:27.048939 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:29:27.049017 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0810 15:29:27.049118 (+ 101us) server_negotiation.cc:299] Negotiation successful
0810 15:29:27.049341 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":86,"threads_started":1}
I20260810 15:29:27.049661 17101 raft_consensus.cc:504] T 00000000000000000000000000000000 P b5bf34b5f2664243bf522ce119deae5b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5bf34b5f2664243bf522ce119deae5b" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 36327 } }
I20260810 15:29:27.049783 17101 leader_election.cc:302] T 00000000000000000000000000000000 P b5bf34b5f2664243bf522ce119deae5b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b5bf34b5f2664243bf522ce119deae5b; no voters:
I20260810 15:29:27.049933 17101 leader_election.cc:288] T 00000000000000000000000000000000 P b5bf34b5f2664243bf522ce119deae5b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 15:29:27.050127 17109 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b5bf34b5f2664243bf522ce119deae5b [term 1 FOLLOWER]: Leader election won for term 1
I20260810 15:29:27.050217 17101 sys_catalog.cc:564] T 00000000000000000000000000000000 P b5bf34b5f2664243bf522ce119deae5b [sys.catalog]: configured and running, proceeding with master startup.
I20260810 15:29:27.050338 17109 raft_consensus.cc:686] T 00000000000000000000000000000000 P b5bf34b5f2664243bf522ce119deae5b [term 1 LEADER]: Becoming Leader. State: Replica: b5bf34b5f2664243bf522ce119deae5b, State: Running, Role: LEADER
I20260810 15:29:27.050480 17109 consensus_queue.cc:237] T 00000000000000000000000000000000 P b5bf34b5f2664243bf522ce119deae5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5bf34b5f2664243bf522ce119deae5b" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 36327 } }
I20260810 15:29:27.050813 17109 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5bf34b5f2664243bf522ce119deae5b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b5bf34b5f2664243bf522ce119deae5b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5bf34b5f2664243bf522ce119deae5b" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 36327 } } }
I20260810 15:29:27.050906 17109 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5bf34b5f2664243bf522ce119deae5b [sys.catalog]: This master's current role is: LEADER
I20260810 15:29:27.051043 17109 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5bf34b5f2664243bf522ce119deae5b [sys.catalog]: SysCatalogTable state changed. Reason: New leader b5bf34b5f2664243bf522ce119deae5b. Latest consensus state: current_term: 1 leader_uuid: "b5bf34b5f2664243bf522ce119deae5b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5bf34b5f2664243bf522ce119deae5b" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 36327 } } }
I20260810 15:29:27.051088 17109 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5bf34b5f2664243bf522ce119deae5b [sys.catalog]: This master's current role is: LEADER
I20260810 15:29:27.051223 17132 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 15:29:27.051759 17132 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 15:29:27.053485 17132 catalog_manager.cc:1347] Generated new cluster ID: 03fa4a350ddc4206bc34ab785cec053b
I20260810 15:29:27.053534 17132 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 15:29:27.063925 17132 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 15:29:27.064621 17132 catalog_manager.cc:1504] Loading token signing keys...
I20260810 15:29:27.071094 17132 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b5bf34b5f2664243bf522ce119deae5b: Generated new TSK 0
I20260810 15:29:27.071264 17132 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 15:29:27.078858 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786375520124696-18706-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786375520124696-18706-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786375520124696-18706-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786375520124696-18706-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.68.129:0
--local_ip_for_outbound_sockets=127.18.68.129
--webserver_interface=127.18.68.129
--webserver_port=0
--tserver_master_addrs=127.18.68.190:36327
--builtin_ntp_servers=127.18.68.148:32819
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260810 15:29:27.166285 17145 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:29:27.166520 17145 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:29:27.166555 17145 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:29:27.167730 17145 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:29:27.167794 17145 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:29:27.167837 17145 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.68.129
I20260810 15:29:27.169242 17145 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:32819
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786375520124696-18706-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786375520124696-18706-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.68.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786375520124696-18706-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.68.129
--webserver_port=0
--tserver_master_addrs=127.18.68.190:36327
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17145
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.68.129
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786375520124696-18706-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:29:27.169502 17145 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:29:27.169801 17145 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:29:27.175964 17157 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:29:27.175987 17145 server_base.cc:1034] running on GCE node
W20260810 15:29:27.175971 17155 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:29:27.176272 17160 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:29:27.176501 17145 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:29:27.176759 17145 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:29:27.177897 17145 hybrid_clock.cc:648] HybridClock initialized: now 1786375767177882 us; error 28 us; skew 500 ppm
I20260810 15:29:27.179466 17145 webserver.cc:460] Webserver started at http://127.18.68.129:41867/ using document root <none> and password file <none>
I20260810 15:29:27.179713 17145 fs_manager.cc:359] Metadata directory not provided
I20260810 15:29:27.179772 17145 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:29:27.179898 17145 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:29:27.181246 17145 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786375520124696-18706-0/minicluster-data/ts-0/data/instance:
uuid: "b15f54f934b346c6a0baf71f9743cfcf"
format_stamp: "Formatted at 2026-08-10 15:29:27 on dist-test-slave-2p8l"
server_key: "9ec1415ca9bc19f691f519ad4ff49d9e"
server_key_iv: "f8ee0e0f458ebafe780781ba7e64e3b8"
server_key_version: "encryptionkey@0"
I20260810 15:29:27.181661 17145 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786375520124696-18706-0/minicluster-data/ts-0/wal/instance:
uuid: "b15f54f934b346c6a0baf71f9743cfcf"
format_stamp: "Formatted at 2026-08-10 15:29:27 on dist-test-slave-2p8l"
server_key: "9ec1415ca9bc19f691f519ad4ff49d9e"
server_key_iv: "f8ee0e0f458ebafe780781ba7e64e3b8"
server_key_version: "encryptionkey@0"
I20260810 15:29:27.183215 17145 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 15:29:27.184018 17173 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:29:27.184230 17145 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 15:29:27.184315 17145 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786375520124696-18706-0/minicluster-data/ts-0/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786375520124696-18706-0/minicluster-data/ts-0/wal
uuid: "b15f54f934b346c6a0baf71f9743cfcf"
format_stamp: "Formatted at 2026-08-10 15:29:27 on dist-test-slave-2p8l"
server_key: "9ec1415ca9bc19f691f519ad4ff49d9e"
server_key_iv: "f8ee0e0f458ebafe780781ba7e64e3b8"
server_key_version: "encryptionkey@0"
I20260810 15:29:27.184371 17145 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786375520124696-18706-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786375520124696-18706-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786375520124696-18706-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:29:27.214237 17145 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:29:27.214573 17145 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:29:27.214695 17145 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:29:27.214920 17145 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 15:29:27.215227 17145 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 15:29:27.215262 17145 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 15:29:27.215288 17145 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 15:29:27.215307 17145 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 15:29:27.221807 17145 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.129:40397
I20260810 15:29:27.221879 17397 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.129:40397 every 8 connection(s)
I20260810 15:29:27.222306 17145 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786375520124696-18706-0/minicluster-data/ts-0/data/info.pb
I20260810 15:29:27.225499 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 17145
I20260810 15:29:27.225596 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786375520124696-18706-0/minicluster-data/ts-0/wal/instance
I20260810 15:29:27.225834 18706 external_mini_cluster.cc:1428] Setting key b4eb6b76839633dcbbdf338765deb7b4
I20260810 15:29:27.226925 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786375520124696-18706-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786375520124696-18706-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786375520124696-18706-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786375520124696-18706-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.68.130:0
--local_ip_for_outbound_sockets=127.18.68.130
--webserver_interface=127.18.68.130
--webserver_port=0
--tserver_master_addrs=127.18.68.190:36327
--builtin_ntp_servers=127.18.68.148:32819
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260810 15:29:27.228468 17105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:27.223138 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.129:42595 (local address 127.18.68.190:36327)
0810 15:29:27.223184 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0810 15:29:27.223186 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:29:27.223417 (+ 231us) server_negotiation.cc:407] Connection header received
0810 15:29:27.223966 (+ 549us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:29:27.223967 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:29:27.223985 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:29:27.224041 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:29:27.224805 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:27.225355 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:27.226676 (+ 1321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:27.226991 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:27.227075 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:27.228092 (+ 1017us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:29:27.228094 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:29:27.228094 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 15:29:27.228100 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:29:27.228119 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 15:29:27.228124 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:29:27.228184 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0810 15:29:27.228321 (+ 137us) server_negotiation.cc:299] Negotiation successful
0810 15:29:27.228349 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260810 15:29:27.228634 17404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:27.223102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:36327 (local address 127.18.68.129:42595)
0810 15:29:27.223287 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:27.223323 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0810 15:29:27.223853 (+ 530us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:29:27.224127 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:29:27.224131 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:29:27.224143 (+ 12us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:29:27.224712 (+ 569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:29:27.224719 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:29:27.225459 (+ 740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:29:27.225460 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:29:27.226583 (+ 1123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:29:27.226587 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:29:27.227128 (+ 541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:29:27.227130 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:29:27.227320 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:27.227929 (+ 609us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 15:29:27.227929 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:29:27.227969 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 15:29:27.227994 (+ 25us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:29:27.228218 (+ 224us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:29:27.228225 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:29:27.228228 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 15:29:27.228308 (+ 80us) client_negotiation.cc:240] Negotiation successful
0810 15:29:27.228399 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":81,"threads_started":1}
I20260810 15:29:27.229151 17401 heartbeater.cc:347] Connected to a master server at 127.18.68.190:36327
I20260810 15:29:27.229249 17401 heartbeater.cc:464] Registering TS with master...
I20260810 15:29:27.229468 17401 heartbeater.cc:511] Master 127.18.68.190:36327 requested a full tablet report, sending...
I20260810 15:29:27.230019 17035 ts_manager.cc:194] Registered new tserver with Master: b15f54f934b346c6a0baf71f9743cfcf (127.18.68.129:40397)
I20260810 15:29:27.230717 17035 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.18.68.129:42595
W20260810 15:29:27.310623 17406 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:29:27.310859 17406 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:29:27.310896 17406 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:29:27.312038 17406 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:29:27.312106 17406 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:29:27.312148 17406 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.68.130
I20260810 15:29:27.313586 17406 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:32819
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786375520124696-18706-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786375520124696-18706-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.68.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786375520124696-18706-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.68.130
--webserver_port=0
--tserver_master_addrs=127.18.68.190:36327
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17406
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.68.130
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786375520124696-18706-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:29:27.313877 17406 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:29:27.314208 17406 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:29:27.319451 17417 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:29:27.319480 17416 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:29:27.319482 17421 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:29:27.319695 17406 server_base.cc:1034] running on GCE node
I20260810 15:29:27.319939 17406 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:29:27.320271 17406 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:29:27.321468 17406 hybrid_clock.cc:648] HybridClock initialized: now 1786375767321452 us; error 28 us; skew 500 ppm
I20260810 15:29:27.323143 17406 webserver.cc:460] Webserver started at http://127.18.68.130:39025/ using document root <none> and password file <none>
I20260810 15:29:27.323412 17406 fs_manager.cc:359] Metadata directory not provided
I20260810 15:29:27.323490 17406 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:29:27.323676 17406 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:29:27.325044 17406 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786375520124696-18706-0/minicluster-data/ts-1/data/instance:
uuid: "6217338f474c46beb68ed6edcc2c942b"
format_stamp: "Formatted at 2026-08-10 15:29:27 on dist-test-slave-2p8l"
server_key: "05aee4b99fd8ffe504e573805a3f0545"
server_key_iv: "822666a51d0db891ad67e59ada6c1a52"
server_key_version: "encryptionkey@0"
I20260810 15:29:27.325500 17406 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786375520124696-18706-0/minicluster-data/ts-1/wal/instance:
uuid: "6217338f474c46beb68ed6edcc2c942b"
format_stamp: "Formatted at 2026-08-10 15:29:27 on dist-test-slave-2p8l"
server_key: "05aee4b99fd8ffe504e573805a3f0545"
server_key_iv: "822666a51d0db891ad67e59ada6c1a52"
server_key_version: "encryptionkey@0"
I20260810 15:29:27.327126 17406 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.003s
I20260810 15:29:27.327993 17430 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:29:27.328250 17406 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:29:27.328374 17406 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786375520124696-18706-0/minicluster-data/ts-1/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786375520124696-18706-0/minicluster-data/ts-1/wal
uuid: "6217338f474c46beb68ed6edcc2c942b"
format_stamp: "Formatted at 2026-08-10 15:29:27 on dist-test-slave-2p8l"
server_key: "05aee4b99fd8ffe504e573805a3f0545"
server_key_iv: "822666a51d0db891ad67e59ada6c1a52"
server_key_version: "encryptionkey@0"
I20260810 15:29:27.328454 17406 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786375520124696-18706-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786375520124696-18706-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786375520124696-18706-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:29:27.338809 17406 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:29:27.339183 17406 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:29:27.339366 17406 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:29:27.339684 17406 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 15:29:27.340058 17406 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 15:29:27.340123 17406 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 15:29:27.340169 17406 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 15:29:27.340204 17406 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 15:29:27.347102 17406 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.130:37737
I20260810 15:29:27.347155 17639 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.130:37737 every 8 connection(s)
I20260810 15:29:27.347529 17406 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786375520124696-18706-0/minicluster-data/ts-1/data/info.pb
I20260810 15:29:27.353284 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 17406
I20260810 15:29:27.353392 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786375520124696-18706-0/minicluster-data/ts-1/wal/instance
I20260810 15:29:27.353682 18706 external_mini_cluster.cc:1428] Setting key 2f84ce93b5f2d5cf2ecf59aa70152f6f
I20260810 15:29:27.353856 17105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:27.348365 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.130:45207 (local address 127.18.68.190:36327)
0810 15:29:27.348440 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0810 15:29:27.348443 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 15:29:27.348757 (+ 314us) server_negotiation.cc:407] Connection header received
0810 15:29:27.349243 (+ 486us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:29:27.349244 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:29:27.349256 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:29:27.349321 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:29:27.350253 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:27.350836 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:27.352141 (+ 1305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:27.352357 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:27.352430 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:27.353517 (+ 1087us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:29:27.353518 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:29:27.353519 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 15:29:27.353525 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:29:27.353544 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 15:29:27.353549 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:29:27.353617 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0810 15:29:27.353740 (+ 123us) server_negotiation.cc:299] Negotiation successful
0810 15:29:27.353774 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260810 15:29:27.354173 17643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:27.348373 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:36327 (local address 127.18.68.130:45207)
0810 15:29:27.348621 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:27.348659 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0810 15:29:27.349155 (+ 496us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:29:27.349440 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:29:27.349444 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:29:27.349453 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:29:27.350048 (+ 595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:29:27.350053 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:29:27.350974 (+ 921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:29:27.350975 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:29:27.352041 (+ 1066us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:29:27.352044 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:29:27.352460 (+ 416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:29:27.352461 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:29:27.352584 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:27.353279 (+ 695us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 15:29:27.353280 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:29:27.353309 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 15:29:27.353332 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:29:27.353647 (+ 315us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:29:27.353654 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:29:27.353656 (+ 2us) client_negotiation.cc:769] Sending connection context
0810 15:29:27.353716 (+ 60us) client_negotiation.cc:240] Negotiation successful
0810 15:29:27.353847 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":103,"threads_started":1}
I20260810 15:29:27.354779 17640 heartbeater.cc:347] Connected to a master server at 127.18.68.190:36327
I20260810 15:29:27.354892 17640 heartbeater.cc:464] Registering TS with master...
I20260810 15:29:27.354905 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786375520124696-18706-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786375520124696-18706-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786375520124696-18706-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786375520124696-18706-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.68.131:0
--local_ip_for_outbound_sockets=127.18.68.131
--webserver_interface=127.18.68.131
--webserver_port=0
--tserver_master_addrs=127.18.68.190:36327
--builtin_ntp_servers=127.18.68.148:32819
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260810 15:29:27.355121 17640 heartbeater.cc:511] Master 127.18.68.190:36327 requested a full tablet report, sending...
I20260810 15:29:27.355494 17035 ts_manager.cc:194] Registered new tserver with Master: 6217338f474c46beb68ed6edcc2c942b (127.18.68.130:37737)
I20260810 15:29:27.355903 17035 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.18.68.130:45207
W20260810 15:29:27.439306 17645 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:29:27.439553 17645 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:29:27.439632 17645 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:29:27.440766 17645 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:29:27.440830 17645 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:29:27.440871 17645 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.68.131
I20260810 15:29:27.442276 17645 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:32819
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786375520124696-18706-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786375520124696-18706-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.68.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786375520124696-18706-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.68.131
--webserver_port=0
--tserver_master_addrs=127.18.68.190:36327
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17645
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.68.131
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786375520124696-18706-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:29:27.442557 17645 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:29:27.442874 17645 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:29:27.448107 17652 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:29:27.448118 17653 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:29:27.448118 17656 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:29:27.448452 17645 server_base.cc:1034] running on GCE node
I20260810 15:29:27.448722 17645 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:29:27.448967 17645 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:29:27.450146 17645 hybrid_clock.cc:648] HybridClock initialized: now 1786375767450125 us; error 30 us; skew 500 ppm
I20260810 15:29:27.451781 17645 webserver.cc:460] Webserver started at http://127.18.68.131:44323/ using document root <none> and password file <none>
I20260810 15:29:27.452059 17645 fs_manager.cc:359] Metadata directory not provided
I20260810 15:29:27.452109 17645 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:29:27.452276 17645 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:29:27.453438 17645 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786375520124696-18706-0/minicluster-data/ts-2/data/instance:
uuid: "7e48d27541a346b08f1b408b0c3fd861"
format_stamp: "Formatted at 2026-08-10 15:29:27 on dist-test-slave-2p8l"
server_key: "cd97ddcd3c6110e492af10bcb37f56df"
server_key_iv: "ff966d5911a3075baa8e1c84dc51d902"
server_key_version: "encryptionkey@0"
I20260810 15:29:27.453825 17645 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786375520124696-18706-0/minicluster-data/ts-2/wal/instance:
uuid: "7e48d27541a346b08f1b408b0c3fd861"
format_stamp: "Formatted at 2026-08-10 15:29:27 on dist-test-slave-2p8l"
server_key: "cd97ddcd3c6110e492af10bcb37f56df"
server_key_iv: "ff966d5911a3075baa8e1c84dc51d902"
server_key_version: "encryptionkey@0"
I20260810 15:29:27.455265 17645 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 15:29:27.456133 17665 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:29:27.456359 17645 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:29:27.456465 17645 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786375520124696-18706-0/minicluster-data/ts-2/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786375520124696-18706-0/minicluster-data/ts-2/wal
uuid: "7e48d27541a346b08f1b408b0c3fd861"
format_stamp: "Formatted at 2026-08-10 15:29:27 on dist-test-slave-2p8l"
server_key: "cd97ddcd3c6110e492af10bcb37f56df"
server_key_iv: "ff966d5911a3075baa8e1c84dc51d902"
server_key_version: "encryptionkey@0"
I20260810 15:29:27.456557 17645 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786375520124696-18706-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786375520124696-18706-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786375520124696-18706-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:29:27.482523 17645 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:29:27.482885 17645 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:29:27.483059 17645 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:29:27.483314 17645 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 15:29:27.483670 17645 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 15:29:27.483731 17645 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 15:29:27.483764 17645 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 15:29:27.483795 17645 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 15:29:27.490195 17645 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.131:46213
I20260810 15:29:27.490273 17885 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.131:46213 every 8 connection(s)
I20260810 15:29:27.490643 17645 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786375520124696-18706-0/minicluster-data/ts-2/data/info.pb
I20260810 15:29:27.490967 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 17645
I20260810 15:29:27.491089 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786375520124696-18706-0/minicluster-data/ts-2/wal/instance
I20260810 15:29:27.491302 18706 external_mini_cluster.cc:1428] Setting key e7bdf7e7164b3aceb8853a9699557cf5
I20260810 15:29:27.495963 17105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:27.491544 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.131:46955 (local address 127.18.68.190:36327)
0810 15:29:27.491600 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0810 15:29:27.491602 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:29:27.491888 (+ 286us) server_negotiation.cc:407] Connection header received
0810 15:29:27.492376 (+ 488us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:29:27.492377 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:29:27.492386 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:29:27.492432 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:29:27.493103 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:27.493611 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:27.494649 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:27.494831 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:27.494892 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:27.495733 (+ 841us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:29:27.495734 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:29:27.495734 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 15:29:27.495739 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:29:27.495751 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 15:29:27.495755 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:29:27.495797 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0810 15:29:27.495884 (+ 87us) server_negotiation.cc:299] Negotiation successful
0810 15:29:27.495904 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260810 15:29:27.496223 17890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:27.491552 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:36327 (local address 127.18.68.131:46955)
0810 15:29:27.491761 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:27.491803 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0810 15:29:27.492292 (+ 489us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:29:27.492487 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:29:27.492490 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:29:27.492499 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:29:27.493018 (+ 519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:29:27.493022 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:29:27.493724 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:29:27.493725 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:29:27.494561 (+ 836us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:29:27.494565 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:29:27.494936 (+ 371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:29:27.494937 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:29:27.495067 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:27.495592 (+ 525us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 15:29:27.495592 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:29:27.495628 (+ 36us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 15:29:27.495651 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:29:27.495813 (+ 162us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:29:27.495818 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:29:27.495820 (+ 2us) client_negotiation.cc:769] Sending connection context
0810 15:29:27.495873 (+ 53us) client_negotiation.cc:240] Negotiation successful
0810 15:29:27.495956 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":108,"threads_started":1}
I20260810 15:29:27.496767 17887 heartbeater.cc:347] Connected to a master server at 127.18.68.190:36327
I20260810 15:29:27.496860 17887 heartbeater.cc:464] Registering TS with master...
I20260810 15:29:27.497004 17887 heartbeater.cc:511] Master 127.18.68.190:36327 requested a full tablet report, sending...
I20260810 15:29:27.497387 17035 ts_manager.cc:194] Registered new tserver with Master: 7e48d27541a346b08f1b408b0c3fd861 (127.18.68.131:46213)
I20260810 15:29:27.497776 17035 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.18.68.131:46955
I20260810 15:29:27.503170 18706 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 15:29:27.507499 17105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:27.504670 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45304 (local address 127.18.68.190:36327)
0810 15:29:27.504712 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0810 15:29:27.504714 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:29:27.504827 (+ 113us) server_negotiation.cc:407] Connection header received
0810 15:29:27.504885 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:29:27.504886 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:29:27.504897 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:29:27.504954 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:29:27.505076 (+ 122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:27.505538 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:27.506325 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:27.506512 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:27.506583 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:27.507291 (+ 708us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:29:27.507292 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:29:27.507293 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 15:29:27.507297 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:29:27.507311 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 15:29:27.507315 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:29:27.507369 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0810 15:29:27.507417 (+ 48us) server_negotiation.cc:299] Negotiation successful
0810 15:29:27.507438 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260810 15:29:27.509204 17035 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45304:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 15:29:27.511018 17035 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 15:29:27.517343 17903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:27.513414 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.129:40397 (local address 127.0.0.1:50808)
0810 15:29:27.513812 (+ 398us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:27.513867 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0810 15:29:27.513935 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:29:27.514242 (+ 307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:29:27.514245 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:29:27.514248 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:29:27.514327 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:29:27.514330 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:29:27.515315 (+ 985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:29:27.515316 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:29:27.516292 (+ 976us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:29:27.516295 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:29:27.517025 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:29:27.517026 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:29:27.517112 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:27.517127 (+ 15us) client_negotiation.cc:769] Sending connection context
0810 15:29:27.517203 (+ 76us) client_negotiation.cc:240] Negotiation successful
0810 15:29:27.517261 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":359,"thread_start_us":101,"threads_started":1}
I20260810 15:29:27.517356 17904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:27.513591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50808 (local address 127.18.68.129:40397)
0810 15:29:27.514017 (+ 426us) server_negotiation.cc:206] Beginning negotiation
0810 15:29:27.514022 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 15:29:27.514034 (+ 12us) server_negotiation.cc:407] Connection header received
0810 15:29:27.514122 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:29:27.514125 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:29:27.514143 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:29:27.514226 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:29:27.514403 (+ 177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:27.515220 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:27.516384 (+ 1164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:27.516931 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:27.517025 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:27.517121 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0810 15:29:27.517233 (+ 112us) server_negotiation.cc:299] Negotiation successful
0810 15:29:27.517269 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":379,"thread_start_us":101,"threads_started":1}
I20260810 15:29:27.518042 17268 tablet_service.cc:1467] Processing CreateTablet for tablet dfebbc9159044d2da25303ecd51ec729 (DEFAULT_TABLE table=test-table [id=ef60485465f341eea64adc571cd3bdb9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 15:29:27.518500 17268 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dfebbc9159044d2da25303ecd51ec729. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:29:27.518599 17901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:27.513422 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.130:37737 (local address 127.0.0.1:52854)
0810 15:29:27.513811 (+ 389us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:27.513859 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0810 15:29:27.513938 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:29:27.514504 (+ 566us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:29:27.514505 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:29:27.514508 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:29:27.514550 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:29:27.514552 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:29:27.515905 (+ 1353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:29:27.515906 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:29:27.517176 (+ 1270us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:29:27.517179 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:29:27.518391 (+ 1212us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:29:27.518391 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:29:27.518448 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:27.518450 (+ 2us) client_negotiation.cc:769] Sending connection context
0810 15:29:27.518496 (+ 46us) client_negotiation.cc:240] Negotiation successful
0810 15:29:27.518525 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":364,"mutex_wait_us":67,"thread_start_us":78,"threads_started":1}
I20260810 15:29:27.518599 17909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:27.513672 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.131:46213 (local address 127.0.0.1:34420)
0810 15:29:27.514086 (+ 414us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:27.514097 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 15:29:27.514149 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:29:27.514472 (+ 323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:29:27.514473 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:29:27.514475 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:29:27.514517 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:29:27.514518 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:29:27.515910 (+ 1392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:29:27.515911 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:29:27.517176 (+ 1265us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:29:27.517179 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:29:27.518338 (+ 1159us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:29:27.518339 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:29:27.518404 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:27.518409 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 15:29:27.518439 (+ 30us) client_negotiation.cc:240] Negotiation successful
0810 15:29:27.518503 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":376,"mutex_wait_us":65,"thread_start_us":73,"threads_started":1}
I20260810 15:29:27.518956 17911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:27.513793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34420 (local address 127.18.68.131:46213)
0810 15:29:27.513986 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0810 15:29:27.513991 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 15:29:27.514143 (+ 152us) server_negotiation.cc:407] Connection header received
0810 15:29:27.514244 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:29:27.514246 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:29:27.514262 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:29:27.514610 (+ 348us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:29:27.514676 (+ 66us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:27.515807 (+ 1131us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:27.517288 (+ 1481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:27.518246 (+ 958us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:27.518701 (+ 455us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:27.518810 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0810 15:29:27.518836 (+ 26us) server_negotiation.cc:299] Negotiation successful
0810 15:29:27.518873 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":87,"threads_started":1}
I20260810 15:29:27.518956 17905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:27.513597 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52854 (local address 127.18.68.130:37737)
0810 15:29:27.514286 (+ 689us) server_negotiation.cc:206] Beginning negotiation
0810 15:29:27.514290 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 15:29:27.514301 (+ 11us) server_negotiation.cc:407] Connection header received
0810 15:29:27.514339 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:29:27.514341 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:29:27.514356 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:29:27.514432 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:29:27.514650 (+ 218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:27.515803 (+ 1153us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:27.517288 (+ 1485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:27.518193 (+ 905us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:27.518269 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:27.518361 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0810 15:29:27.518829 (+ 468us) server_negotiation.cc:299] Negotiation successful
0810 15:29:27.518873 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":651,"thread_start_us":114,"threads_started":1}
I20260810 15:29:27.519714 17513 tablet_service.cc:1467] Processing CreateTablet for tablet dfebbc9159044d2da25303ecd51ec729 (DEFAULT_TABLE table=test-table [id=ef60485465f341eea64adc571cd3bdb9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 15:29:27.519812 17748 tablet_service.cc:1467] Processing CreateTablet for tablet dfebbc9159044d2da25303ecd51ec729 (DEFAULT_TABLE table=test-table [id=ef60485465f341eea64adc571cd3bdb9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 15:29:27.520087 17513 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dfebbc9159044d2da25303ecd51ec729. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:29:27.520183 17748 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dfebbc9159044d2da25303ecd51ec729. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:29:27.522367 17915 tablet_bootstrap.cc:492] T dfebbc9159044d2da25303ecd51ec729 P b15f54f934b346c6a0baf71f9743cfcf: Bootstrap starting.
I20260810 15:29:27.523067 17917 tablet_bootstrap.cc:492] T dfebbc9159044d2da25303ecd51ec729 P 6217338f474c46beb68ed6edcc2c942b: Bootstrap starting.
I20260810 15:29:27.523156 17915 tablet_bootstrap.cc:654] T dfebbc9159044d2da25303ecd51ec729 P b15f54f934b346c6a0baf71f9743cfcf: Neither blocks nor log segments found. Creating new log.
I20260810 15:29:27.523514 17915 log.cc:824] T dfebbc9159044d2da25303ecd51ec729 P b15f54f934b346c6a0baf71f9743cfcf: Log is configured to *not* fsync() on all Append() calls
I20260810 15:29:27.523828 17917 tablet_bootstrap.cc:654] T dfebbc9159044d2da25303ecd51ec729 P 6217338f474c46beb68ed6edcc2c942b: Neither blocks nor log segments found. Creating new log.
I20260810 15:29:27.523954 17918 tablet_bootstrap.cc:492] T dfebbc9159044d2da25303ecd51ec729 P 7e48d27541a346b08f1b408b0c3fd861: Bootstrap starting.
I20260810 15:29:27.524183 17917 log.cc:824] T dfebbc9159044d2da25303ecd51ec729 P 6217338f474c46beb68ed6edcc2c942b: Log is configured to *not* fsync() on all Append() calls
I20260810 15:29:27.524550 17915 tablet_bootstrap.cc:492] T dfebbc9159044d2da25303ecd51ec729 P b15f54f934b346c6a0baf71f9743cfcf: No bootstrap required, opened a new log
I20260810 15:29:27.524636 17915 ts_tablet_manager.cc:1397] T dfebbc9159044d2da25303ecd51ec729 P b15f54f934b346c6a0baf71f9743cfcf: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 15:29:27.524667 17918 tablet_bootstrap.cc:654] T dfebbc9159044d2da25303ecd51ec729 P 7e48d27541a346b08f1b408b0c3fd861: Neither blocks nor log segments found. Creating new log.
I20260810 15:29:27.525014 17918 log.cc:824] T dfebbc9159044d2da25303ecd51ec729 P 7e48d27541a346b08f1b408b0c3fd861: Log is configured to *not* fsync() on all Append() calls
I20260810 15:29:27.525207 17917 tablet_bootstrap.cc:492] T dfebbc9159044d2da25303ecd51ec729 P 6217338f474c46beb68ed6edcc2c942b: No bootstrap required, opened a new log
I20260810 15:29:27.525465 17917 ts_tablet_manager.cc:1397] T dfebbc9159044d2da25303ecd51ec729 P 6217338f474c46beb68ed6edcc2c942b: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260810 15:29:27.525739 17918 tablet_bootstrap.cc:492] T dfebbc9159044d2da25303ecd51ec729 P 7e48d27541a346b08f1b408b0c3fd861: No bootstrap required, opened a new log
I20260810 15:29:27.525820 17918 ts_tablet_manager.cc:1397] T dfebbc9159044d2da25303ecd51ec729 P 7e48d27541a346b08f1b408b0c3fd861: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 15:29:27.527379 17915 raft_consensus.cc:348] T dfebbc9159044d2da25303ecd51ec729 P b15f54f934b346c6a0baf71f9743cfcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b15f54f934b346c6a0baf71f9743cfcf" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 40397 } } peers { permanent_uuid: "6217338f474c46beb68ed6edcc2c942b" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 37737 } } peers { permanent_uuid: "7e48d27541a346b08f1b408b0c3fd861" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 46213 } }
I20260810 15:29:27.527580 17915 raft_consensus.cc:374] T dfebbc9159044d2da25303ecd51ec729 P b15f54f934b346c6a0baf71f9743cfcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:29:27.527617 17915 raft_consensus.cc:729] T dfebbc9159044d2da25303ecd51ec729 P b15f54f934b346c6a0baf71f9743cfcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b15f54f934b346c6a0baf71f9743cfcf, State: Initialized, Role: FOLLOWER
I20260810 15:29:27.527765 17915 consensus_queue.cc:260] T dfebbc9159044d2da25303ecd51ec729 P b15f54f934b346c6a0baf71f9743cfcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b15f54f934b346c6a0baf71f9743cfcf" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 40397 } } peers { permanent_uuid: "6217338f474c46beb68ed6edcc2c942b" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 37737 } } peers { permanent_uuid: "7e48d27541a346b08f1b408b0c3fd861" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 46213 } }
I20260810 15:29:27.527820 17918 raft_consensus.cc:348] T dfebbc9159044d2da25303ecd51ec729 P 7e48d27541a346b08f1b408b0c3fd861 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b15f54f934b346c6a0baf71f9743cfcf" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 40397 } } peers { permanent_uuid: "6217338f474c46beb68ed6edcc2c942b" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 37737 } } peers { permanent_uuid: "7e48d27541a346b08f1b408b0c3fd861" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 46213 } }
I20260810 15:29:27.527990 17918 raft_consensus.cc:374] T dfebbc9159044d2da25303ecd51ec729 P 7e48d27541a346b08f1b408b0c3fd861 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:29:27.528035 17918 raft_consensus.cc:729] T dfebbc9159044d2da25303ecd51ec729 P 7e48d27541a346b08f1b408b0c3fd861 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e48d27541a346b08f1b408b0c3fd861, State: Initialized, Role: FOLLOWER
I20260810 15:29:27.528055 17915 ts_tablet_manager.cc:1428] T dfebbc9159044d2da25303ecd51ec729 P b15f54f934b346c6a0baf71f9743cfcf: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260810 15:29:27.528177 17401 heartbeater.cc:503] Master 127.18.68.190:36327 was elected leader, sending a full tablet report...
I20260810 15:29:27.528157 17918 consensus_queue.cc:260] T dfebbc9159044d2da25303ecd51ec729 P 7e48d27541a346b08f1b408b0c3fd861 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b15f54f934b346c6a0baf71f9743cfcf" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 40397 } } peers { permanent_uuid: "6217338f474c46beb68ed6edcc2c942b" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 37737 } } peers { permanent_uuid: "7e48d27541a346b08f1b408b0c3fd861" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 46213 } }
I20260810 15:29:27.528229 17917 raft_consensus.cc:348] T dfebbc9159044d2da25303ecd51ec729 P 6217338f474c46beb68ed6edcc2c942b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b15f54f934b346c6a0baf71f9743cfcf" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 40397 } } peers { permanent_uuid: "6217338f474c46beb68ed6edcc2c942b" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 37737 } } peers { permanent_uuid: "7e48d27541a346b08f1b408b0c3fd861" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 46213 } }
I20260810 15:29:27.528416 17918 ts_tablet_manager.cc:1428] T dfebbc9159044d2da25303ecd51ec729 P 7e48d27541a346b08f1b408b0c3fd861: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 15:29:27.528421 17917 raft_consensus.cc:374] T dfebbc9159044d2da25303ecd51ec729 P 6217338f474c46beb68ed6edcc2c942b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:29:27.528437 17887 heartbeater.cc:503] Master 127.18.68.190:36327 was elected leader, sending a full tablet report...
I20260810 15:29:27.528466 17917 raft_consensus.cc:729] T dfebbc9159044d2da25303ecd51ec729 P 6217338f474c46beb68ed6edcc2c942b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6217338f474c46beb68ed6edcc2c942b, State: Initialized, Role: FOLLOWER
I20260810 15:29:27.528602 17917 consensus_queue.cc:260] T dfebbc9159044d2da25303ecd51ec729 P 6217338f474c46beb68ed6edcc2c942b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b15f54f934b346c6a0baf71f9743cfcf" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 40397 } } peers { permanent_uuid: "6217338f474c46beb68ed6edcc2c942b" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 37737 } } peers { permanent_uuid: "7e48d27541a346b08f1b408b0c3fd861" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 46213 } }
I20260810 15:29:27.528888 17917 ts_tablet_manager.cc:1428] T dfebbc9159044d2da25303ecd51ec729 P 6217338f474c46beb68ed6edcc2c942b: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260810 15:29:27.528944 17640 heartbeater.cc:503] Master 127.18.68.190:36327 was elected leader, sending a full tablet report...
I20260810 15:29:27.529357 17925 raft_consensus.cc:482] T dfebbc9159044d2da25303ecd51ec729 P 7e48d27541a346b08f1b408b0c3fd861 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 15:29:27.529440 17925 raft_consensus.cc:504] T dfebbc9159044d2da25303ecd51ec729 P 7e48d27541a346b08f1b408b0c3fd861 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b15f54f934b346c6a0baf71f9743cfcf" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 40397 } } peers { permanent_uuid: "6217338f474c46beb68ed6edcc2c942b" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 37737 } } peers { permanent_uuid: "7e48d27541a346b08f1b408b0c3fd861" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 46213 } }
I20260810 15:29:27.529771 17925 leader_election.cc:288] T dfebbc9159044d2da25303ecd51ec729 P 7e48d27541a346b08f1b408b0c3fd861 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b15f54f934b346c6a0baf71f9743cfcf (127.18.68.129:40397), 6217338f474c46beb68ed6edcc2c942b (127.18.68.130:37737)
I20260810 15:29:27.533320 17890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:27.529932 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.130:37737 (local address 127.18.68.131:40539)
0810 15:29:27.529977 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:27.529990 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 15:29:27.530030 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:29:27.530174 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:29:27.530175 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:29:27.530177 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:29:27.530248 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:29:27.530250 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:29:27.531098 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:29:27.531099 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:29:27.532236 (+ 1137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:29:27.532238 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:29:27.533052 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:29:27.533053 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:29:27.533115 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:27.533118 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 15:29:27.533180 (+ 62us) client_negotiation.cc:240] Negotiation successful
0810 15:29:27.533219 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":23}
I20260810 15:29:27.533346 17905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:27.529992 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.131:40539 (local address 127.18.68.130:37737)
0810 15:29:27.530041 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0810 15:29:27.530043 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:29:27.530053 (+ 10us) server_negotiation.cc:407] Connection header received
0810 15:29:27.530097 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:29:27.530098 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:29:27.530108 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:29:27.530170 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:29:27.530311 (+ 141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:27.531008 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:27.532338 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:27.532945 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:27.533033 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:27.533064 (+ 31us) server_negotiation.cc:1035] Waiting for connection context
0810 15:29:27.533208 (+ 144us) server_negotiation.cc:299] Negotiation successful
0810 15:29:27.533257 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260810 15:29:27.533607 17904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:27.530089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.131:53521 (local address 127.18.68.129:40397)
0810 15:29:27.530127 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0810 15:29:27.530129 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:29:27.530557 (+ 428us) server_negotiation.cc:407] Connection header received
0810 15:29:27.530660 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:29:27.530662 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:29:27.530672 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:29:27.530731 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:29:27.530850 (+ 119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:27.531286 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:27.532527 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:27.533201 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:27.533277 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:27.533285 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0810 15:29:27.533495 (+ 210us) server_negotiation.cc:299] Negotiation successful
0810 15:29:27.533552 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260810 15:29:27.533707 17549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dfebbc9159044d2da25303ecd51ec729" candidate_uuid: "7e48d27541a346b08f1b408b0c3fd861" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6217338f474c46beb68ed6edcc2c942b" is_pre_election: true
I20260810 15:29:27.533828 17929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:27.529932 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.129:40397 (local address 127.18.68.131:53521)
0810 15:29:27.530494 (+ 562us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:27.530505 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 15:29:27.530591 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:29:27.530738 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:29:27.530738 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:29:27.530740 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:29:27.530799 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:29:27.530800 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:29:27.531368 (+ 568us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:29:27.531369 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:29:27.532436 (+ 1067us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:29:27.532438 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:29:27.533299 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:29:27.533299 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:29:27.533386 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:27.533391 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 15:29:27.533695 (+ 304us) client_negotiation.cc:240] Negotiation successful
0810 15:29:27.533743 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":543,"mutex_wait_us":319,"thread_start_us":108,"threads_started":1}
I20260810 15:29:27.533861 17549 raft_consensus.cc:2454] T dfebbc9159044d2da25303ecd51ec729 P 6217338f474c46beb68ed6edcc2c942b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e48d27541a346b08f1b408b0c3fd861 in term 0.
I20260810 15:29:27.534113 17673 leader_election.cc:302] T dfebbc9159044d2da25303ecd51ec729 P 7e48d27541a346b08f1b408b0c3fd861 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6217338f474c46beb68ed6edcc2c942b, 7e48d27541a346b08f1b408b0c3fd861; no voters:
I20260810 15:29:27.534250 17925 raft_consensus.cc:2781] T dfebbc9159044d2da25303ecd51ec729 P 7e48d27541a346b08f1b408b0c3fd861 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 15:29:27.534284 17305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dfebbc9159044d2da25303ecd51ec729" candidate_uuid: "7e48d27541a346b08f1b408b0c3fd861" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b15f54f934b346c6a0baf71f9743cfcf" is_pre_election: true
I20260810 15:29:27.534350 17925 raft_consensus.cc:482] T dfebbc9159044d2da25303ecd51ec729 P 7e48d27541a346b08f1b408b0c3fd861 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 15:29:27.534395 17925 raft_consensus.cc:3037] T dfebbc9159044d2da25303ecd51ec729 P 7e48d27541a346b08f1b408b0c3fd861 [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:29:27.534426 17305 raft_consensus.cc:2454] T dfebbc9159044d2da25303ecd51ec729 P b15f54f934b346c6a0baf71f9743cfcf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e48d27541a346b08f1b408b0c3fd861 in term 0.
I20260810 15:29:27.535131 17925 raft_consensus.cc:504] T dfebbc9159044d2da25303ecd51ec729 P 7e48d27541a346b08f1b408b0c3fd861 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b15f54f934b346c6a0baf71f9743cfcf" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 40397 } } peers { permanent_uuid: "6217338f474c46beb68ed6edcc2c942b" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 37737 } } peers { permanent_uuid: "7e48d27541a346b08f1b408b0c3fd861" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 46213 } }
I20260810 15:29:27.535286 17925 leader_election.cc:288] T dfebbc9159044d2da25303ecd51ec729 P 7e48d27541a346b08f1b408b0c3fd861 [CANDIDATE]: Term 1 election: Requested vote from peers b15f54f934b346c6a0baf71f9743cfcf (127.18.68.129:40397), 6217338f474c46beb68ed6edcc2c942b (127.18.68.130:37737)
I20260810 15:29:27.535442 17305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dfebbc9159044d2da25303ecd51ec729" candidate_uuid: "7e48d27541a346b08f1b408b0c3fd861" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b15f54f934b346c6a0baf71f9743cfcf"
I20260810 15:29:27.535542 17305 raft_consensus.cc:3037] T dfebbc9159044d2da25303ecd51ec729 P b15f54f934b346c6a0baf71f9743cfcf [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:29:27.535606 17549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dfebbc9159044d2da25303ecd51ec729" candidate_uuid: "7e48d27541a346b08f1b408b0c3fd861" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6217338f474c46beb68ed6edcc2c942b"
I20260810 15:29:27.535678 17549 raft_consensus.cc:3037] T dfebbc9159044d2da25303ecd51ec729 P 6217338f474c46beb68ed6edcc2c942b [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:29:27.536708 17549 raft_consensus.cc:2454] T dfebbc9159044d2da25303ecd51ec729 P 6217338f474c46beb68ed6edcc2c942b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e48d27541a346b08f1b408b0c3fd861 in term 1.
I20260810 15:29:27.536708 17305 raft_consensus.cc:2454] T dfebbc9159044d2da25303ecd51ec729 P b15f54f934b346c6a0baf71f9743cfcf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e48d27541a346b08f1b408b0c3fd861 in term 1.
I20260810 15:29:27.536904 17670 leader_election.cc:302] T dfebbc9159044d2da25303ecd51ec729 P 7e48d27541a346b08f1b408b0c3fd861 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e48d27541a346b08f1b408b0c3fd861, b15f54f934b346c6a0baf71f9743cfcf; no voters:
I20260810 15:29:27.537024 17925 raft_consensus.cc:2781] T dfebbc9159044d2da25303ecd51ec729 P 7e48d27541a346b08f1b408b0c3fd861 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 15:29:27.537235 17925 raft_consensus.cc:686] T dfebbc9159044d2da25303ecd51ec729 P 7e48d27541a346b08f1b408b0c3fd861 [term 1 LEADER]: Becoming Leader. State: Replica: 7e48d27541a346b08f1b408b0c3fd861, State: Running, Role: LEADER
I20260810 15:29:27.537354 17925 consensus_queue.cc:237] T dfebbc9159044d2da25303ecd51ec729 P 7e48d27541a346b08f1b408b0c3fd861 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b15f54f934b346c6a0baf71f9743cfcf" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 40397 } } peers { permanent_uuid: "6217338f474c46beb68ed6edcc2c942b" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 37737 } } peers { permanent_uuid: "7e48d27541a346b08f1b408b0c3fd861" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 46213 } }
I20260810 15:29:27.538354 17034 catalog_manager.cc:5495] T dfebbc9159044d2da25303ecd51ec729 P 7e48d27541a346b08f1b408b0c3fd861 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e48d27541a346b08f1b408b0c3fd861 (127.18.68.131). New cstate: current_term: 1 leader_uuid: "7e48d27541a346b08f1b408b0c3fd861" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b15f54f934b346c6a0baf71f9743cfcf" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 40397 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6217338f474c46beb68ed6edcc2c942b" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 37737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e48d27541a346b08f1b408b0c3fd861" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 46213 } health_report { overall_health: HEALTHY } } }
I20260810 15:29:27.546056 17911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:27.543725 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34426 (local address 127.18.68.131:46213)
0810 15:29:27.543787 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0810 15:29:27.543788 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 15:29:27.543797 (+ 9us) server_negotiation.cc:407] Connection header received
0810 15:29:27.543845 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:29:27.543846 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:29:27.543862 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:29:27.543921 (+ 59us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 15:29:27.544023 (+ 102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:27.544484 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:27.545239 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:27.545420 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:27.545473 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:27.545711 (+ 238us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 15:29:27.545812 (+ 101us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 15:29:27.545880 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0810 15:29:27.545920 (+ 40us) server_negotiation.cc:299] Negotiation successful
0810 15:29:27.545937 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260810 15:29:27.547878 17549 raft_consensus.cc:1261] T dfebbc9159044d2da25303ecd51ec729 P 6217338f474c46beb68ed6edcc2c942b [term 1 FOLLOWER]: Refusing update from remote peer 7e48d27541a346b08f1b408b0c3fd861: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 15:29:27.547885 17305 raft_consensus.cc:1261] T dfebbc9159044d2da25303ecd51ec729 P b15f54f934b346c6a0baf71f9743cfcf [term 1 FOLLOWER]: Refusing update from remote peer 7e48d27541a346b08f1b408b0c3fd861: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 15:29:27.548259 17925 consensus_queue.cc:1035] T dfebbc9159044d2da25303ecd51ec729 P 7e48d27541a346b08f1b408b0c3fd861 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b15f54f934b346c6a0baf71f9743cfcf" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 40397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 15:29:27.548426 17930 consensus_queue.cc:1035] T dfebbc9159044d2da25303ecd51ec729 P 7e48d27541a346b08f1b408b0c3fd861 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6217338f474c46beb68ed6edcc2c942b" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 37737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 15:29:27.550926 17937 mvcc.cc:205] Tried to move back new op lower bound from 7316995143873490944 to 7316995143833886720. Current Snapshot: MvccSnapshot[applied={T|T < 7316995143873490944}]
I20260810 15:29:27.551671 17938 mvcc.cc:205] Tried to move back new op lower bound from 7316995143873490944 to 7316995143833886720. Current Snapshot: MvccSnapshot[applied={T|T < 7316995143873490944 or (T in {7316995143873490944})}]
I20260810 15:29:27.553462 17034 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45304:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 15:29:27.553562 17034 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45304:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 15:29:27.554426 17034 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b5bf34b5f2664243bf522ce119deae5b: Sending DeleteTablet for 3 replicas of tablet dfebbc9159044d2da25303ecd51ec729
I20260810 15:29:27.554805 17748 tablet_service.cc:1514] Processing DeleteTablet for tablet dfebbc9159044d2da25303ecd51ec729 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 15:29:27 UTC) from {username='slave'} at 127.0.0.1:34420
I20260810 15:29:27.554819 17513 tablet_service.cc:1514] Processing DeleteTablet for tablet dfebbc9159044d2da25303ecd51ec729 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 15:29:27 UTC) from {username='slave'} at 127.0.0.1:52854
I20260810 15:29:27.554893 17268 tablet_service.cc:1514] Processing DeleteTablet for tablet dfebbc9159044d2da25303ecd51ec729 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 15:29:27 UTC) from {username='slave'} at 127.0.0.1:50808
I20260810 15:29:27.555017 17955 tablet_replica.cc:330] T dfebbc9159044d2da25303ecd51ec729 P 7e48d27541a346b08f1b408b0c3fd861: stopping tablet replica
I20260810 15:29:27.555109 17955 raft_consensus.cc:2229] T dfebbc9159044d2da25303ecd51ec729 P 7e48d27541a346b08f1b408b0c3fd861 [term 1 LEADER]: Raft consensus shutting down.
I20260810 15:29:27.555212 17955 raft_consensus.cc:2258] T dfebbc9159044d2da25303ecd51ec729 P 7e48d27541a346b08f1b408b0c3fd861 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 15:29:27.555387 17954 tablet_replica.cc:330] T dfebbc9159044d2da25303ecd51ec729 P 6217338f474c46beb68ed6edcc2c942b: stopping tablet replica
I20260810 15:29:27.555406 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 17145
I20260810 15:29:27.582998 17954 raft_consensus.cc:2229] T dfebbc9159044d2da25303ecd51ec729 P 6217338f474c46beb68ed6edcc2c942b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 15:29:27.583209 17954 raft_consensus.cc:2258] T dfebbc9159044d2da25303ecd51ec729 P 6217338f474c46beb68ed6edcc2c942b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 15:29:27.584949 17954 ts_tablet_manager.cc:1905] T dfebbc9159044d2da25303ecd51ec729 P 6217338f474c46beb68ed6edcc2c942b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 15:29:27.584955 17955 ts_tablet_manager.cc:1905] T dfebbc9159044d2da25303ecd51ec729 P 7e48d27541a346b08f1b408b0c3fd861: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 15:29:27.586776 17954 ts_tablet_manager.cc:1918] T dfebbc9159044d2da25303ecd51ec729 P 6217338f474c46beb68ed6edcc2c942b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 15:29:27.586872 17954 log.cc:1196] T dfebbc9159044d2da25303ecd51ec729 P 6217338f474c46beb68ed6edcc2c942b: Deleting WAL directory at /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786375520124696-18706-0/minicluster-data/ts-1/wal/wals/dfebbc9159044d2da25303ecd51ec729
I20260810 15:29:27.587139 17954 ts_tablet_manager.cc:1939] T dfebbc9159044d2da25303ecd51ec729 P 6217338f474c46beb68ed6edcc2c942b: Deleting consensus metadata
I20260810 15:29:27.587445 17955 ts_tablet_manager.cc:1918] T dfebbc9159044d2da25303ecd51ec729 P 7e48d27541a346b08f1b408b0c3fd861: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 15:29:27.587590 17955 log.cc:1196] T dfebbc9159044d2da25303ecd51ec729 P 7e48d27541a346b08f1b408b0c3fd861: Deleting WAL directory at /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786375520124696-18706-0/minicluster-data/ts-2/wal/wals/dfebbc9159044d2da25303ecd51ec729
I20260810 15:29:27.587649 17015 catalog_manager.cc:4841] TS 6217338f474c46beb68ed6edcc2c942b (127.18.68.130:37737): tablet dfebbc9159044d2da25303ecd51ec729 (table test-table [id=ef60485465f341eea64adc571cd3bdb9]) successfully deleted
I20260810 15:29:27.587987 17955 ts_tablet_manager.cc:1939] T dfebbc9159044d2da25303ecd51ec729 P 7e48d27541a346b08f1b408b0c3fd861: Deleting consensus metadata
I20260810 15:29:27.588449 17015 catalog_manager.cc:4841] TS 7e48d27541a346b08f1b408b0c3fd861 (127.18.68.131:46213): tablet dfebbc9159044d2da25303ecd51ec729 (table test-table [id=ef60485465f341eea64adc571cd3bdb9]) successfully deleted
W20260810 15:29:27.589336 17012 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.18.68.129:40397 (error 108)
I20260810 15:29:27.589906 17901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:27.589754 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.129:40397 (local address 127.0.0.1:50824)
0810 15:29:27.589820 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:27.589868 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.129:40397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260810 15:29:27.589985 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 17406
W20260810 15:29:27.596019 17012 catalog_manager.cc:4584] TS b15f54f934b346c6a0baf71f9743cfcf (127.18.68.129:40397): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet dfebbc9159044d2da25303ecd51ec729: Network error: Client connection negotiation failed: client connection to 127.18.68.129:40397: connect: Connection refused (error 111)
I20260810 15:29:27.600695 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 17645
I20260810 15:29:27.615389 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 16978
2026-08-10T15:29:27Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (734 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786375520124696-18706-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 15:29:27 dist-test-slave-2p8l krb5kdc[17967](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 15:29:27 dist-test-slave-2p8l krb5kdc[17967](info): set up 2 sockets
Aug 10 15:29:27 dist-test-slave-2p8l krb5kdc[17967](info): commencing operation
krb5kdc: starting...
W20260810 15:29:28.920435 18706 mini_kdc.cc:121] Time spent starting KDC: real 1.277s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786375520124696-18706-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786375520124696-18706-0/krb5kdc/test-user.keytab.
Aug 10 15:29:29 dist-test-slave-2p8l krb5kdc[17967](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375769, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T15:29:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T15:29:29Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.68.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.68.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.68.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab.
Entry for principal kudu/127.18.68.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab.
I20260810 15:29:29.049556 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786375520124696-18706-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786375520124696-18706-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786375520124696-18706-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.190:37609
--webserver_interface=127.18.68.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab
--principal=kudu/127.18.68.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:40553
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.68.190:37609
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:29:29.134042 17988 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:29:29.134284 17988 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:29:29.134307 17988 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:29:29.135495 17988 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 15:29:29.135538 17988 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:29:29.135553 17988 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:29:29.135565 17988 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 15:29:29.135577 17988 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 15:29:29.137116 17988 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:40553
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786375520124696-18706-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786375520124696-18706-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.68.190:37609
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab
--principal=kudu/127.18.68.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.190:37609
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.68.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17988
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786375520124696-18706-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:29:29.137401 17988 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:29:29.137655 17988 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:29:29.142869 17998 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:29:29.142899 17988 server_base.cc:1034] running on GCE node
W20260810 15:29:29.142925 17999 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:29:29.142869 18003 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:29:29.143306 17988 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:29:29.143630 17988 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:29:29.144802 17988 hybrid_clock.cc:648] HybridClock initialized: now 1786375769144789 us; error 34 us; skew 500 ppm
Aug 10 15:29:29 dist-test-slave-2p8l krb5kdc[17967](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375769, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:29:29.147482 17988 init.cc:377] Logged in from keytab as kudu/127.18.68.190@KRBTEST.COM (short username kudu)
I20260810 15:29:29.147904 17988 webserver.cc:460] Webserver started at http://127.18.68.190:45113/ using document root <none> and password file <none>
I20260810 15:29:29.148161 17988 fs_manager.cc:359] Metadata directory not provided
I20260810 15:29:29.148211 17988 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:29:29.148365 17988 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:29:29.149466 17988 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786375520124696-18706-0/minicluster-data/master-0/data/instance:
uuid: "3ddb7fc0986c4a42a8a42cfdac2726a3"
format_stamp: "Formatted at 2026-08-10 15:29:29 on dist-test-slave-2p8l"
server_key: "43f3beddebd7a4481aea4e73996bd196"
server_key_iv: "892fa6c09555addb7b7632c0c4c094e9"
server_key_version: "encryptionkey@0"
I20260810 15:29:29.149854 17988 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786375520124696-18706-0/minicluster-data/master-0/wal/instance:
uuid: "3ddb7fc0986c4a42a8a42cfdac2726a3"
format_stamp: "Formatted at 2026-08-10 15:29:29 on dist-test-slave-2p8l"
server_key: "43f3beddebd7a4481aea4e73996bd196"
server_key_iv: "892fa6c09555addb7b7632c0c4c094e9"
server_key_version: "encryptionkey@0"
I20260810 15:29:29.151400 17988 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260810 15:29:29.152307 18025 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:29:29.152563 17988 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:29:29.152678 17988 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786375520124696-18706-0/minicluster-data/master-0/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786375520124696-18706-0/minicluster-data/master-0/wal
uuid: "3ddb7fc0986c4a42a8a42cfdac2726a3"
format_stamp: "Formatted at 2026-08-10 15:29:29 on dist-test-slave-2p8l"
server_key: "43f3beddebd7a4481aea4e73996bd196"
server_key_iv: "892fa6c09555addb7b7632c0c4c094e9"
server_key_version: "encryptionkey@0"
I20260810 15:29:29.152766 17988 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786375520124696-18706-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786375520124696-18706-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786375520124696-18706-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:29:29.168658 17988 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:29:29.171475 17988 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:29:29.171628 17988 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:29:29.176671 17988 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.190:37609
I20260810 15:29:29.176697 18118 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.190:37609 every 8 connection(s)
I20260810 15:29:29.177124 17988 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
I20260810 15:29:29.178022 18120 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:29:29.181393 18120 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3ddb7fc0986c4a42a8a42cfdac2726a3: Bootstrap starting.
I20260810 15:29:29.182181 18120 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3ddb7fc0986c4a42a8a42cfdac2726a3: Neither blocks nor log segments found. Creating new log.
I20260810 15:29:29.182613 18120 log.cc:824] T 00000000000000000000000000000000 P 3ddb7fc0986c4a42a8a42cfdac2726a3: Log is configured to *not* fsync() on all Append() calls
I20260810 15:29:29.183502 18120 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3ddb7fc0986c4a42a8a42cfdac2726a3: No bootstrap required, opened a new log
I20260810 15:29:29.185729 18120 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3ddb7fc0986c4a42a8a42cfdac2726a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ddb7fc0986c4a42a8a42cfdac2726a3" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 37609 } }
I20260810 15:29:29.185938 18120 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3ddb7fc0986c4a42a8a42cfdac2726a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:29:29.185976 18120 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3ddb7fc0986c4a42a8a42cfdac2726a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ddb7fc0986c4a42a8a42cfdac2726a3, State: Initialized, Role: FOLLOWER
I20260810 15:29:29.186156 18120 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3ddb7fc0986c4a42a8a42cfdac2726a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ddb7fc0986c4a42a8a42cfdac2726a3" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 37609 } }
I20260810 15:29:29.186245 18120 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3ddb7fc0986c4a42a8a42cfdac2726a3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 15:29:29.186276 18120 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3ddb7fc0986c4a42a8a42cfdac2726a3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 15:29:29.186319 18120 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3ddb7fc0986c4a42a8a42cfdac2726a3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:29:29.186407 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 17988
I20260810 15:29:29.186507 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786375520124696-18706-0/minicluster-data/master-0/wal/instance
I20260810 15:29:29.186717 18706 external_mini_cluster.cc:1428] Setting key 69d994f7c1fd8e6230c06459b341fbbc
I20260810 15:29:29.187016 18120 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3ddb7fc0986c4a42a8a42cfdac2726a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ddb7fc0986c4a42a8a42cfdac2726a3" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 37609 } }
I20260810 15:29:29.187129 18120 leader_election.cc:302] T 00000000000000000000000000000000 P 3ddb7fc0986c4a42a8a42cfdac2726a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3ddb7fc0986c4a42a8a42cfdac2726a3; no voters:
I20260810 15:29:29.187305 18120 leader_election.cc:288] T 00000000000000000000000000000000 P 3ddb7fc0986c4a42a8a42cfdac2726a3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 15:29:29.187419 18125 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3ddb7fc0986c4a42a8a42cfdac2726a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 15:29:29.187606 18125 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3ddb7fc0986c4a42a8a42cfdac2726a3 [term 1 LEADER]: Becoming Leader. State: Replica: 3ddb7fc0986c4a42a8a42cfdac2726a3, State: Running, Role: LEADER
I20260810 15:29:29.187654 18120 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3ddb7fc0986c4a42a8a42cfdac2726a3 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 15:29:29.189328 18125 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3ddb7fc0986c4a42a8a42cfdac2726a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ddb7fc0986c4a42a8a42cfdac2726a3" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 37609 } }
I20260810 15:29:29.189901 18128 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ddb7fc0986c4a42a8a42cfdac2726a3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3ddb7fc0986c4a42a8a42cfdac2726a3. Latest consensus state: current_term: 1 leader_uuid: "3ddb7fc0986c4a42a8a42cfdac2726a3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ddb7fc0986c4a42a8a42cfdac2726a3" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 37609 } } }
I20260810 15:29:29.192344 18128 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ddb7fc0986c4a42a8a42cfdac2726a3 [sys.catalog]: This master's current role is: LEADER
I20260810 15:29:29.190021 18129 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ddb7fc0986c4a42a8a42cfdac2726a3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3ddb7fc0986c4a42a8a42cfdac2726a3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ddb7fc0986c4a42a8a42cfdac2726a3" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 37609 } } }
I20260810 15:29:29.192538 18129 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ddb7fc0986c4a42a8a42cfdac2726a3 [sys.catalog]: This master's current role is: LEADER
W20260810 15:29:29.190819 18151 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3ddb7fc0986c4a42a8a42cfdac2726a3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 15:29:29.192587 18151 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 15:29:29.192644 18158 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 15:29:29.192806 18158 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 15:29:29.194545 18158 catalog_manager.cc:1347] Generated new cluster ID: d5f0715036b94b658c32a9a79e094625
I20260810 15:29:29.194598 18158 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 10 15:29:29 dist-test-slave-2p8l krb5kdc[17967](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375769, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
I20260810 15:29:29.198917 18158 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 15:29:29.199590 18158 catalog_manager.cc:1504] Loading token signing keys...
I20260810 15:29:29.200569 18127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:29.187355 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49042 (local address 127.18.68.190:37609)
0810 15:29:29.187542 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0810 15:29:29.187553 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 15:29:29.188425 (+ 872us) server_negotiation.cc:407] Connection header received
0810 15:29:29.188586 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:29:29.188592 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:29:29.188638 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:29:29.188807 (+ 169us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:29:29.189683 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:29.191091 (+ 1408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:29.192307 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:29.192930 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:29.193048 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:29.196057 (+ 3009us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:29:29.196062 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:29:29.196062 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:29:29.196075 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:29:29.198820 (+ 2745us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:29:29.199287 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:29:29.199290 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:29:29.199291 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:29:29.199402 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:29:29.199658 (+ 256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:29:29.199659 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:29:29.199659 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:29:29.199929 (+ 270us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:29:29.200090 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0810 15:29:29.200213 (+ 123us) server_negotiation.cc:299] Negotiation successful
0810 15:29:29.200359 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134,"thread_start_us":77,"threads_started":1}
I20260810 15:29:29.207747 18158 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3ddb7fc0986c4a42a8a42cfdac2726a3: Generated new TSK 0
I20260810 15:29:29.207955 18158 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.18.68.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.68.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.68.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.129.keytab.
Entry for principal kudu/127.18.68.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.129.keytab.
I20260810 15:29:29.245612 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786375520124696-18706-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786375520124696-18706-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786375520124696-18706-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786375520124696-18706-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.68.129:0
--local_ip_for_outbound_sockets=127.18.68.129
--webserver_interface=127.18.68.129
--webserver_port=0
--tserver_master_addrs=127.18.68.190:37609
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.129.keytab
--principal=kudu/127.18.68.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:40553
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:29:29.336189 18166 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:29:29.336387 18166 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:29:29.336410 18166 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:29:29.337607 18166 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:29:29.337654 18166 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:29:29.337680 18166 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.68.129
I20260810 15:29:29.339216 18166 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:40553
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786375520124696-18706-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786375520124696-18706-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.129.keytab
--principal=kudu/127.18.68.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.68.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786375520124696-18706-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.68.129
--webserver_port=0
--tserver_master_addrs=127.18.68.190:37609
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18166
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.68.129
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786375520124696-18706-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:29:29.339481 18166 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:29:29.339738 18166 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:29:29.345705 18182 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:29:29.345701 18180 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:29:29.345767 18186 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:29:29.346029 18166 server_base.cc:1034] running on GCE node
I20260810 15:29:29.346360 18166 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:29:29.346632 18166 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:29:29.347810 18166 hybrid_clock.cc:648] HybridClock initialized: now 1786375769347788 us; error 36 us; skew 500 ppm
Aug 10 15:29:29 dist-test-slave-2p8l krb5kdc[17967](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375769, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:29:29.350657 18166 init.cc:377] Logged in from keytab as kudu/127.18.68.129@KRBTEST.COM (short username kudu)
I20260810 15:29:29.351295 18166 webserver.cc:460] Webserver started at http://127.18.68.129:42893/ using document root <none> and password file <none>
I20260810 15:29:29.351601 18166 fs_manager.cc:359] Metadata directory not provided
I20260810 15:29:29.351671 18166 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:29:29.351801 18166 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:29:29.353264 18166 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786375520124696-18706-0/minicluster-data/ts-0/data/instance:
uuid: "4cfcc2f1abff43bd879075551d8285c2"
format_stamp: "Formatted at 2026-08-10 15:29:29 on dist-test-slave-2p8l"
server_key: "7725ad9d4704e129172bcf641766830d"
server_key_iv: "dc560dab2f13a2480c3887ce52af3db0"
server_key_version: "encryptionkey@0"
I20260810 15:29:29.353704 18166 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786375520124696-18706-0/minicluster-data/ts-0/wal/instance:
uuid: "4cfcc2f1abff43bd879075551d8285c2"
format_stamp: "Formatted at 2026-08-10 15:29:29 on dist-test-slave-2p8l"
server_key: "7725ad9d4704e129172bcf641766830d"
server_key_iv: "dc560dab2f13a2480c3887ce52af3db0"
server_key_version: "encryptionkey@0"
I20260810 15:29:29.355872 18166 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260810 15:29:29.356870 18200 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:29:29.357134 18166 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:29:29.357254 18166 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786375520124696-18706-0/minicluster-data/ts-0/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786375520124696-18706-0/minicluster-data/ts-0/wal
uuid: "4cfcc2f1abff43bd879075551d8285c2"
format_stamp: "Formatted at 2026-08-10 15:29:29 on dist-test-slave-2p8l"
server_key: "7725ad9d4704e129172bcf641766830d"
server_key_iv: "dc560dab2f13a2480c3887ce52af3db0"
server_key_version: "encryptionkey@0"
I20260810 15:29:29.357350 18166 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786375520124696-18706-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786375520124696-18706-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786375520124696-18706-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:29:29.364881 18166 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:29:29.367396 18166 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:29:29.367569 18166 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:29:29.367812 18166 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 15:29:29.368147 18166 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 15:29:29.368204 18166 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 15:29:29.368238 18166 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 15:29:29.368266 18166 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 15:29:29.374310 18166 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.129:35747
I20260810 15:29:29.374349 18419 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.129:35747 every 8 connection(s)
I20260810 15:29:29.374691 18166 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786375520124696-18706-0/minicluster-data/ts-0/data/info.pb
I20260810 15:29:29.375981 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 18166
I20260810 15:29:29.376084 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786375520124696-18706-0/minicluster-data/ts-0/wal/instance
I20260810 15:29:29.376295 18706 external_mini_cluster.cc:1428] Setting key 5d0f87b76d2ecb033d01e54e3d4ca927
Aug 10 15:29:29 dist-test-slave-2p8l krb5kdc[17967](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375769, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.129@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.18.68.130@KRBTEST.COM; defaulting to no policy
I20260810 15:29:29.385531 18127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:29.375498 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.129:33369 (local address 127.18.68.190:37609)
0810 15:29:29.375569 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0810 15:29:29.375571 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:29:29.375780 (+ 209us) server_negotiation.cc:407] Connection header received
0810 15:29:29.376409 (+ 629us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:29:29.376411 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:29:29.376425 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:29:29.376498 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:29:29.377878 (+ 1380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:29.378419 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:29.379627 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:29.379861 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:29.379951 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:29.382355 (+ 2404us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:29:29.382357 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:29:29.382357 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:29:29.382366 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:29:29.383906 (+ 1540us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:29:29.384383 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:29:29.384385 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:29:29.384385 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:29:29.384453 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:29:29.384772 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:29:29.384773 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:29:29.384773 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:29:29.384946 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:29:29.385011 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0810 15:29:29.385331 (+ 320us) server_negotiation.cc:299] Negotiation successful
0810 15:29:29.385437 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260810 15:29:29.385731 18426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:29.375476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:37609 (local address 127.18.68.129:33369)
0810 15:29:29.375667 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:29.375705 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0810 15:29:29.376274 (+ 569us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:29:29.376643 (+ 369us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:29:29.376647 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:29:29.377472 (+ 825us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:29:29.377759 (+ 287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:29:29.377765 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:29:29.378513 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:29:29.378514 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:29:29.379509 (+ 995us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:29:29.379511 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:29:29.379965 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:29:29.379966 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:29:29.380119 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:29.380685 (+ 566us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:29:29.380694 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:29:29.382257 (+ 1563us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:29:29.384031 (+ 1774us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:29:29.384040 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:29:29.384042 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:29:29.384299 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:29:29.384554 (+ 255us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:29:29.384555 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:29:29.384555 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:29:29.384682 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:29:29.385011 (+ 329us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:29:29.385020 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:29:29.385177 (+ 157us) client_negotiation.cc:769] Sending connection context
0810 15:29:29.385303 (+ 126us) client_negotiation.cc:240] Negotiation successful
0810 15:29:29.385475 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":99,"threads_started":1}
I20260810 15:29:29.386260 18421 heartbeater.cc:347] Connected to a master server at 127.18.68.190:37609
I20260810 15:29:29.386380 18421 heartbeater.cc:464] Registering TS with master...
I20260810 15:29:29.386591 18421 heartbeater.cc:511] Master 127.18.68.190:37609 requested a full tablet report, sending...
I20260810 15:29:29.387105 18051 ts_manager.cc:194] Registered new tserver with Master: 4cfcc2f1abff43bd879075551d8285c2 (127.18.68.129:35747)
I20260810 15:29:29.387907 18051 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.68.129@KRBTEST.COM'} at 127.18.68.129:33369
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.68.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.68.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.130.keytab.
Entry for principal kudu/127.18.68.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.130.keytab.
I20260810 15:29:29.404577 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786375520124696-18706-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786375520124696-18706-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786375520124696-18706-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786375520124696-18706-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.68.130:0
--local_ip_for_outbound_sockets=127.18.68.130
--webserver_interface=127.18.68.130
--webserver_port=0
--tserver_master_addrs=127.18.68.190:37609
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.130.keytab
--principal=kudu/127.18.68.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:40553
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:29:29.487125 18431 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:29:29.487355 18431 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:29:29.487397 18431 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:29:29.488777 18431 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:29:29.488839 18431 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:29:29.488886 18431 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.68.130
I20260810 15:29:29.490485 18431 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:40553
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786375520124696-18706-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786375520124696-18706-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.130.keytab
--principal=kudu/127.18.68.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.68.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786375520124696-18706-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.68.130
--webserver_port=0
--tserver_master_addrs=127.18.68.190:37609
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18431
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.68.130
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786375520124696-18706-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:29:29.490765 18431 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:29:29.491003 18431 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:29:29.496106 18443 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:29:29.496145 18441 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:29:29.496112 18440 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:29:29.496343 18431 server_base.cc:1034] running on GCE node
I20260810 15:29:29.496518 18431 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:29:29.496716 18431 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:29:29.497867 18431 hybrid_clock.cc:648] HybridClock initialized: now 1786375769497850 us; error 30 us; skew 500 ppm
Aug 10 15:29:29 dist-test-slave-2p8l krb5kdc[17967](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375769, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:29:29.500515 18431 init.cc:377] Logged in from keytab as kudu/127.18.68.130@KRBTEST.COM (short username kudu)
I20260810 15:29:29.500991 18431 webserver.cc:460] Webserver started at http://127.18.68.130:40491/ using document root <none> and password file <none>
I20260810 15:29:29.501252 18431 fs_manager.cc:359] Metadata directory not provided
I20260810 15:29:29.501299 18431 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:29:29.501461 18431 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:29:29.502538 18431 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786375520124696-18706-0/minicluster-data/ts-1/data/instance:
uuid: "a3c9cf4553ab42f08c01b0345572318a"
format_stamp: "Formatted at 2026-08-10 15:29:29 on dist-test-slave-2p8l"
server_key: "c515b95b041c5b965ed1c399f1c9d868"
server_key_iv: "8010708353eb122f4b1bef5ed053edf2"
server_key_version: "encryptionkey@0"
I20260810 15:29:29.502894 18431 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786375520124696-18706-0/minicluster-data/ts-1/wal/instance:
uuid: "a3c9cf4553ab42f08c01b0345572318a"
format_stamp: "Formatted at 2026-08-10 15:29:29 on dist-test-slave-2p8l"
server_key: "c515b95b041c5b965ed1c399f1c9d868"
server_key_iv: "8010708353eb122f4b1bef5ed053edf2"
server_key_version: "encryptionkey@0"
I20260810 15:29:29.504264 18431 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:29:29.505069 18452 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:29:29.505302 18431 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:29:29.505417 18431 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786375520124696-18706-0/minicluster-data/ts-1/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786375520124696-18706-0/minicluster-data/ts-1/wal
uuid: "a3c9cf4553ab42f08c01b0345572318a"
format_stamp: "Formatted at 2026-08-10 15:29:29 on dist-test-slave-2p8l"
server_key: "c515b95b041c5b965ed1c399f1c9d868"
server_key_iv: "8010708353eb122f4b1bef5ed053edf2"
server_key_version: "encryptionkey@0"
I20260810 15:29:29.505499 18431 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786375520124696-18706-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786375520124696-18706-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786375520124696-18706-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:29:29.516860 18431 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:29:29.519205 18431 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:29:29.519371 18431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:29:29.519629 18431 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 15:29:29.519956 18431 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 15:29:29.519991 18431 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 15:29:29.520015 18431 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 15:29:29.520066 18431 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 15:29:29.525935 18431 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.130:33949
I20260810 15:29:29.526015 18660 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.130:33949 every 8 connection(s)
I20260810 15:29:29.526345 18431 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786375520124696-18706-0/minicluster-data/ts-1/data/info.pb
I20260810 15:29:29.530102 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 18431
I20260810 15:29:29.530252 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786375520124696-18706-0/minicluster-data/ts-1/wal/instance
I20260810 15:29:29.530503 18706 external_mini_cluster.cc:1428] Setting key ef3f93712e3671bc74fbe9b3dbe3f242
Aug 10 15:29:29 dist-test-slave-2p8l krb5kdc[17967](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375769, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.130@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
I20260810 15:29:29.536326 18127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:29.527129 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.130:41819 (local address 127.18.68.190:37609)
0810 15:29:29.527201 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0810 15:29:29.527205 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 15:29:29.527402 (+ 197us) server_negotiation.cc:407] Connection header received
0810 15:29:29.527876 (+ 474us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:29:29.527877 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:29:29.527888 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:29:29.527941 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:29:29.528850 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:29.529338 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:29.530391 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:29.530700 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:29.530772 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:29.533275 (+ 2503us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:29:29.533276 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:29:29.533276 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:29:29.533284 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:29:29.534831 (+ 1547us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:29:29.535301 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:29:29.535303 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:29:29.535303 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:29:29.535371 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:29:29.535627 (+ 256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:29:29.535628 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:29:29.535628 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:29:29.535782 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:29:29.535866 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0810 15:29:29.536146 (+ 280us) server_negotiation.cc:299] Negotiation successful
0810 15:29:29.536229 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260810 15:29:29.536540 18665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:29.527077 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:37609 (local address 127.18.68.130:41819)
0810 15:29:29.527278 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:29.527315 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0810 15:29:29.527793 (+ 478us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:29:29.527992 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:29:29.527995 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:29:29.528566 (+ 571us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:29:29.528759 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:29:29.528764 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:29:29.529427 (+ 663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:29:29.529427 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:29:29.530307 (+ 880us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:29:29.530310 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:29:29.530801 (+ 491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:29:29.530803 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:29:29.530948 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:29.531496 (+ 548us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:29:29.531507 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:29:29.533147 (+ 1640us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:29:29.534955 (+ 1808us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:29:29.534963 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:29:29.534965 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:29:29.535217 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:29:29.535449 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:29:29.535450 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:29:29.535450 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:29:29.535556 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:29:29.535869 (+ 313us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:29:29.535877 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:29:29.536014 (+ 137us) client_negotiation.cc:769] Sending connection context
0810 15:29:29.536123 (+ 109us) client_negotiation.cc:240] Negotiation successful
0810 15:29:29.536296 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":113,"threads_started":1}
I20260810 15:29:29.537087 18663 heartbeater.cc:347] Connected to a master server at 127.18.68.190:37609
I20260810 15:29:29.537205 18663 heartbeater.cc:464] Registering TS with master...
I20260810 15:29:29.537431 18663 heartbeater.cc:511] Master 127.18.68.190:37609 requested a full tablet report, sending...
I20260810 15:29:29.537864 18051 ts_manager.cc:194] Registered new tserver with Master: a3c9cf4553ab42f08c01b0345572318a (127.18.68.130:33949)
I20260810 15:29:29.538430 18051 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.68.130@KRBTEST.COM'} at 127.18.68.130:41819
WARNING: no policy specified for kudu/127.18.68.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.68.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.68.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.131.keytab.
Entry for principal kudu/127.18.68.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.131.keytab.
I20260810 15:29:29.561713 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786375520124696-18706-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786375520124696-18706-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786375520124696-18706-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786375520124696-18706-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.68.131:0
--local_ip_for_outbound_sockets=127.18.68.131
--webserver_interface=127.18.68.131
--webserver_port=0
--tserver_master_addrs=127.18.68.190:37609
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.131.keytab
--principal=kudu/127.18.68.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:40553
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:29:29.645896 18668 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:29:29.646135 18668 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:29:29.646162 18668 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:29:29.647318 18668 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:29:29.647364 18668 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:29:29.647390 18668 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.68.131
I20260810 15:29:29.648864 18668 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:40553
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786375520124696-18706-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786375520124696-18706-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.131.keytab
--principal=kudu/127.18.68.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.68.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786375520124696-18706-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.68.131
--webserver_port=0
--tserver_master_addrs=127.18.68.190:37609
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18668
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.68.131
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786375520124696-18706-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:29:29.649106 18668 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:29:29.649358 18668 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:29:29.654809 18682 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:29:29.654947 18684 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:29:29.655092 18679 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:29:29.655736 18668 server_base.cc:1034] running on GCE node
I20260810 15:29:29.656020 18668 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:29:29.656361 18668 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:29:29.657547 18668 hybrid_clock.cc:648] HybridClock initialized: now 1786375769657530 us; error 37 us; skew 500 ppm
Aug 10 15:29:29 dist-test-slave-2p8l krb5kdc[17967](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375769, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:29:29.664419 18668 init.cc:377] Logged in from keytab as kudu/127.18.68.131@KRBTEST.COM (short username kudu)
I20260810 15:29:29.665026 18668 webserver.cc:460] Webserver started at http://127.18.68.131:36175/ using document root <none> and password file <none>
I20260810 15:29:29.665247 18668 fs_manager.cc:359] Metadata directory not provided
I20260810 15:29:29.665294 18668 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:29:29.665452 18668 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:29:29.666745 18668 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786375520124696-18706-0/minicluster-data/ts-2/data/instance:
uuid: "96c16337542e43d4b14d04bb58c4d2e5"
format_stamp: "Formatted at 2026-08-10 15:29:29 on dist-test-slave-2p8l"
server_key: "b9567252842facf3645b60dce546014c"
server_key_iv: "9e088103fcd4c1b81d2f6742f8fa451a"
server_key_version: "encryptionkey@0"
I20260810 15:29:29.667147 18668 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786375520124696-18706-0/minicluster-data/ts-2/wal/instance:
uuid: "96c16337542e43d4b14d04bb58c4d2e5"
format_stamp: "Formatted at 2026-08-10 15:29:29 on dist-test-slave-2p8l"
server_key: "b9567252842facf3645b60dce546014c"
server_key_iv: "9e088103fcd4c1b81d2f6742f8fa451a"
server_key_version: "encryptionkey@0"
I20260810 15:29:29.668756 18668 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 15:29:29.669629 18692 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:29:29.669879 18668 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:29:29.670006 18668 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786375520124696-18706-0/minicluster-data/ts-2/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786375520124696-18706-0/minicluster-data/ts-2/wal
uuid: "96c16337542e43d4b14d04bb58c4d2e5"
format_stamp: "Formatted at 2026-08-10 15:29:29 on dist-test-slave-2p8l"
server_key: "b9567252842facf3645b60dce546014c"
server_key_iv: "9e088103fcd4c1b81d2f6742f8fa451a"
server_key_version: "encryptionkey@0"
I20260810 15:29:29.670131 18668 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786375520124696-18706-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786375520124696-18706-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786375520124696-18706-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:29:29.679816 18668 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:29:29.681905 18668 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:29:29.682073 18668 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:29:29.682422 18668 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 15:29:29.682787 18668 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 15:29:29.682826 18668 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 15:29:29.682852 18668 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 15:29:29.682901 18668 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 15:29:29.690332 18668 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.131:34907
I20260810 15:29:29.690433 18936 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.131:34907 every 8 connection(s)
I20260810 15:29:29.690806 18668 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786375520124696-18706-0/minicluster-data/ts-2/data/info.pb
Aug 10 15:29:29 dist-test-slave-2p8l krb5kdc[17967](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375769, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.131@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
I20260810 15:29:29.698141 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 18668
I20260810 15:29:29.698266 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786375520124696-18706-0/minicluster-data/ts-2/wal/instance
I20260810 15:29:29.698509 18706 external_mini_cluster.cc:1428] Setting key 937c5878ae0586d94e714af6cf6c2b66
I20260810 15:29:29.701514 18127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:29.691660 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.131:60075 (local address 127.18.68.190:37609)
0810 15:29:29.691735 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0810 15:29:29.691737 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:29:29.691968 (+ 231us) server_negotiation.cc:407] Connection header received
0810 15:29:29.692466 (+ 498us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:29:29.692468 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:29:29.692478 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:29:29.692537 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:29:29.693925 (+ 1388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:29.694551 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:29.695691 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:29.695883 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:29.695952 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:29.698486 (+ 2534us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:29:29.698488 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:29:29.698488 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:29:29.698495 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:29:29.700020 (+ 1525us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:29:29.700421 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:29:29.700422 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:29:29.700422 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:29:29.700475 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:29:29.700836 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:29:29.700841 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:29:29.700841 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:29:29.700957 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:29:29.701011 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0810 15:29:29.701373 (+ 362us) server_negotiation.cc:299] Negotiation successful
0810 15:29:29.701447 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260810 15:29:29.701723 18942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:29.691638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:37609 (local address 127.18.68.131:60075)
0810 15:29:29.691838 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:29.691883 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0810 15:29:29.692378 (+ 495us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:29:29.692656 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:29:29.692660 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:29:29.693573 (+ 913us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:29:29.693801 (+ 228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:29:29.693807 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:29:29.694665 (+ 858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:29:29.694666 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:29:29.695594 (+ 928us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:29:29.695598 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:29:29.696000 (+ 402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:29:29.696001 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:29:29.696134 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:29.696722 (+ 588us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:29:29.696731 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:29:29.698386 (+ 1655us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:29:29.700113 (+ 1727us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:29:29.700120 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:29:29.700122 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:29:29.700346 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:29:29.700596 (+ 250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:29:29.700597 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:29:29.700597 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:29:29.700758 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:29:29.701057 (+ 299us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:29:29.701066 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:29:29.701201 (+ 135us) client_negotiation.cc:769] Sending connection context
0810 15:29:29.701326 (+ 125us) client_negotiation.cc:240] Negotiation successful
0810 15:29:29.701471 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":114,"threads_started":1}
I20260810 15:29:29.702359 18938 heartbeater.cc:347] Connected to a master server at 127.18.68.190:37609
I20260810 15:29:29.702486 18938 heartbeater.cc:464] Registering TS with master...
I20260810 15:29:29.702708 18938 heartbeater.cc:511] Master 127.18.68.190:37609 requested a full tablet report, sending...
I20260810 15:29:29.703131 18051 ts_manager.cc:194] Registered new tserver with Master: 96c16337542e43d4b14d04bb58c4d2e5 (127.18.68.131:34907)
I20260810 15:29:29.703562 18051 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.68.131@KRBTEST.COM'} at 127.18.68.131:60075
I20260810 15:29:29.710491 18706 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 15:29:29.718803 18127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:29.711895 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49050 (local address 127.18.68.190:37609)
0810 15:29:29.711990 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0810 15:29:29.711992 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:29:29.712099 (+ 107us) server_negotiation.cc:407] Connection header received
0810 15:29:29.712208 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:29:29.712209 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:29:29.712220 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:29:29.712286 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:29:29.712868 (+ 582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:29.713365 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:29.714113 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:29.714325 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:29.714399 (+ 74us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:29.715897 (+ 1498us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:29:29.715898 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:29:29.715899 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:29:29.715907 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:29:29.717260 (+ 1353us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:29:29.717700 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:29:29.717701 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:29:29.717702 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:29:29.717769 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:29:29.718005 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:29:29.718006 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:29:29.718006 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:29:29.718312 (+ 306us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:29:29.718464 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0810 15:29:29.718613 (+ 149us) server_negotiation.cc:299] Negotiation successful
0810 15:29:29.718686 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260810 15:29:29.721094 18051 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49050:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 15:29:29.722929 18051 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 15:29:29.730208 18966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:29.725926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48720 (local address 127.18.68.131:34907)
0810 15:29:29.726188 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0810 15:29:29.726193 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 15:29:29.726206 (+ 13us) server_negotiation.cc:407] Connection header received
0810 15:29:29.726251 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:29:29.726254 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:29:29.726271 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:29:29.726351 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:29:29.726545 (+ 194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:29.727755 (+ 1210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:29.729006 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:29.729748 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:29.729831 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:29.729888 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0810 15:29:29.729963 (+ 75us) server_negotiation.cc:299] Negotiation successful
0810 15:29:29.730007 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":228,"thread_start_us":111,"threads_started":1}
I20260810 15:29:29.730240 18964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:29.725929 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60254 (local address 127.18.68.129:35747)
0810 15:29:29.726179 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0810 15:29:29.726185 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 15:29:29.726408 (+ 223us) server_negotiation.cc:407] Connection header received
0810 15:29:29.726454 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:29:29.726456 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:29:29.726472 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:29:29.726542 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:29:29.726768 (+ 226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:29.727471 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:29.729040 (+ 1569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:29.729570 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:29.729690 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:29.729757 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0810 15:29:29.730117 (+ 360us) server_negotiation.cc:299] Negotiation successful
0810 15:29:29.730173 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":214,"thread_start_us":103,"threads_started":1}
I20260810 15:29:29.730417 18961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:29.725680 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.129:35747 (local address 127.0.0.1:60254)
0810 15:29:29.726290 (+ 610us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:29.726299 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 15:29:29.726346 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:29:29.726627 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:29:29.726628 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:29:29.726630 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:29:29.726685 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:29:29.726687 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:29:29.727591 (+ 904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:29:29.727592 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:29:29.728930 (+ 1338us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:29:29.728933 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:29:29.729706 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:29:29.729707 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:29:29.729803 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:29.729821 (+ 18us) client_negotiation.cc:769] Sending connection context
0810 15:29:29.729894 (+ 73us) client_negotiation.cc:240] Negotiation successful
0810 15:29:29.729959 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":591,"mutex_wait_us":41,"thread_start_us":104,"threads_started":1}
I20260810 15:29:29.730436 18962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:29.725747 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46908 (local address 127.18.68.130:33949)
0810 15:29:29.726498 (+ 751us) server_negotiation.cc:206] Beginning negotiation
0810 15:29:29.726502 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 15:29:29.726511 (+ 9us) server_negotiation.cc:407] Connection header received
0810 15:29:29.726551 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:29:29.726553 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:29:29.726568 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:29:29.726649 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:29:29.726739 (+ 90us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:29.727788 (+ 1049us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:29.729074 (+ 1286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:29.729770 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:29.729832 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:29.729888 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0810 15:29:29.730272 (+ 384us) server_negotiation.cc:299] Negotiation successful
0810 15:29:29.730334 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":709,"thread_start_us":99,"threads_started":1}
I20260810 15:29:29.730553 18957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:29.725602 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.130:33949 (local address 127.0.0.1:46908)
0810 15:29:29.725963 (+ 361us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:29.726016 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0810 15:29:29.726126 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:29:29.726652 (+ 526us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:29:29.726653 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:29:29.726654 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:29:29.726689 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:29:29.726690 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:29:29.727895 (+ 1205us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:29:29.727896 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:29:29.728993 (+ 1097us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:29:29.728996 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:29:29.729927 (+ 931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:29:29.729928 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:29:29.729995 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:29.730000 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 15:29:29.730051 (+ 51us) client_negotiation.cc:240] Negotiation successful
0810 15:29:29.730485 (+ 434us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":329,"mutex_wait_us":4,"thread_start_us":83,"threads_started":1}
I20260810 15:29:29.730429 18959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:29.725668 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.131:34907 (local address 127.0.0.1:48720)
0810 15:29:29.725979 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:29.726030 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0810 15:29:29.726121 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:29:29.726354 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:29:29.726357 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:29:29.726360 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:29:29.726454 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:29:29.726456 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:29:29.727886 (+ 1430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:29:29.727887 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:29:29.728907 (+ 1020us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:29:29.728910 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:29:29.729827 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:29:29.729828 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:29:29.729897 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:29.729900 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 15:29:29.729951 (+ 51us) client_negotiation.cc:240] Negotiation successful
0810 15:29:29.729980 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":287,"mutex_wait_us":46,"thread_start_us":102,"threads_started":1}
I20260810 15:29:29.731262 18293 tablet_service.cc:1467] Processing CreateTablet for tablet aa3406e0ec07410fb0a46bd0def22c00 (DEFAULT_TABLE table=test-table [id=a95dd3b9084d4dc1aee1ba772fde1599]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 15:29:29.731298 18541 tablet_service.cc:1467] Processing CreateTablet for tablet aa3406e0ec07410fb0a46bd0def22c00 (DEFAULT_TABLE table=test-table [id=a95dd3b9084d4dc1aee1ba772fde1599]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 15:29:29.731647 18541 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aa3406e0ec07410fb0a46bd0def22c00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:29:29.731657 18293 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aa3406e0ec07410fb0a46bd0def22c00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:29:29.734730 18813 tablet_service.cc:1467] Processing CreateTablet for tablet aa3406e0ec07410fb0a46bd0def22c00 (DEFAULT_TABLE table=test-table [id=a95dd3b9084d4dc1aee1ba772fde1599]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 15:29:29.735116 18813 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aa3406e0ec07410fb0a46bd0def22c00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:29:29.735352 18971 tablet_bootstrap.cc:492] T aa3406e0ec07410fb0a46bd0def22c00 P 4cfcc2f1abff43bd879075551d8285c2: Bootstrap starting.
I20260810 15:29:29.735527 18969 tablet_bootstrap.cc:492] T aa3406e0ec07410fb0a46bd0def22c00 P a3c9cf4553ab42f08c01b0345572318a: Bootstrap starting.
I20260810 15:29:29.736265 18969 tablet_bootstrap.cc:654] T aa3406e0ec07410fb0a46bd0def22c00 P a3c9cf4553ab42f08c01b0345572318a: Neither blocks nor log segments found. Creating new log.
I20260810 15:29:29.736891 18969 log.cc:824] T aa3406e0ec07410fb0a46bd0def22c00 P a3c9cf4553ab42f08c01b0345572318a: Log is configured to *not* fsync() on all Append() calls
I20260810 15:29:29.737816 18971 tablet_bootstrap.cc:654] T aa3406e0ec07410fb0a46bd0def22c00 P 4cfcc2f1abff43bd879075551d8285c2: Neither blocks nor log segments found. Creating new log.
I20260810 15:29:29.737854 18969 tablet_bootstrap.cc:492] T aa3406e0ec07410fb0a46bd0def22c00 P a3c9cf4553ab42f08c01b0345572318a: No bootstrap required, opened a new log
I20260810 15:29:29.737942 18969 ts_tablet_manager.cc:1397] T aa3406e0ec07410fb0a46bd0def22c00 P a3c9cf4553ab42f08c01b0345572318a: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 15:29:29.738435 18971 log.cc:824] T aa3406e0ec07410fb0a46bd0def22c00 P 4cfcc2f1abff43bd879075551d8285c2: Log is configured to *not* fsync() on all Append() calls
I20260810 15:29:29.739223 18971 tablet_bootstrap.cc:492] T aa3406e0ec07410fb0a46bd0def22c00 P 4cfcc2f1abff43bd879075551d8285c2: No bootstrap required, opened a new log
I20260810 15:29:29.739277 18971 ts_tablet_manager.cc:1397] T aa3406e0ec07410fb0a46bd0def22c00 P 4cfcc2f1abff43bd879075551d8285c2: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260810 15:29:29.739805 18969 raft_consensus.cc:348] T aa3406e0ec07410fb0a46bd0def22c00 P a3c9cf4553ab42f08c01b0345572318a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3c9cf4553ab42f08c01b0345572318a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 33949 } } peers { permanent_uuid: "4cfcc2f1abff43bd879075551d8285c2" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35747 } } peers { permanent_uuid: "96c16337542e43d4b14d04bb58c4d2e5" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 34907 } }
I20260810 15:29:29.739967 18969 raft_consensus.cc:374] T aa3406e0ec07410fb0a46bd0def22c00 P a3c9cf4553ab42f08c01b0345572318a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:29:29.740015 18969 raft_consensus.cc:729] T aa3406e0ec07410fb0a46bd0def22c00 P a3c9cf4553ab42f08c01b0345572318a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3c9cf4553ab42f08c01b0345572318a, State: Initialized, Role: FOLLOWER
I20260810 15:29:29.738878 18974 tablet_bootstrap.cc:492] T aa3406e0ec07410fb0a46bd0def22c00 P 96c16337542e43d4b14d04bb58c4d2e5: Bootstrap starting.
I20260810 15:29:29.740182 18969 consensus_queue.cc:260] T aa3406e0ec07410fb0a46bd0def22c00 P a3c9cf4553ab42f08c01b0345572318a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3c9cf4553ab42f08c01b0345572318a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 33949 } } peers { permanent_uuid: "4cfcc2f1abff43bd879075551d8285c2" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35747 } } peers { permanent_uuid: "96c16337542e43d4b14d04bb58c4d2e5" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 34907 } }
I20260810 15:29:29.740515 18663 heartbeater.cc:503] Master 127.18.68.190:37609 was elected leader, sending a full tablet report...
I20260810 15:29:29.740517 18969 ts_tablet_manager.cc:1428] T aa3406e0ec07410fb0a46bd0def22c00 P a3c9cf4553ab42f08c01b0345572318a: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 15:29:29.741098 18974 tablet_bootstrap.cc:654] T aa3406e0ec07410fb0a46bd0def22c00 P 96c16337542e43d4b14d04bb58c4d2e5: Neither blocks nor log segments found. Creating new log.
I20260810 15:29:29.741062 18971 raft_consensus.cc:348] T aa3406e0ec07410fb0a46bd0def22c00 P 4cfcc2f1abff43bd879075551d8285c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3c9cf4553ab42f08c01b0345572318a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 33949 } } peers { permanent_uuid: "4cfcc2f1abff43bd879075551d8285c2" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35747 } } peers { permanent_uuid: "96c16337542e43d4b14d04bb58c4d2e5" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 34907 } }
I20260810 15:29:29.741273 18971 raft_consensus.cc:374] T aa3406e0ec07410fb0a46bd0def22c00 P 4cfcc2f1abff43bd879075551d8285c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:29:29.741325 18971 raft_consensus.cc:729] T aa3406e0ec07410fb0a46bd0def22c00 P 4cfcc2f1abff43bd879075551d8285c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cfcc2f1abff43bd879075551d8285c2, State: Initialized, Role: FOLLOWER
I20260810 15:29:29.741457 18971 consensus_queue.cc:260] T aa3406e0ec07410fb0a46bd0def22c00 P 4cfcc2f1abff43bd879075551d8285c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3c9cf4553ab42f08c01b0345572318a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 33949 } } peers { permanent_uuid: "4cfcc2f1abff43bd879075551d8285c2" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35747 } } peers { permanent_uuid: "96c16337542e43d4b14d04bb58c4d2e5" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 34907 } }
I20260810 15:29:29.741744 18974 log.cc:824] T aa3406e0ec07410fb0a46bd0def22c00 P 96c16337542e43d4b14d04bb58c4d2e5: Log is configured to *not* fsync() on all Append() calls
I20260810 15:29:29.741768 18971 ts_tablet_manager.cc:1428] T aa3406e0ec07410fb0a46bd0def22c00 P 4cfcc2f1abff43bd879075551d8285c2: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260810 15:29:29.741919 18421 heartbeater.cc:503] Master 127.18.68.190:37609 was elected leader, sending a full tablet report...
I20260810 15:29:29.742573 18974 tablet_bootstrap.cc:492] T aa3406e0ec07410fb0a46bd0def22c00 P 96c16337542e43d4b14d04bb58c4d2e5: No bootstrap required, opened a new log
I20260810 15:29:29.742661 18974 ts_tablet_manager.cc:1397] T aa3406e0ec07410fb0a46bd0def22c00 P 96c16337542e43d4b14d04bb58c4d2e5: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260810 15:29:29.744033 18974 raft_consensus.cc:348] T aa3406e0ec07410fb0a46bd0def22c00 P 96c16337542e43d4b14d04bb58c4d2e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3c9cf4553ab42f08c01b0345572318a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 33949 } } peers { permanent_uuid: "4cfcc2f1abff43bd879075551d8285c2" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35747 } } peers { permanent_uuid: "96c16337542e43d4b14d04bb58c4d2e5" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 34907 } }
I20260810 15:29:29.744189 18974 raft_consensus.cc:374] T aa3406e0ec07410fb0a46bd0def22c00 P 96c16337542e43d4b14d04bb58c4d2e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:29:29.744238 18974 raft_consensus.cc:729] T aa3406e0ec07410fb0a46bd0def22c00 P 96c16337542e43d4b14d04bb58c4d2e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96c16337542e43d4b14d04bb58c4d2e5, State: Initialized, Role: FOLLOWER
I20260810 15:29:29.744354 18974 consensus_queue.cc:260] T aa3406e0ec07410fb0a46bd0def22c00 P 96c16337542e43d4b14d04bb58c4d2e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3c9cf4553ab42f08c01b0345572318a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 33949 } } peers { permanent_uuid: "4cfcc2f1abff43bd879075551d8285c2" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35747 } } peers { permanent_uuid: "96c16337542e43d4b14d04bb58c4d2e5" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 34907 } }
I20260810 15:29:29.744640 18974 ts_tablet_manager.cc:1428] T aa3406e0ec07410fb0a46bd0def22c00 P 96c16337542e43d4b14d04bb58c4d2e5: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 15:29:29.744717 18938 heartbeater.cc:503] Master 127.18.68.190:37609 was elected leader, sending a full tablet report...
W20260810 15:29:29.776949 18664 tablet.cc:2369] T aa3406e0ec07410fb0a46bd0def22c00 P a3c9cf4553ab42f08c01b0345572318a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 15:29:29.875512 18422 tablet.cc:2369] T aa3406e0ec07410fb0a46bd0def22c00 P 4cfcc2f1abff43bd879075551d8285c2: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 15:29:29.941474 18940 tablet.cc:2369] T aa3406e0ec07410fb0a46bd0def22c00 P 96c16337542e43d4b14d04bb58c4d2e5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 15:29:29.975410 18980 raft_consensus.cc:482] T aa3406e0ec07410fb0a46bd0def22c00 P 96c16337542e43d4b14d04bb58c4d2e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 15:29:29.975545 18980 raft_consensus.cc:504] T aa3406e0ec07410fb0a46bd0def22c00 P 96c16337542e43d4b14d04bb58c4d2e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3c9cf4553ab42f08c01b0345572318a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 33949 } } peers { permanent_uuid: "4cfcc2f1abff43bd879075551d8285c2" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35747 } } peers { permanent_uuid: "96c16337542e43d4b14d04bb58c4d2e5" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 34907 } }
I20260810 15:29:29.975977 18980 leader_election.cc:288] T aa3406e0ec07410fb0a46bd0def22c00 P 96c16337542e43d4b14d04bb58c4d2e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3c9cf4553ab42f08c01b0345572318a (127.18.68.130:33949), 4cfcc2f1abff43bd879075551d8285c2 (127.18.68.129:35747)
I20260810 15:29:29.979092 18962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:29.976312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.131:42419 (local address 127.18.68.130:33949)
0810 15:29:29.976390 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0810 15:29:29.976392 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:29:29.976404 (+ 12us) server_negotiation.cc:407] Connection header received
0810 15:29:29.976440 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:29:29.976441 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:29:29.976451 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:29:29.976558 (+ 107us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:29:29.976762 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:29.977268 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:29.978323 (+ 1055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:29.978707 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:29.978793 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:29.978804 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0810 15:29:29.978975 (+ 171us) server_negotiation.cc:299] Negotiation successful
0810 15:29:29.979019 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260810 15:29:29.979110 18942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:29.976242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.130:33949 (local address 127.18.68.131:42419)
0810 15:29:29.976304 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:29.976316 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 15:29:29.976368 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:29:29.976565 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:29:29.976566 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:29:29.976568 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:29:29.976676 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:29:29.976678 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:29:29.977359 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:29:29.977360 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:29:29.978227 (+ 867us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:29:29.978230 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:29:29.978811 (+ 581us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:29:29.978812 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:29:29.978898 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:29.978900 (+ 2us) client_negotiation.cc:769] Sending connection context
0810 15:29:29.978969 (+ 69us) client_negotiation.cc:240] Negotiation successful
0810 15:29:29.979033 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42,"mutex_wait_us":46}
I20260810 15:29:29.979099 18964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:29.976370 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.131:34063 (local address 127.18.68.129:35747)
0810 15:29:29.976436 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0810 15:29:29.976438 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:29:29.976566 (+ 128us) server_negotiation.cc:407] Connection header received
0810 15:29:29.976637 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:29:29.976639 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:29:29.976651 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:29:29.976722 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:29:29.976879 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:29.977373 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:29.978366 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:29.978721 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:29.978807 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:29.978815 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0810 15:29:29.978977 (+ 162us) server_negotiation.cc:299] Negotiation successful
0810 15:29:29.979016 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260810 15:29:29.979120 18981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:29.976242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.129:35747 (local address 127.18.68.131:34063)
0810 15:29:29.976484 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:29.976492 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0810 15:29:29.976563 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:29:29.976726 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:29:29.976727 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:29:29.976728 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:29:29.976805 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:29:29.976806 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:29:29.977462 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:29:29.977463 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:29:29.978270 (+ 807us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:29:29.978273 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:29:29.978807 (+ 534us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:29:29.978809 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:29:29.978890 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:29.978894 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 15:29:29.978958 (+ 64us) client_negotiation.cc:240] Negotiation successful
0810 15:29:29.979015 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":220,"mutex_wait_us":30,"thread_start_us":139,"threads_started":1}
I20260810 15:29:29.979478 18577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa3406e0ec07410fb0a46bd0def22c00" candidate_uuid: "96c16337542e43d4b14d04bb58c4d2e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3c9cf4553ab42f08c01b0345572318a" is_pre_election: true
I20260810 15:29:29.979526 18328 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa3406e0ec07410fb0a46bd0def22c00" candidate_uuid: "96c16337542e43d4b14d04bb58c4d2e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cfcc2f1abff43bd879075551d8285c2" is_pre_election: true
I20260810 15:29:29.979673 18577 raft_consensus.cc:2454] T aa3406e0ec07410fb0a46bd0def22c00 P a3c9cf4553ab42f08c01b0345572318a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96c16337542e43d4b14d04bb58c4d2e5 in term 0.
I20260810 15:29:29.979699 18328 raft_consensus.cc:2454] T aa3406e0ec07410fb0a46bd0def22c00 P 4cfcc2f1abff43bd879075551d8285c2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96c16337542e43d4b14d04bb58c4d2e5 in term 0.
I20260810 15:29:29.979929 18698 leader_election.cc:302] T aa3406e0ec07410fb0a46bd0def22c00 P 96c16337542e43d4b14d04bb58c4d2e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96c16337542e43d4b14d04bb58c4d2e5, a3c9cf4553ab42f08c01b0345572318a; no voters:
I20260810 15:29:29.980118 18980 raft_consensus.cc:2781] T aa3406e0ec07410fb0a46bd0def22c00 P 96c16337542e43d4b14d04bb58c4d2e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 15:29:29.980159 18980 raft_consensus.cc:482] T aa3406e0ec07410fb0a46bd0def22c00 P 96c16337542e43d4b14d04bb58c4d2e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 15:29:29.980175 18980 raft_consensus.cc:3037] T aa3406e0ec07410fb0a46bd0def22c00 P 96c16337542e43d4b14d04bb58c4d2e5 [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:29:29.980868 18980 raft_consensus.cc:504] T aa3406e0ec07410fb0a46bd0def22c00 P 96c16337542e43d4b14d04bb58c4d2e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3c9cf4553ab42f08c01b0345572318a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 33949 } } peers { permanent_uuid: "4cfcc2f1abff43bd879075551d8285c2" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35747 } } peers { permanent_uuid: "96c16337542e43d4b14d04bb58c4d2e5" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 34907 } }
I20260810 15:29:29.981019 18980 leader_election.cc:288] T aa3406e0ec07410fb0a46bd0def22c00 P 96c16337542e43d4b14d04bb58c4d2e5 [CANDIDATE]: Term 1 election: Requested vote from peers a3c9cf4553ab42f08c01b0345572318a (127.18.68.130:33949), 4cfcc2f1abff43bd879075551d8285c2 (127.18.68.129:35747)
I20260810 15:29:29.981200 18577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa3406e0ec07410fb0a46bd0def22c00" candidate_uuid: "96c16337542e43d4b14d04bb58c4d2e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3c9cf4553ab42f08c01b0345572318a"
I20260810 15:29:29.981226 18328 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa3406e0ec07410fb0a46bd0def22c00" candidate_uuid: "96c16337542e43d4b14d04bb58c4d2e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cfcc2f1abff43bd879075551d8285c2"
I20260810 15:29:29.981287 18577 raft_consensus.cc:3037] T aa3406e0ec07410fb0a46bd0def22c00 P a3c9cf4553ab42f08c01b0345572318a [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:29:29.981317 18328 raft_consensus.cc:3037] T aa3406e0ec07410fb0a46bd0def22c00 P 4cfcc2f1abff43bd879075551d8285c2 [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:29:29.982131 18328 raft_consensus.cc:2454] T aa3406e0ec07410fb0a46bd0def22c00 P 4cfcc2f1abff43bd879075551d8285c2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96c16337542e43d4b14d04bb58c4d2e5 in term 1.
I20260810 15:29:29.982151 18577 raft_consensus.cc:2454] T aa3406e0ec07410fb0a46bd0def22c00 P a3c9cf4553ab42f08c01b0345572318a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96c16337542e43d4b14d04bb58c4d2e5 in term 1.
I20260810 15:29:29.982345 18693 leader_election.cc:302] T aa3406e0ec07410fb0a46bd0def22c00 P 96c16337542e43d4b14d04bb58c4d2e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cfcc2f1abff43bd879075551d8285c2, 96c16337542e43d4b14d04bb58c4d2e5; no voters:
I20260810 15:29:29.982439 18980 raft_consensus.cc:2781] T aa3406e0ec07410fb0a46bd0def22c00 P 96c16337542e43d4b14d04bb58c4d2e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 15:29:29.982652 18980 raft_consensus.cc:686] T aa3406e0ec07410fb0a46bd0def22c00 P 96c16337542e43d4b14d04bb58c4d2e5 [term 1 LEADER]: Becoming Leader. State: Replica: 96c16337542e43d4b14d04bb58c4d2e5, State: Running, Role: LEADER
I20260810 15:29:29.982762 18980 consensus_queue.cc:237] T aa3406e0ec07410fb0a46bd0def22c00 P 96c16337542e43d4b14d04bb58c4d2e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3c9cf4553ab42f08c01b0345572318a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 33949 } } peers { permanent_uuid: "4cfcc2f1abff43bd879075551d8285c2" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35747 } } peers { permanent_uuid: "96c16337542e43d4b14d04bb58c4d2e5" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 34907 } }
I20260810 15:29:29.983641 18051 catalog_manager.cc:5495] T aa3406e0ec07410fb0a46bd0def22c00 P 96c16337542e43d4b14d04bb58c4d2e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 96c16337542e43d4b14d04bb58c4d2e5 (127.18.68.131). New cstate: current_term: 1 leader_uuid: "96c16337542e43d4b14d04bb58c4d2e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3c9cf4553ab42f08c01b0345572318a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 33949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cfcc2f1abff43bd879075551d8285c2" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96c16337542e43d4b14d04bb58c4d2e5" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 34907 } health_report { overall_health: HEALTHY } } }
I20260810 15:29:30.014276 18966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:30.011837 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48734 (local address 127.18.68.131:34907)
0810 15:29:30.011892 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0810 15:29:30.011893 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 15:29:30.011901 (+ 8us) server_negotiation.cc:407] Connection header received
0810 15:29:30.011942 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:29:30.011943 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:29:30.011968 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:29:30.012037 (+ 69us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 15:29:30.012221 (+ 184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:30.012704 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:30.013469 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:30.013708 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:30.013782 (+ 74us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:30.013923 (+ 141us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 15:29:30.014015 (+ 92us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 15:29:30.014152 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0810 15:29:30.014197 (+ 45us) server_negotiation.cc:299] Negotiation successful
0810 15:29:30.014209 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260810 15:29:30.016433 18328 raft_consensus.cc:1261] T aa3406e0ec07410fb0a46bd0def22c00 P 4cfcc2f1abff43bd879075551d8285c2 [term 1 FOLLOWER]: Refusing update from remote peer 96c16337542e43d4b14d04bb58c4d2e5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 15:29:30.016433 18577 raft_consensus.cc:1261] T aa3406e0ec07410fb0a46bd0def22c00 P a3c9cf4553ab42f08c01b0345572318a [term 1 FOLLOWER]: Refusing update from remote peer 96c16337542e43d4b14d04bb58c4d2e5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 15:29:30.016922 18982 consensus_queue.cc:1035] T aa3406e0ec07410fb0a46bd0def22c00 P 96c16337542e43d4b14d04bb58c4d2e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3c9cf4553ab42f08c01b0345572318a" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 33949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 15:29:30.017083 18980 consensus_queue.cc:1035] T aa3406e0ec07410fb0a46bd0def22c00 P 96c16337542e43d4b14d04bb58c4d2e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cfcc2f1abff43bd879075551d8285c2" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 35747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 15:29:30.020466 18990 mvcc.cc:205] Tried to move back new op lower bound from 7316995153983791104 to 7316995153849987072. Current Snapshot: MvccSnapshot[applied={T|T < 7316995153983791104}]
I20260810 15:29:30.022470 18049 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49050:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 15:29:30.022572 18049 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49050:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 15:29:30.023442 18049 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3ddb7fc0986c4a42a8a42cfdac2726a3: Sending DeleteTablet for 3 replicas of tablet aa3406e0ec07410fb0a46bd0def22c00
I20260810 15:29:30.023765 18541 tablet_service.cc:1514] Processing DeleteTablet for tablet aa3406e0ec07410fb0a46bd0def22c00 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 15:29:30 UTC) from {username='kudu', principal='kudu/127.18.68.190@KRBTEST.COM'} at 127.0.0.1:46908
I20260810 15:29:30.023834 18813 tablet_service.cc:1514] Processing DeleteTablet for tablet aa3406e0ec07410fb0a46bd0def22c00 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 15:29:30 UTC) from {username='kudu', principal='kudu/127.18.68.190@KRBTEST.COM'} at 127.0.0.1:48720
I20260810 15:29:30.024017 19007 tablet_replica.cc:330] T aa3406e0ec07410fb0a46bd0def22c00 P a3c9cf4553ab42f08c01b0345572318a: stopping tablet replica
I20260810 15:29:30.024174 19007 raft_consensus.cc:2229] T aa3406e0ec07410fb0a46bd0def22c00 P a3c9cf4553ab42f08c01b0345572318a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 15:29:30.024180 18293 tablet_service.cc:1514] Processing DeleteTablet for tablet aa3406e0ec07410fb0a46bd0def22c00 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 15:29:30 UTC) from {username='kudu', principal='kudu/127.18.68.190@KRBTEST.COM'} at 127.0.0.1:60254
I20260810 15:29:30.024333 19007 raft_consensus.cc:2258] T aa3406e0ec07410fb0a46bd0def22c00 P a3c9cf4553ab42f08c01b0345572318a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 15:29:30.024422 19008 tablet_replica.cc:330] T aa3406e0ec07410fb0a46bd0def22c00 P 96c16337542e43d4b14d04bb58c4d2e5: stopping tablet replica
I20260810 15:29:30.024592 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 18166
I20260810 15:29:30.024591 19008 raft_consensus.cc:2229] T aa3406e0ec07410fb0a46bd0def22c00 P 96c16337542e43d4b14d04bb58c4d2e5 [term 1 LEADER]: Raft consensus shutting down.
I20260810 15:29:30.024721 19008 raft_consensus.cc:2258] T aa3406e0ec07410fb0a46bd0def22c00 P 96c16337542e43d4b14d04bb58c4d2e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 15:29:30.025022 19007 ts_tablet_manager.cc:1905] T aa3406e0ec07410fb0a46bd0def22c00 P a3c9cf4553ab42f08c01b0345572318a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 15:29:30.025332 19008 ts_tablet_manager.cc:1905] T aa3406e0ec07410fb0a46bd0def22c00 P 96c16337542e43d4b14d04bb58c4d2e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 15:29:30.026747 19007 ts_tablet_manager.cc:1918] T aa3406e0ec07410fb0a46bd0def22c00 P a3c9cf4553ab42f08c01b0345572318a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 15:29:30.026814 19007 log.cc:1196] T aa3406e0ec07410fb0a46bd0def22c00 P a3c9cf4553ab42f08c01b0345572318a: Deleting WAL directory at /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786375520124696-18706-0/minicluster-data/ts-1/wal/wals/aa3406e0ec07410fb0a46bd0def22c00
I20260810 15:29:30.027066 19007 ts_tablet_manager.cc:1939] T aa3406e0ec07410fb0a46bd0def22c00 P a3c9cf4553ab42f08c01b0345572318a: Deleting consensus metadata
I20260810 15:29:30.027518 18028 catalog_manager.cc:4841] TS a3c9cf4553ab42f08c01b0345572318a (127.18.68.130:33949): tablet aa3406e0ec07410fb0a46bd0def22c00 (table test-table [id=a95dd3b9084d4dc1aee1ba772fde1599]) successfully deleted
I20260810 15:29:30.028113 19008 ts_tablet_manager.cc:1918] T aa3406e0ec07410fb0a46bd0def22c00 P 96c16337542e43d4b14d04bb58c4d2e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 15:29:30.028203 19008 log.cc:1196] T aa3406e0ec07410fb0a46bd0def22c00 P 96c16337542e43d4b14d04bb58c4d2e5: Deleting WAL directory at /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786375520124696-18706-0/minicluster-data/ts-2/wal/wals/aa3406e0ec07410fb0a46bd0def22c00
I20260810 15:29:30.028527 19008 ts_tablet_manager.cc:1939] T aa3406e0ec07410fb0a46bd0def22c00 P 96c16337542e43d4b14d04bb58c4d2e5: Deleting consensus metadata
I20260810 15:29:30.065378 18027 catalog_manager.cc:4841] TS 96c16337542e43d4b14d04bb58c4d2e5 (127.18.68.131:34907): tablet aa3406e0ec07410fb0a46bd0def22c00 (table test-table [id=a95dd3b9084d4dc1aee1ba772fde1599]) successfully deleted
W20260810 15:29:30.070516 18026 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.18.68.129:35747 (error 108)
I20260810 15:29:30.070729 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 18431
I20260810 15:29:30.072909 18957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:30.070998 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.129:35747 (local address 127.0.0.1:60264)
0810 15:29:30.072813 (+ 1815us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:30.072863 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.129:35747: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1781}
W20260810 15:29:30.085703 18026 catalog_manager.cc:4584] TS 4cfcc2f1abff43bd879075551d8285c2 (127.18.68.129:35747): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet aa3406e0ec07410fb0a46bd0def22c00: Network error: Client connection negotiation failed: client connection to 127.18.68.129:35747: connect: Connection refused (error 111)
I20260810 15:29:30.090449 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 18668
I20260810 15:29:30.109427 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 17988
2026-08-10T15:29:30Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2494 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-10T15:29:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T15:29:30Z Disabled control of system clock
I20260810 15:29:30.147254 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786375520124696-18706-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786375520124696-18706-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786375520124696-18706-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.190:43483
--webserver_interface=127.18.68.190
--webserver_port=0
--builtin_ntp_servers=127.18.68.148:34337
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.68.190:43483
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260810 15:29:30.227957 19022 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:29:30.228230 19022 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:29:30.228264 19022 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:29:30.229377 19022 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 15:29:30.229450 19022 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:29:30.229471 19022 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:29:30.229491 19022 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 15:29:30.229547 19022 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 15:29:30.230911 19022 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:34337
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786375520124696-18706-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786375520124696-18706-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.68.190:43483
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.190:43483
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.68.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19022
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786375520124696-18706-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:29:30.231207 19022 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:29:30.231508 19022 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:29:30.236424 19033 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:29:30.236388 19029 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:29:30.236404 19031 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:29:30.236617 19022 server_base.cc:1034] running on GCE node
I20260810 15:29:30.237015 19022 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:29:30.237337 19022 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:29:30.238509 19022 hybrid_clock.cc:648] HybridClock initialized: now 1786375770238501 us; error 38 us; skew 500 ppm
I20260810 15:29:30.239720 19022 webserver.cc:460] Webserver started at http://127.18.68.190:44875/ using document root <none> and password file <none>
I20260810 15:29:30.239981 19022 fs_manager.cc:359] Metadata directory not provided
I20260810 15:29:30.240054 19022 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:29:30.240208 19022 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:29:30.241274 19022 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786375520124696-18706-0/minicluster-data/master-0/data/instance:
uuid: "118266cda32d42489d20d0e00395a44f"
format_stamp: "Formatted at 2026-08-10 15:29:30 on dist-test-slave-2p8l"
server_key: "d5ba88f857eed515a6031c4043259555"
server_key_iv: "39c9d9df7df319992aa5508ef093e3c2"
server_key_version: "encryptionkey@0"
I20260810 15:29:30.241703 19022 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786375520124696-18706-0/minicluster-data/master-0/wal/instance:
uuid: "118266cda32d42489d20d0e00395a44f"
format_stamp: "Formatted at 2026-08-10 15:29:30 on dist-test-slave-2p8l"
server_key: "d5ba88f857eed515a6031c4043259555"
server_key_iv: "39c9d9df7df319992aa5508ef093e3c2"
server_key_version: "encryptionkey@0"
I20260810 15:29:30.243062 19022 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 15:29:30.243815 19043 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:29:30.244040 19022 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 15:29:30.244148 19022 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786375520124696-18706-0/minicluster-data/master-0/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786375520124696-18706-0/minicluster-data/master-0/wal
uuid: "118266cda32d42489d20d0e00395a44f"
format_stamp: "Formatted at 2026-08-10 15:29:30 on dist-test-slave-2p8l"
server_key: "d5ba88f857eed515a6031c4043259555"
server_key_iv: "39c9d9df7df319992aa5508ef093e3c2"
server_key_version: "encryptionkey@0"
I20260810 15:29:30.244226 19022 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786375520124696-18706-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786375520124696-18706-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786375520124696-18706-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:29:30.255595 19022 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:29:30.255910 19022 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:29:30.256076 19022 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:29:30.260241 19022 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.190:43483
I20260810 15:29:30.260279 19127 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.190:43483 every 8 connection(s)
I20260810 15:29:30.260645 19022 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
I20260810 15:29:30.261755 19129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:29:30.261996 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 19022
I20260810 15:29:30.262152 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786375520124696-18706-0/minicluster-data/master-0/wal/instance
I20260810 15:29:30.262409 18706 external_mini_cluster.cc:1428] Setting key ff90a2d27dc4ff3f8c29366a690fbf7f
I20260810 15:29:30.264703 19129 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 118266cda32d42489d20d0e00395a44f: Bootstrap starting.
I20260810 15:29:30.265405 19129 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 118266cda32d42489d20d0e00395a44f: Neither blocks nor log segments found. Creating new log.
I20260810 15:29:30.265724 19129 log.cc:824] T 00000000000000000000000000000000 P 118266cda32d42489d20d0e00395a44f: Log is configured to *not* fsync() on all Append() calls
I20260810 15:29:30.266537 19129 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 118266cda32d42489d20d0e00395a44f: No bootstrap required, opened a new log
I20260810 15:29:30.267982 19132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:30.262996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40820 (local address 127.18.68.190:43483)
0810 15:29:30.263250 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0810 15:29:30.263257 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 15:29:30.263281 (+ 24us) server_negotiation.cc:407] Connection header received
0810 15:29:30.263706 (+ 425us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:29:30.263713 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:29:30.263771 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:29:30.263929 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:29:30.264133 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:30.265054 (+ 921us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:30.265958 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:30.266429 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:30.266570 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:30.267362 (+ 792us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:29:30.267366 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:29:30.267366 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 15:29:30.267549 (+ 183us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:29:30.267582 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 15:29:30.267593 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:29:30.267669 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0810 15:29:30.267743 (+ 74us) server_negotiation.cc:299] Negotiation successful
0810 15:29:30.267821 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157,"thread_start_us":91,"threads_started":1}
I20260810 15:29:30.269101 19129 raft_consensus.cc:348] T 00000000000000000000000000000000 P 118266cda32d42489d20d0e00395a44f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "118266cda32d42489d20d0e00395a44f" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 43483 } }
I20260810 15:29:30.269270 19129 raft_consensus.cc:374] T 00000000000000000000000000000000 P 118266cda32d42489d20d0e00395a44f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:29:30.269322 19129 raft_consensus.cc:729] T 00000000000000000000000000000000 P 118266cda32d42489d20d0e00395a44f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 118266cda32d42489d20d0e00395a44f, State: Initialized, Role: FOLLOWER
I20260810 15:29:30.269477 19129 consensus_queue.cc:260] T 00000000000000000000000000000000 P 118266cda32d42489d20d0e00395a44f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "118266cda32d42489d20d0e00395a44f" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 43483 } }
I20260810 15:29:30.269569 19129 raft_consensus.cc:388] T 00000000000000000000000000000000 P 118266cda32d42489d20d0e00395a44f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 15:29:30.269618 19129 raft_consensus.cc:482] T 00000000000000000000000000000000 P 118266cda32d42489d20d0e00395a44f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 15:29:30.269670 19129 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 118266cda32d42489d20d0e00395a44f [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:29:30.270326 19129 raft_consensus.cc:504] T 00000000000000000000000000000000 P 118266cda32d42489d20d0e00395a44f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "118266cda32d42489d20d0e00395a44f" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 43483 } }
I20260810 15:29:30.270457 19129 leader_election.cc:302] T 00000000000000000000000000000000 P 118266cda32d42489d20d0e00395a44f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 118266cda32d42489d20d0e00395a44f; no voters:
I20260810 15:29:30.270658 19129 leader_election.cc:288] T 00000000000000000000000000000000 P 118266cda32d42489d20d0e00395a44f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 15:29:30.270718 19136 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 118266cda32d42489d20d0e00395a44f [term 1 FOLLOWER]: Leader election won for term 1
I20260810 15:29:30.270927 19136 raft_consensus.cc:686] T 00000000000000000000000000000000 P 118266cda32d42489d20d0e00395a44f [term 1 LEADER]: Becoming Leader. State: Replica: 118266cda32d42489d20d0e00395a44f, State: Running, Role: LEADER
I20260810 15:29:30.270962 19129 sys_catalog.cc:564] T 00000000000000000000000000000000 P 118266cda32d42489d20d0e00395a44f [sys.catalog]: configured and running, proceeding with master startup.
I20260810 15:29:30.271077 19136 consensus_queue.cc:237] T 00000000000000000000000000000000 P 118266cda32d42489d20d0e00395a44f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "118266cda32d42489d20d0e00395a44f" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 43483 } }
I20260810 15:29:30.271473 19137 sys_catalog.cc:455] T 00000000000000000000000000000000 P 118266cda32d42489d20d0e00395a44f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "118266cda32d42489d20d0e00395a44f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "118266cda32d42489d20d0e00395a44f" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 43483 } } }
I20260810 15:29:30.271574 19137 sys_catalog.cc:458] T 00000000000000000000000000000000 P 118266cda32d42489d20d0e00395a44f [sys.catalog]: This master's current role is: LEADER
I20260810 15:29:30.271484 19138 sys_catalog.cc:455] T 00000000000000000000000000000000 P 118266cda32d42489d20d0e00395a44f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 118266cda32d42489d20d0e00395a44f. Latest consensus state: current_term: 1 leader_uuid: "118266cda32d42489d20d0e00395a44f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "118266cda32d42489d20d0e00395a44f" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 43483 } } }
I20260810 15:29:30.271811 19138 sys_catalog.cc:458] T 00000000000000000000000000000000 P 118266cda32d42489d20d0e00395a44f [sys.catalog]: This master's current role is: LEADER
I20260810 15:29:30.272185 19149 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 15:29:30.272670 19149 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 15:29:30.274243 19149 catalog_manager.cc:1347] Generated new cluster ID: c375f3e4815b4f5296912190a7a9f356
I20260810 15:29:30.274299 19149 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 15:29:30.284497 19149 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 15:29:30.285213 19149 catalog_manager.cc:1504] Loading token signing keys...
I20260810 15:29:30.312160 19149 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 118266cda32d42489d20d0e00395a44f: Generated new TSK 0
I20260810 15:29:30.312394 19149 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 15:29:30.315099 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786375520124696-18706-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786375520124696-18706-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786375520124696-18706-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786375520124696-18706-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.68.129:0
--local_ip_for_outbound_sockets=127.18.68.129
--webserver_interface=127.18.68.129
--webserver_port=0
--tserver_master_addrs=127.18.68.190:43483
--builtin_ntp_servers=127.18.68.148:34337
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260810 15:29:30.408344 19169 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:29:30.408583 19169 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:29:30.408609 19169 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:29:30.409930 19169 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:29:30.409977 19169 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:29:30.410006 19169 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.68.129
I20260810 15:29:30.411725 19169 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:34337
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786375520124696-18706-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786375520124696-18706-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.68.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786375520124696-18706-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.68.129
--webserver_port=0
--tserver_master_addrs=127.18.68.190:43483
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19169
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.68.129
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786375520124696-18706-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:29:30.412016 19169 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:29:30.412376 19169 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:29:30.417989 19175 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:29:30.417999 19184 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:29:30.417995 19177 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:29:30.418290 19169 server_base.cc:1034] running on GCE node
I20260810 15:29:30.418545 19169 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:29:30.418751 19169 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:29:30.419925 19169 hybrid_clock.cc:648] HybridClock initialized: now 1786375770419906 us; error 35 us; skew 500 ppm
I20260810 15:29:30.421360 19169 webserver.cc:460] Webserver started at http://127.18.68.129:37155/ using document root <none> and password file <none>
I20260810 15:29:30.421664 19169 fs_manager.cc:359] Metadata directory not provided
I20260810 15:29:30.421720 19169 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:29:30.421856 19169 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:29:30.423053 19169 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786375520124696-18706-0/minicluster-data/ts-0/data/instance:
uuid: "7f388f9dfd214c3296c8d329ea6398ea"
format_stamp: "Formatted at 2026-08-10 15:29:30 on dist-test-slave-2p8l"
server_key: "38cbbd0238a4c0dad0e3db1c12202e4b"
server_key_iv: "aaf7d4df1fc780aaf1a11f1101dcf222"
server_key_version: "encryptionkey@0"
I20260810 15:29:30.423429 19169 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786375520124696-18706-0/minicluster-data/ts-0/wal/instance:
uuid: "7f388f9dfd214c3296c8d329ea6398ea"
format_stamp: "Formatted at 2026-08-10 15:29:30 on dist-test-slave-2p8l"
server_key: "38cbbd0238a4c0dad0e3db1c12202e4b"
server_key_iv: "aaf7d4df1fc780aaf1a11f1101dcf222"
server_key_version: "encryptionkey@0"
I20260810 15:29:30.424846 19169 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 15:29:30.425673 19196 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:29:30.425926 19169 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:29:30.426013 19169 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786375520124696-18706-0/minicluster-data/ts-0/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786375520124696-18706-0/minicluster-data/ts-0/wal
uuid: "7f388f9dfd214c3296c8d329ea6398ea"
format_stamp: "Formatted at 2026-08-10 15:29:30 on dist-test-slave-2p8l"
server_key: "38cbbd0238a4c0dad0e3db1c12202e4b"
server_key_iv: "aaf7d4df1fc780aaf1a11f1101dcf222"
server_key_version: "encryptionkey@0"
I20260810 15:29:30.426142 19169 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786375520124696-18706-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786375520124696-18706-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786375520124696-18706-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:29:30.435756 19169 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:29:30.436076 19169 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:29:30.436220 19169 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:29:30.436475 19169 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 15:29:30.436838 19169 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 15:29:30.436897 19169 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 15:29:30.436942 19169 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 15:29:30.436969 19169 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 15:29:30.442938 19169 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.129:41377
I20260810 15:29:30.442986 19406 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.129:41377 every 8 connection(s)
I20260810 15:29:30.443352 19169 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786375520124696-18706-0/minicluster-data/ts-0/data/info.pb
I20260810 15:29:30.448642 19132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:30.444145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.129:53851 (local address 127.18.68.190:43483)
0810 15:29:30.444210 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0810 15:29:30.444212 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:29:30.444438 (+ 226us) server_negotiation.cc:407] Connection header received
0810 15:29:30.444955 (+ 517us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:29:30.444956 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:29:30.444966 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:29:30.445031 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:29:30.445660 (+ 629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:30.446228 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:30.447305 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:30.447528 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:30.447584 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:30.448432 (+ 848us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:29:30.448433 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:29:30.448434 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 15:29:30.448437 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:29:30.448452 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 15:29:30.448456 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:29:30.448499 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0810 15:29:30.448559 (+ 60us) server_negotiation.cc:299] Negotiation successful
0810 15:29:30.448583 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260810 15:29:30.448819 19412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:30.444106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:43483 (local address 127.18.68.129:53851)
0810 15:29:30.444306 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:30.444347 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0810 15:29:30.444847 (+ 500us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:29:30.445085 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:29:30.445089 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:29:30.445097 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:29:30.445587 (+ 490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:29:30.445591 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:29:30.446335 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:29:30.446335 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:29:30.447230 (+ 895us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:29:30.447232 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:29:30.447634 (+ 402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:29:30.447635 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:29:30.447744 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:30.448295 (+ 551us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 15:29:30.448296 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:29:30.448324 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 15:29:30.448347 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:29:30.448500 (+ 153us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:29:30.448502 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:29:30.448504 (+ 2us) client_negotiation.cc:769] Sending connection context
0810 15:29:30.448549 (+ 45us) client_negotiation.cc:240] Negotiation successful
0810 15:29:30.448627 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":98,"threads_started":1}
I20260810 15:29:30.449421 19407 heartbeater.cc:347] Connected to a master server at 127.18.68.190:43483
I20260810 15:29:30.449535 19407 heartbeater.cc:464] Registering TS with master...
I20260810 15:29:30.449723 19407 heartbeater.cc:511] Master 127.18.68.190:43483 requested a full tablet report, sending...
I20260810 15:29:30.450287 19073 ts_manager.cc:194] Registered new tserver with Master: 7f388f9dfd214c3296c8d329ea6398ea (127.18.68.129:41377)
I20260810 15:29:30.450883 19073 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.18.68.129:53851
I20260810 15:29:30.451321 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 19169
I20260810 15:29:30.451453 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786375520124696-18706-0/minicluster-data/ts-0/wal/instance
I20260810 15:29:30.451660 18706 external_mini_cluster.cc:1428] Setting key 12e19728128eeaf0fac9f136380a0461
I20260810 15:29:30.452525 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786375520124696-18706-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786375520124696-18706-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786375520124696-18706-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786375520124696-18706-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.68.130:0
--local_ip_for_outbound_sockets=127.18.68.130
--webserver_interface=127.18.68.130
--webserver_port=0
--tserver_master_addrs=127.18.68.190:43483
--builtin_ntp_servers=127.18.68.148:34337
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260810 15:29:30.534706 19413 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:29:30.534919 19413 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:29:30.534942 19413 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:29:30.536114 19413 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:29:30.536159 19413 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:29:30.536185 19413 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.68.130
I20260810 15:29:30.537639 19413 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:34337
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786375520124696-18706-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786375520124696-18706-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.68.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786375520124696-18706-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.68.130
--webserver_port=0
--tserver_master_addrs=127.18.68.190:43483
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19413
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.68.130
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786375520124696-18706-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:29:30.537899 19413 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:29:30.538236 19413 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:29:30.543658 19425 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:29:30.543704 19428 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:29:30.543718 19424 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:29:30.543793 19413 server_base.cc:1034] running on GCE node
I20260810 15:29:30.544080 19413 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:29:30.544378 19413 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:29:30.545565 19413 hybrid_clock.cc:648] HybridClock initialized: now 1786375770545550 us; error 26 us; skew 500 ppm
I20260810 15:29:30.546974 19413 webserver.cc:460] Webserver started at http://127.18.68.130:40977/ using document root <none> and password file <none>
I20260810 15:29:30.547312 19413 fs_manager.cc:359] Metadata directory not provided
I20260810 15:29:30.547387 19413 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:29:30.547537 19413 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:29:30.548640 19413 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786375520124696-18706-0/minicluster-data/ts-1/data/instance:
uuid: "3cf0adc8e9394fcdb186635f6c368161"
format_stamp: "Formatted at 2026-08-10 15:29:30 on dist-test-slave-2p8l"
server_key: "6414227c7c0d187a75a60ec333ed5543"
server_key_iv: "05165ab490951ed8caeabe4a26a9c1d7"
server_key_version: "encryptionkey@0"
I20260810 15:29:30.549021 19413 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786375520124696-18706-0/minicluster-data/ts-1/wal/instance:
uuid: "3cf0adc8e9394fcdb186635f6c368161"
format_stamp: "Formatted at 2026-08-10 15:29:30 on dist-test-slave-2p8l"
server_key: "6414227c7c0d187a75a60ec333ed5543"
server_key_iv: "05165ab490951ed8caeabe4a26a9c1d7"
server_key_version: "encryptionkey@0"
I20260810 15:29:30.550426 19413 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 15:29:30.551222 19438 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:29:30.551416 19413 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260810 15:29:30.551529 19413 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786375520124696-18706-0/minicluster-data/ts-1/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786375520124696-18706-0/minicluster-data/ts-1/wal
uuid: "3cf0adc8e9394fcdb186635f6c368161"
format_stamp: "Formatted at 2026-08-10 15:29:30 on dist-test-slave-2p8l"
server_key: "6414227c7c0d187a75a60ec333ed5543"
server_key_iv: "05165ab490951ed8caeabe4a26a9c1d7"
server_key_version: "encryptionkey@0"
I20260810 15:29:30.551605 19413 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786375520124696-18706-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786375520124696-18706-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786375520124696-18706-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:29:30.569432 19413 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:29:30.569789 19413 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:29:30.569952 19413 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:29:30.570302 19413 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 15:29:30.570657 19413 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 15:29:30.570714 19413 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 15:29:30.570756 19413 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 15:29:30.570804 19413 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 15:29:30.576776 19413 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.130:45347
I20260810 15:29:30.576849 19638 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.130:45347 every 8 connection(s)
I20260810 15:29:30.577235 19413 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786375520124696-18706-0/minicluster-data/ts-1/data/info.pb
I20260810 15:29:30.578133 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 19413
I20260810 15:29:30.578258 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786375520124696-18706-0/minicluster-data/ts-1/wal/instance
I20260810 15:29:30.578470 18706 external_mini_cluster.cc:1428] Setting key 4e3e0856562732505f8c24e919c77f69
I20260810 15:29:30.579440 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786375520124696-18706-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786375520124696-18706-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786375520124696-18706-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786375520124696-18706-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.68.131:0
--local_ip_for_outbound_sockets=127.18.68.131
--webserver_interface=127.18.68.131
--webserver_port=0
--tserver_master_addrs=127.18.68.190:43483
--builtin_ntp_servers=127.18.68.148:34337
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260810 15:29:30.583490 19132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:30.578132 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.130:57801 (local address 127.18.68.190:43483)
0810 15:29:30.578209 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0810 15:29:30.578212 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 15:29:30.578557 (+ 345us) server_negotiation.cc:407] Connection header received
0810 15:29:30.579093 (+ 536us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:29:30.579094 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:29:30.579106 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:29:30.579177 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:29:30.580001 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:30.580502 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:30.581924 (+ 1422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:30.582211 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:30.582275 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:30.583230 (+ 955us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:29:30.583231 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:29:30.583231 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 15:29:30.583235 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:29:30.583250 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 15:29:30.583254 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:29:30.583298 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0810 15:29:30.583400 (+ 102us) server_negotiation.cc:299] Negotiation successful
0810 15:29:30.583430 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260810 15:29:30.583827 19646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:30.578102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:43483 (local address 127.18.68.130:57801)
0810 15:29:30.578412 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:30.578445 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0810 15:29:30.578977 (+ 532us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:29:30.579264 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:29:30.579269 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:29:30.579285 (+ 16us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:29:30.579903 (+ 618us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:29:30.579908 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:29:30.580607 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:29:30.580608 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:29:30.581824 (+ 1216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:29:30.581828 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:29:30.582307 (+ 479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:29:30.582308 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:29:30.582468 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:30.583056 (+ 588us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 15:29:30.583057 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:29:30.583096 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 15:29:30.583126 (+ 30us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:29:30.583319 (+ 193us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:29:30.583325 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:29:30.583328 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 15:29:30.583398 (+ 70us) client_negotiation.cc:240] Negotiation successful
0810 15:29:30.583515 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":244,"thread_start_us":93,"threads_started":1}
I20260810 15:29:30.584350 19640 heartbeater.cc:347] Connected to a master server at 127.18.68.190:43483
I20260810 15:29:30.584448 19640 heartbeater.cc:464] Registering TS with master...
I20260810 15:29:30.584666 19640 heartbeater.cc:511] Master 127.18.68.190:43483 requested a full tablet report, sending...
I20260810 15:29:30.585109 19073 ts_manager.cc:194] Registered new tserver with Master: 3cf0adc8e9394fcdb186635f6c368161 (127.18.68.130:45347)
I20260810 15:29:30.585451 19073 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.18.68.130:57801
W20260810 15:29:30.667339 19647 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:29:30.667579 19647 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:29:30.667619 19647 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:29:30.668886 19647 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:29:30.668955 19647 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:29:30.669001 19647 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.68.131
I20260810 15:29:30.670514 19647 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:34337
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786375520124696-18706-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786375520124696-18706-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.68.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786375520124696-18706-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.68.131
--webserver_port=0
--tserver_master_addrs=127.18.68.190:43483
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19647
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.68.131
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786375520124696-18706-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:29:30.670783 19647 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:29:30.671154 19647 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:29:30.676584 19661 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:29:30.676630 19654 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:29:30.676594 19655 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:29:30.676960 19647 server_base.cc:1034] running on GCE node
I20260810 15:29:30.677268 19647 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:29:30.677480 19647 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:29:30.678634 19647 hybrid_clock.cc:648] HybridClock initialized: now 1786375770678619 us; error 29 us; skew 500 ppm
I20260810 15:29:30.680131 19647 webserver.cc:460] Webserver started at http://127.18.68.131:42421/ using document root <none> and password file <none>
I20260810 15:29:30.680395 19647 fs_manager.cc:359] Metadata directory not provided
I20260810 15:29:30.680471 19647 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:29:30.680644 19647 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:29:30.681756 19647 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786375520124696-18706-0/minicluster-data/ts-2/data/instance:
uuid: "9b39087135b7435ca79247024756cc16"
format_stamp: "Formatted at 2026-08-10 15:29:30 on dist-test-slave-2p8l"
server_key: "f7728bb7f97dffaa21802cb83795c4ed"
server_key_iv: "ad6d9d737193f997be0cc0a10794a887"
server_key_version: "encryptionkey@0"
I20260810 15:29:30.682201 19647 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786375520124696-18706-0/minicluster-data/ts-2/wal/instance:
uuid: "9b39087135b7435ca79247024756cc16"
format_stamp: "Formatted at 2026-08-10 15:29:30 on dist-test-slave-2p8l"
server_key: "f7728bb7f97dffaa21802cb83795c4ed"
server_key_iv: "ad6d9d737193f997be0cc0a10794a887"
server_key_version: "encryptionkey@0"
I20260810 15:29:30.683627 19647 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:29:30.684429 19669 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:29:30.684662 19647 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:29:30.684770 19647 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786375520124696-18706-0/minicluster-data/ts-2/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786375520124696-18706-0/minicluster-data/ts-2/wal
uuid: "9b39087135b7435ca79247024756cc16"
format_stamp: "Formatted at 2026-08-10 15:29:30 on dist-test-slave-2p8l"
server_key: "f7728bb7f97dffaa21802cb83795c4ed"
server_key_iv: "ad6d9d737193f997be0cc0a10794a887"
server_key_version: "encryptionkey@0"
I20260810 15:29:30.684857 19647 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786375520124696-18706-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786375520124696-18706-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786375520124696-18706-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:29:30.711539 19647 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:29:30.711910 19647 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:29:30.712082 19647 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:29:30.712354 19647 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 15:29:30.712723 19647 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 15:29:30.712781 19647 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 15:29:30.712816 19647 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 15:29:30.712845 19647 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 15:29:30.719106 19647 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.131:37861
I20260810 15:29:30.719169 19869 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.131:37861 every 8 connection(s)
I20260810 15:29:30.719542 19647 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786375520124696-18706-0/minicluster-data/ts-2/data/info.pb
I20260810 15:29:30.724954 19132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:30.720362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.131:58527 (local address 127.18.68.190:43483)
0810 15:29:30.720408 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0810 15:29:30.720410 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:29:30.720680 (+ 270us) server_negotiation.cc:407] Connection header received
0810 15:29:30.721225 (+ 545us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:29:30.721226 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:29:30.721239 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:29:30.721296 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:29:30.721993 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:30.722508 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:30.723514 (+ 1006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:30.723719 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:30.723800 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:30.724660 (+ 860us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:29:30.724662 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:29:30.724662 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 15:29:30.724667 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:29:30.724686 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 15:29:30.724690 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:29:30.724751 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0810 15:29:30.724846 (+ 95us) server_negotiation.cc:299] Negotiation successful
0810 15:29:30.724872 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260810 15:29:30.725185 19880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:30.720350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:43483 (local address 127.18.68.131:58527)
0810 15:29:30.720557 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:30.720592 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0810 15:29:30.721107 (+ 515us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:29:30.721372 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:29:30.721375 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:29:30.721383 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:29:30.721892 (+ 509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:29:30.721896 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:29:30.722614 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:29:30.722615 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:29:30.723406 (+ 791us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:29:30.723407 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:29:30.723809 (+ 402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:29:30.723810 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:29:30.723943 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:30.724473 (+ 530us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 15:29:30.724473 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:29:30.724501 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 15:29:30.724533 (+ 32us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:29:30.724751 (+ 218us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:29:30.724758 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:29:30.724762 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 15:29:30.724848 (+ 86us) client_negotiation.cc:240] Negotiation successful
0810 15:29:30.724953 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":88,"threads_started":1}
I20260810 15:29:30.725704 19875 heartbeater.cc:347] Connected to a master server at 127.18.68.190:43483
I20260810 15:29:30.725790 19875 heartbeater.cc:464] Registering TS with master...
I20260810 15:29:30.725977 19875 heartbeater.cc:511] Master 127.18.68.190:43483 requested a full tablet report, sending...
I20260810 15:29:30.726294 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 19647
I20260810 15:29:30.726439 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786375520124696-18706-0/minicluster-data/ts-2/wal/instance
I20260810 15:29:30.726478 19073 ts_manager.cc:194] Registered new tserver with Master: 9b39087135b7435ca79247024756cc16 (127.18.68.131:37861)
I20260810 15:29:30.726661 18706 external_mini_cluster.cc:1428] Setting key dd58a19dd357d5800baa06921dbfeec7
I20260810 15:29:30.727000 19073 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.18.68.131:58527
I20260810 15:29:30.727685 18706 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 15:29:30.732323 19132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:30.729263 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40832 (local address 127.18.68.190:43483)
0810 15:29:30.729300 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0810 15:29:30.729302 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:29:30.729444 (+ 142us) server_negotiation.cc:407] Connection header received
0810 15:29:30.729519 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:29:30.729520 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:29:30.729530 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:29:30.729585 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:29:30.729739 (+ 154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:30.730269 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:30.731024 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:30.731231 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:30.731314 (+ 83us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:30.731998 (+ 684us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:29:30.731999 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:29:30.732000 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 15:29:30.732004 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:29:30.732017 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 15:29:30.732021 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:29:30.732121 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0810 15:29:30.732233 (+ 112us) server_negotiation.cc:299] Negotiation successful
0810 15:29:30.732243 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260810 15:29:30.733991 19073 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40832:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 15:29:30.735657 19073 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 15:29:30.742223 19891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:30.738168 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55988 (local address 127.18.68.130:45347)
0810 15:29:30.738326 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0810 15:29:30.738330 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 15:29:30.738341 (+ 11us) server_negotiation.cc:407] Connection header received
0810 15:29:30.738381 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:29:30.738385 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:29:30.738402 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:29:30.738567 (+ 165us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:29:30.738820 (+ 253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:30.739958 (+ 1138us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:30.741223 (+ 1265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:30.741750 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:30.741848 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:30.741943 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0810 15:29:30.742096 (+ 153us) server_negotiation.cc:299] Negotiation successful
0810 15:29:30.742135 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118,"thread_start_us":86,"threads_started":1}
I20260810 15:29:30.742228 19887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:30.737775 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.131:37861 (local address 127.0.0.1:39446)
0810 15:29:30.737896 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:30.737934 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0810 15:29:30.737994 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:29:30.738726 (+ 732us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:29:30.738727 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:29:30.738729 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:29:30.738778 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:29:30.738780 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:29:30.739715 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:29:30.739716 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:29:30.740955 (+ 1239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:29:30.740958 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:29:30.741931 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:29:30.741932 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:29:30.741989 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:30.741993 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 15:29:30.742024 (+ 31us) client_negotiation.cc:240] Negotiation successful
0810 15:29:30.742112 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":74,"threads_started":1}
I20260810 15:29:30.742319 19888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:30.737996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.129:41377 (local address 127.0.0.1:55386)
0810 15:29:30.738326 (+ 330us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:30.738335 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 15:29:30.738373 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:29:30.738697 (+ 324us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:29:30.738697 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:29:30.738699 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:29:30.738739 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:29:30.738740 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:29:30.740245 (+ 1505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:29:30.740246 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:29:30.741063 (+ 817us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:29:30.741066 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:29:30.742110 (+ 1044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:29:30.742111 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:29:30.742168 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:30.742171 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 15:29:30.742221 (+ 50us) client_negotiation.cc:240] Negotiation successful
0810 15:29:30.742263 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":313,"mutex_wait_us":7,"thread_start_us":110,"threads_started":1}
I20260810 15:29:30.742209 19890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:30.737852 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.130:45347 (local address 127.0.0.1:55988)
0810 15:29:30.738171 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:30.738181 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 15:29:30.738239 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:29:30.738653 (+ 414us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:29:30.738656 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:29:30.738658 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:29:30.738733 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:29:30.738734 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:29:30.740069 (+ 1335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:29:30.740069 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:29:30.741134 (+ 1065us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:29:30.741136 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:29:30.741849 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:29:30.741850 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:29:30.741926 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:30.741939 (+ 13us) client_negotiation.cc:769] Sending connection context
0810 15:29:30.742052 (+ 113us) client_negotiation.cc:240] Negotiation successful
0810 15:29:30.742119 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":300,"mutex_wait_us":29,"thread_start_us":100,"threads_started":1}
I20260810 15:29:30.742496 19889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:30.737868 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39446 (local address 127.18.68.131:37861)
0810 15:29:30.738490 (+ 622us) server_negotiation.cc:206] Beginning negotiation
0810 15:29:30.738496 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 15:29:30.738552 (+ 56us) server_negotiation.cc:407] Connection header received
0810 15:29:30.738595 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:29:30.738598 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:29:30.738614 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:29:30.738883 (+ 269us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:29:30.738936 (+ 53us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:30.739623 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:30.741047 (+ 1424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:30.741820 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:30.742268 (+ 448us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:30.742358 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0810 15:29:30.742385 (+ 27us) server_negotiation.cc:299] Negotiation successful
0810 15:29:30.742423 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":580,"thread_start_us":100,"threads_started":1}
I20260810 15:29:30.742529 19893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:30.738255 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55386 (local address 127.18.68.129:41377)
0810 15:29:30.738474 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0810 15:29:30.738478 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 15:29:30.738489 (+ 11us) server_negotiation.cc:407] Connection header received
0810 15:29:30.738527 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:29:30.738530 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:29:30.738558 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:29:30.738632 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:29:30.738819 (+ 187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:30.739958 (+ 1139us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:30.741162 (+ 1204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:30.741888 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:30.741946 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:30.742037 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0810 15:29:30.742408 (+ 371us) server_negotiation.cc:299] Negotiation successful
0810 15:29:30.742448 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":182,"thread_start_us":117,"threads_started":1}
I20260810 15:29:30.743268 19294 tablet_service.cc:1467] Processing CreateTablet for tablet 5e57d4eb836647bbbdd5ba222ad5fbba (DEFAULT_TABLE table=test-table [id=59cb8d39ebf54b05bdcd55573852b622]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 15:29:30.743474 19756 tablet_service.cc:1467] Processing CreateTablet for tablet 5e57d4eb836647bbbdd5ba222ad5fbba (DEFAULT_TABLE table=test-table [id=59cb8d39ebf54b05bdcd55573852b622]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 15:29:30.743722 19294 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e57d4eb836647bbbdd5ba222ad5fbba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:29:30.743717 19523 tablet_service.cc:1467] Processing CreateTablet for tablet 5e57d4eb836647bbbdd5ba222ad5fbba (DEFAULT_TABLE table=test-table [id=59cb8d39ebf54b05bdcd55573852b622]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 15:29:30.743898 19756 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e57d4eb836647bbbdd5ba222ad5fbba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:29:30.744045 19523 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e57d4eb836647bbbdd5ba222ad5fbba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:29:30.746781 19895 tablet_bootstrap.cc:492] T 5e57d4eb836647bbbdd5ba222ad5fbba P 9b39087135b7435ca79247024756cc16: Bootstrap starting.
I20260810 15:29:30.747493 19896 tablet_bootstrap.cc:492] T 5e57d4eb836647bbbdd5ba222ad5fbba P 7f388f9dfd214c3296c8d329ea6398ea: Bootstrap starting.
I20260810 15:29:30.747571 19895 tablet_bootstrap.cc:654] T 5e57d4eb836647bbbdd5ba222ad5fbba P 9b39087135b7435ca79247024756cc16: Neither blocks nor log segments found. Creating new log.
I20260810 15:29:30.747922 19895 log.cc:824] T 5e57d4eb836647bbbdd5ba222ad5fbba P 9b39087135b7435ca79247024756cc16: Log is configured to *not* fsync() on all Append() calls
I20260810 15:29:30.748245 19896 tablet_bootstrap.cc:654] T 5e57d4eb836647bbbdd5ba222ad5fbba P 7f388f9dfd214c3296c8d329ea6398ea: Neither blocks nor log segments found. Creating new log.
I20260810 15:29:30.748585 19896 log.cc:824] T 5e57d4eb836647bbbdd5ba222ad5fbba P 7f388f9dfd214c3296c8d329ea6398ea: Log is configured to *not* fsync() on all Append() calls
I20260810 15:29:30.748816 19895 tablet_bootstrap.cc:492] T 5e57d4eb836647bbbdd5ba222ad5fbba P 9b39087135b7435ca79247024756cc16: No bootstrap required, opened a new log
I20260810 15:29:30.748894 19895 ts_tablet_manager.cc:1397] T 5e57d4eb836647bbbdd5ba222ad5fbba P 9b39087135b7435ca79247024756cc16: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 15:29:30.748931 19898 tablet_bootstrap.cc:492] T 5e57d4eb836647bbbdd5ba222ad5fbba P 3cf0adc8e9394fcdb186635f6c368161: Bootstrap starting.
I20260810 15:29:30.749524 19896 tablet_bootstrap.cc:492] T 5e57d4eb836647bbbdd5ba222ad5fbba P 7f388f9dfd214c3296c8d329ea6398ea: No bootstrap required, opened a new log
I20260810 15:29:30.749621 19896 ts_tablet_manager.cc:1397] T 5e57d4eb836647bbbdd5ba222ad5fbba P 7f388f9dfd214c3296c8d329ea6398ea: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 15:29:30.749634 19898 tablet_bootstrap.cc:654] T 5e57d4eb836647bbbdd5ba222ad5fbba P 3cf0adc8e9394fcdb186635f6c368161: Neither blocks nor log segments found. Creating new log.
I20260810 15:29:30.749998 19898 log.cc:824] T 5e57d4eb836647bbbdd5ba222ad5fbba P 3cf0adc8e9394fcdb186635f6c368161: Log is configured to *not* fsync() on all Append() calls
I20260810 15:29:30.750885 19898 tablet_bootstrap.cc:492] T 5e57d4eb836647bbbdd5ba222ad5fbba P 3cf0adc8e9394fcdb186635f6c368161: No bootstrap required, opened a new log
I20260810 15:29:30.750957 19898 ts_tablet_manager.cc:1397] T 5e57d4eb836647bbbdd5ba222ad5fbba P 3cf0adc8e9394fcdb186635f6c368161: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 15:29:30.751713 19895 raft_consensus.cc:348] T 5e57d4eb836647bbbdd5ba222ad5fbba P 9b39087135b7435ca79247024756cc16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b39087135b7435ca79247024756cc16" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37861 } } peers { permanent_uuid: "7f388f9dfd214c3296c8d329ea6398ea" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 41377 } } peers { permanent_uuid: "3cf0adc8e9394fcdb186635f6c368161" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 45347 } }
I20260810 15:29:30.751888 19895 raft_consensus.cc:374] T 5e57d4eb836647bbbdd5ba222ad5fbba P 9b39087135b7435ca79247024756cc16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:29:30.751924 19895 raft_consensus.cc:729] T 5e57d4eb836647bbbdd5ba222ad5fbba P 9b39087135b7435ca79247024756cc16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b39087135b7435ca79247024756cc16, State: Initialized, Role: FOLLOWER
I20260810 15:29:30.751929 19896 raft_consensus.cc:348] T 5e57d4eb836647bbbdd5ba222ad5fbba P 7f388f9dfd214c3296c8d329ea6398ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b39087135b7435ca79247024756cc16" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37861 } } peers { permanent_uuid: "7f388f9dfd214c3296c8d329ea6398ea" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 41377 } } peers { permanent_uuid: "3cf0adc8e9394fcdb186635f6c368161" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 45347 } }
I20260810 15:29:30.752065 19895 consensus_queue.cc:260] T 5e57d4eb836647bbbdd5ba222ad5fbba P 9b39087135b7435ca79247024756cc16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b39087135b7435ca79247024756cc16" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37861 } } peers { permanent_uuid: "7f388f9dfd214c3296c8d329ea6398ea" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 41377 } } peers { permanent_uuid: "3cf0adc8e9394fcdb186635f6c368161" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 45347 } }
I20260810 15:29:30.752138 19896 raft_consensus.cc:374] T 5e57d4eb836647bbbdd5ba222ad5fbba P 7f388f9dfd214c3296c8d329ea6398ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:29:30.752192 19896 raft_consensus.cc:729] T 5e57d4eb836647bbbdd5ba222ad5fbba P 7f388f9dfd214c3296c8d329ea6398ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f388f9dfd214c3296c8d329ea6398ea, State: Initialized, Role: FOLLOWER
I20260810 15:29:30.752331 19895 ts_tablet_manager.cc:1428] T 5e57d4eb836647bbbdd5ba222ad5fbba P 9b39087135b7435ca79247024756cc16: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260810 15:29:30.752308 19896 consensus_queue.cc:260] T 5e57d4eb836647bbbdd5ba222ad5fbba P 7f388f9dfd214c3296c8d329ea6398ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b39087135b7435ca79247024756cc16" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37861 } } peers { permanent_uuid: "7f388f9dfd214c3296c8d329ea6398ea" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 41377 } } peers { permanent_uuid: "3cf0adc8e9394fcdb186635f6c368161" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 45347 } }
I20260810 15:29:30.752456 19875 heartbeater.cc:503] Master 127.18.68.190:43483 was elected leader, sending a full tablet report...
I20260810 15:29:30.752614 19896 ts_tablet_manager.cc:1428] T 5e57d4eb836647bbbdd5ba222ad5fbba P 7f388f9dfd214c3296c8d329ea6398ea: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 15:29:30.752756 19407 heartbeater.cc:503] Master 127.18.68.190:43483 was elected leader, sending a full tablet report...
I20260810 15:29:30.753510 19898 raft_consensus.cc:348] T 5e57d4eb836647bbbdd5ba222ad5fbba P 3cf0adc8e9394fcdb186635f6c368161 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b39087135b7435ca79247024756cc16" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37861 } } peers { permanent_uuid: "7f388f9dfd214c3296c8d329ea6398ea" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 41377 } } peers { permanent_uuid: "3cf0adc8e9394fcdb186635f6c368161" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 45347 } }
I20260810 15:29:30.753657 19898 raft_consensus.cc:374] T 5e57d4eb836647bbbdd5ba222ad5fbba P 3cf0adc8e9394fcdb186635f6c368161 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:29:30.753692 19898 raft_consensus.cc:729] T 5e57d4eb836647bbbdd5ba222ad5fbba P 3cf0adc8e9394fcdb186635f6c368161 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cf0adc8e9394fcdb186635f6c368161, State: Initialized, Role: FOLLOWER
I20260810 15:29:30.753799 19898 consensus_queue.cc:260] T 5e57d4eb836647bbbdd5ba222ad5fbba P 3cf0adc8e9394fcdb186635f6c368161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b39087135b7435ca79247024756cc16" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37861 } } peers { permanent_uuid: "7f388f9dfd214c3296c8d329ea6398ea" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 41377 } } peers { permanent_uuid: "3cf0adc8e9394fcdb186635f6c368161" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 45347 } }
I20260810 15:29:30.754047 19898 ts_tablet_manager.cc:1428] T 5e57d4eb836647bbbdd5ba222ad5fbba P 3cf0adc8e9394fcdb186635f6c368161: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 15:29:30.754148 19640 heartbeater.cc:503] Master 127.18.68.190:43483 was elected leader, sending a full tablet report...
W20260810 15:29:30.827898 19642 tablet.cc:2369] T 5e57d4eb836647bbbdd5ba222ad5fbba P 3cf0adc8e9394fcdb186635f6c368161: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 15:29:30.885733 19907 raft_consensus.cc:482] T 5e57d4eb836647bbbdd5ba222ad5fbba P 3cf0adc8e9394fcdb186635f6c368161 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 15:29:30.885882 19907 raft_consensus.cc:504] T 5e57d4eb836647bbbdd5ba222ad5fbba P 3cf0adc8e9394fcdb186635f6c368161 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b39087135b7435ca79247024756cc16" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37861 } } peers { permanent_uuid: "7f388f9dfd214c3296c8d329ea6398ea" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 41377 } } peers { permanent_uuid: "3cf0adc8e9394fcdb186635f6c368161" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 45347 } }
I20260810 15:29:30.886262 19907 leader_election.cc:288] T 5e57d4eb836647bbbdd5ba222ad5fbba P 3cf0adc8e9394fcdb186635f6c368161 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b39087135b7435ca79247024756cc16 (127.18.68.131:37861), 7f388f9dfd214c3296c8d329ea6398ea (127.18.68.129:41377)
I20260810 15:29:30.890290 19889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:30.886573 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.130:38359 (local address 127.18.68.131:37861)
0810 15:29:30.886682 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0810 15:29:30.886684 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:29:30.886826 (+ 142us) server_negotiation.cc:407] Connection header received
0810 15:29:30.886863 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:29:30.886864 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:29:30.886875 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:29:30.886935 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:29:30.887146 (+ 211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:30.887931 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:30.889500 (+ 1569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:30.889887 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:30.889984 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:30.889993 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0810 15:29:30.890174 (+ 181us) server_negotiation.cc:299] Negotiation successful
0810 15:29:30.890215 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260810 15:29:30.890291 19646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:30.886490 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.131:37861 (local address 127.18.68.130:38359)
0810 15:29:30.886663 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:30.886679 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 15:29:30.886761 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:29:30.886956 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:29:30.886957 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:29:30.886960 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:29:30.887063 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:29:30.887065 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:29:30.888041 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:29:30.888042 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:29:30.889410 (+ 1368us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:29:30.889413 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:29:30.889985 (+ 572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:29:30.889986 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:29:30.890092 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:30.890096 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 15:29:30.890167 (+ 71us) client_negotiation.cc:240] Negotiation successful
0810 15:29:30.890215 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"mutex_wait_us":95}
I20260810 15:29:30.890435 19910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:30.886629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.129:41377 (local address 127.18.68.130:56715)
0810 15:29:30.886802 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:30.886813 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 15:29:30.886880 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:29:30.887050 (+ 170us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:29:30.887051 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:29:30.887052 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:29:30.887116 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:29:30.887117 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:29:30.888041 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:29:30.888042 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:29:30.889445 (+ 1403us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:29:30.889449 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:29:30.890126 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:29:30.890128 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:29:30.890221 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:30.890225 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 15:29:30.890300 (+ 75us) client_negotiation.cc:240] Negotiation successful
0810 15:29:30.890343 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"mutex_wait_us":45,"thread_start_us":113,"threads_started":1}
I20260810 15:29:30.890426 19893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:30.886764 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.130:56715 (local address 127.18.68.129:41377)
0810 15:29:30.886810 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0810 15:29:30.886812 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:29:30.886860 (+ 48us) server_negotiation.cc:407] Connection header received
0810 15:29:30.886952 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:29:30.886953 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:29:30.886966 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:29:30.887019 (+ 53us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:29:30.887192 (+ 173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:30.887931 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:30.889549 (+ 1618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:30.889975 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:30.890071 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:30.890110 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0810 15:29:30.890308 (+ 198us) server_negotiation.cc:299] Negotiation successful
0810 15:29:30.890357 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260810 15:29:30.890678 19790 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e57d4eb836647bbbdd5ba222ad5fbba" candidate_uuid: "3cf0adc8e9394fcdb186635f6c368161" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b39087135b7435ca79247024756cc16" is_pre_election: true
I20260810 15:29:30.890864 19790 raft_consensus.cc:2454] T 5e57d4eb836647bbbdd5ba222ad5fbba P 9b39087135b7435ca79247024756cc16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cf0adc8e9394fcdb186635f6c368161 in term 0.
I20260810 15:29:30.891131 19446 leader_election.cc:302] T 5e57d4eb836647bbbdd5ba222ad5fbba P 3cf0adc8e9394fcdb186635f6c368161 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cf0adc8e9394fcdb186635f6c368161, 9b39087135b7435ca79247024756cc16; no voters:
I20260810 15:29:30.891273 19907 raft_consensus.cc:2781] T 5e57d4eb836647bbbdd5ba222ad5fbba P 3cf0adc8e9394fcdb186635f6c368161 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 15:29:30.891340 19907 raft_consensus.cc:482] T 5e57d4eb836647bbbdd5ba222ad5fbba P 3cf0adc8e9394fcdb186635f6c368161 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 15:29:30.891377 19907 raft_consensus.cc:3037] T 5e57d4eb836647bbbdd5ba222ad5fbba P 3cf0adc8e9394fcdb186635f6c368161 [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:29:30.891311 19325 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e57d4eb836647bbbdd5ba222ad5fbba" candidate_uuid: "3cf0adc8e9394fcdb186635f6c368161" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f388f9dfd214c3296c8d329ea6398ea" is_pre_election: true
I20260810 15:29:30.891467 19325 raft_consensus.cc:2454] T 5e57d4eb836647bbbdd5ba222ad5fbba P 7f388f9dfd214c3296c8d329ea6398ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cf0adc8e9394fcdb186635f6c368161 in term 0.
I20260810 15:29:30.892194 19907 raft_consensus.cc:504] T 5e57d4eb836647bbbdd5ba222ad5fbba P 3cf0adc8e9394fcdb186635f6c368161 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b39087135b7435ca79247024756cc16" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37861 } } peers { permanent_uuid: "7f388f9dfd214c3296c8d329ea6398ea" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 41377 } } peers { permanent_uuid: "3cf0adc8e9394fcdb186635f6c368161" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 45347 } }
I20260810 15:29:30.892340 19907 leader_election.cc:288] T 5e57d4eb836647bbbdd5ba222ad5fbba P 3cf0adc8e9394fcdb186635f6c368161 [CANDIDATE]: Term 1 election: Requested vote from peers 9b39087135b7435ca79247024756cc16 (127.18.68.131:37861), 7f388f9dfd214c3296c8d329ea6398ea (127.18.68.129:41377)
I20260810 15:29:30.892580 19325 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e57d4eb836647bbbdd5ba222ad5fbba" candidate_uuid: "3cf0adc8e9394fcdb186635f6c368161" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f388f9dfd214c3296c8d329ea6398ea"
I20260810 15:29:30.892544 19790 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e57d4eb836647bbbdd5ba222ad5fbba" candidate_uuid: "3cf0adc8e9394fcdb186635f6c368161" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b39087135b7435ca79247024756cc16"
I20260810 15:29:30.892654 19325 raft_consensus.cc:3037] T 5e57d4eb836647bbbdd5ba222ad5fbba P 7f388f9dfd214c3296c8d329ea6398ea [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:29:30.892702 19790 raft_consensus.cc:3037] T 5e57d4eb836647bbbdd5ba222ad5fbba P 9b39087135b7435ca79247024756cc16 [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:29:30.893428 19325 raft_consensus.cc:2454] T 5e57d4eb836647bbbdd5ba222ad5fbba P 7f388f9dfd214c3296c8d329ea6398ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cf0adc8e9394fcdb186635f6c368161 in term 1.
I20260810 15:29:30.893592 19446 leader_election.cc:302] T 5e57d4eb836647bbbdd5ba222ad5fbba P 3cf0adc8e9394fcdb186635f6c368161 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cf0adc8e9394fcdb186635f6c368161, 7f388f9dfd214c3296c8d329ea6398ea; no voters:
I20260810 15:29:30.893631 19790 raft_consensus.cc:2454] T 5e57d4eb836647bbbdd5ba222ad5fbba P 9b39087135b7435ca79247024756cc16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cf0adc8e9394fcdb186635f6c368161 in term 1.
I20260810 15:29:30.893703 19907 raft_consensus.cc:2781] T 5e57d4eb836647bbbdd5ba222ad5fbba P 3cf0adc8e9394fcdb186635f6c368161 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 15:29:30.893863 19907 raft_consensus.cc:686] T 5e57d4eb836647bbbdd5ba222ad5fbba P 3cf0adc8e9394fcdb186635f6c368161 [term 1 LEADER]: Becoming Leader. State: Replica: 3cf0adc8e9394fcdb186635f6c368161, State: Running, Role: LEADER
I20260810 15:29:30.893983 19907 consensus_queue.cc:237] T 5e57d4eb836647bbbdd5ba222ad5fbba P 3cf0adc8e9394fcdb186635f6c368161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b39087135b7435ca79247024756cc16" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37861 } } peers { permanent_uuid: "7f388f9dfd214c3296c8d329ea6398ea" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 41377 } } peers { permanent_uuid: "3cf0adc8e9394fcdb186635f6c368161" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 45347 } }
I20260810 15:29:30.894863 19072 catalog_manager.cc:5495] T 5e57d4eb836647bbbdd5ba222ad5fbba P 3cf0adc8e9394fcdb186635f6c368161 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3cf0adc8e9394fcdb186635f6c368161 (127.18.68.130). New cstate: current_term: 1 leader_uuid: "3cf0adc8e9394fcdb186635f6c368161" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b39087135b7435ca79247024756cc16" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37861 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f388f9dfd214c3296c8d329ea6398ea" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 41377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cf0adc8e9394fcdb186635f6c368161" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 45347 } health_report { overall_health: HEALTHY } } }
I20260810 15:29:30.930413 19891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:30.927595 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55992 (local address 127.18.68.130:45347)
0810 15:29:30.927673 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0810 15:29:30.927675 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:29:30.927683 (+ 8us) server_negotiation.cc:407] Connection header received
0810 15:29:30.927732 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:29:30.927733 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:29:30.927756 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:29:30.927838 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 15:29:30.927985 (+ 147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:30.928708 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:30.929465 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:30.929733 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:30.929801 (+ 68us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:30.929955 (+ 154us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 15:29:30.930109 (+ 154us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 15:29:30.930257 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0810 15:29:30.930289 (+ 32us) server_negotiation.cc:299] Negotiation successful
0810 15:29:30.930301 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260810 15:29:30.932631 19325 raft_consensus.cc:1261] T 5e57d4eb836647bbbdd5ba222ad5fbba P 7f388f9dfd214c3296c8d329ea6398ea [term 1 FOLLOWER]: Refusing update from remote peer 3cf0adc8e9394fcdb186635f6c368161: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 15:29:30.932631 19790 raft_consensus.cc:1261] T 5e57d4eb836647bbbdd5ba222ad5fbba P 9b39087135b7435ca79247024756cc16 [term 1 FOLLOWER]: Refusing update from remote peer 3cf0adc8e9394fcdb186635f6c368161: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 15:29:30.933092 19912 consensus_queue.cc:1035] T 5e57d4eb836647bbbdd5ba222ad5fbba P 3cf0adc8e9394fcdb186635f6c368161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b39087135b7435ca79247024756cc16" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 37861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 15:29:30.933290 19907 consensus_queue.cc:1035] T 5e57d4eb836647bbbdd5ba222ad5fbba P 3cf0adc8e9394fcdb186635f6c368161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f388f9dfd214c3296c8d329ea6398ea" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 41377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 15:29:30.937249 19922 mvcc.cc:205] Tried to move back new op lower bound from 7316995157736398848 to 7316995157582356480. Current Snapshot: MvccSnapshot[applied={T|T < 7316995157736398848}]
I20260810 15:29:30.938936 19072 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40832:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 15:29:30.939040 19072 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40832:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 15:29:30.939880 19072 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 118266cda32d42489d20d0e00395a44f: Sending DeleteTablet for 3 replicas of tablet 5e57d4eb836647bbbdd5ba222ad5fbba
I20260810 15:29:30.940200 19523 tablet_service.cc:1514] Processing DeleteTablet for tablet 5e57d4eb836647bbbdd5ba222ad5fbba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 15:29:30 UTC) from {username='slave'} at 127.0.0.1:55988
I20260810 15:29:30.940230 19294 tablet_service.cc:1514] Processing DeleteTablet for tablet 5e57d4eb836647bbbdd5ba222ad5fbba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 15:29:30 UTC) from {username='slave'} at 127.0.0.1:55386
I20260810 15:29:30.940282 19756 tablet_service.cc:1514] Processing DeleteTablet for tablet 5e57d4eb836647bbbdd5ba222ad5fbba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 15:29:30 UTC) from {username='slave'} at 127.0.0.1:39446
I20260810 15:29:30.940508 19947 tablet_replica.cc:330] T 5e57d4eb836647bbbdd5ba222ad5fbba P 9b39087135b7435ca79247024756cc16: stopping tablet replica
I20260810 15:29:30.940653 19947 raft_consensus.cc:2229] T 5e57d4eb836647bbbdd5ba222ad5fbba P 9b39087135b7435ca79247024756cc16 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 15:29:30.940769 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 19169
I20260810 15:29:30.948868 19947 raft_consensus.cc:2258] T 5e57d4eb836647bbbdd5ba222ad5fbba P 9b39087135b7435ca79247024756cc16 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 15:29:30.954355 19940 tablet_replica.cc:330] T 5e57d4eb836647bbbdd5ba222ad5fbba P 3cf0adc8e9394fcdb186635f6c368161: stopping tablet replica
I20260810 15:29:30.954499 19940 raft_consensus.cc:2229] T 5e57d4eb836647bbbdd5ba222ad5fbba P 3cf0adc8e9394fcdb186635f6c368161 [term 1 LEADER]: Raft consensus shutting down.
I20260810 15:29:30.954640 19940 raft_consensus.cc:2258] T 5e57d4eb836647bbbdd5ba222ad5fbba P 3cf0adc8e9394fcdb186635f6c368161 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 15:29:30.960481 19940 ts_tablet_manager.cc:1905] T 5e57d4eb836647bbbdd5ba222ad5fbba P 3cf0adc8e9394fcdb186635f6c368161: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 15:29:30.962571 19947 ts_tablet_manager.cc:1905] T 5e57d4eb836647bbbdd5ba222ad5fbba P 9b39087135b7435ca79247024756cc16: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 15:29:30.963006 19940 ts_tablet_manager.cc:1918] T 5e57d4eb836647bbbdd5ba222ad5fbba P 3cf0adc8e9394fcdb186635f6c368161: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 15:29:30.963207 19940 log.cc:1196] T 5e57d4eb836647bbbdd5ba222ad5fbba P 3cf0adc8e9394fcdb186635f6c368161: Deleting WAL directory at /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786375520124696-18706-0/minicluster-data/ts-1/wal/wals/5e57d4eb836647bbbdd5ba222ad5fbba
I20260810 15:29:30.963752 19940 ts_tablet_manager.cc:1939] T 5e57d4eb836647bbbdd5ba222ad5fbba P 3cf0adc8e9394fcdb186635f6c368161: Deleting consensus metadata
I20260810 15:29:30.964329 19045 catalog_manager.cc:4841] TS 3cf0adc8e9394fcdb186635f6c368161 (127.18.68.130:45347): tablet 5e57d4eb836647bbbdd5ba222ad5fbba (table test-table [id=59cb8d39ebf54b05bdcd55573852b622]) successfully deleted
I20260810 15:29:30.964376 19947 ts_tablet_manager.cc:1918] T 5e57d4eb836647bbbdd5ba222ad5fbba P 9b39087135b7435ca79247024756cc16: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 15:29:30.964463 19947 log.cc:1196] T 5e57d4eb836647bbbdd5ba222ad5fbba P 9b39087135b7435ca79247024756cc16: Deleting WAL directory at /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786375520124696-18706-0/minicluster-data/ts-2/wal/wals/5e57d4eb836647bbbdd5ba222ad5fbba
I20260810 15:29:30.964807 19947 ts_tablet_manager.cc:1939] T 5e57d4eb836647bbbdd5ba222ad5fbba P 9b39087135b7435ca79247024756cc16: Deleting consensus metadata
W20260810 15:29:30.965422 19046 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.18.68.129:41377 (error 108)
I20260810 15:29:30.965662 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 19413
I20260810 15:29:30.965687 19046 catalog_manager.cc:4841] TS 9b39087135b7435ca79247024756cc16 (127.18.68.131:37861): tablet 5e57d4eb836647bbbdd5ba222ad5fbba (table test-table [id=59cb8d39ebf54b05bdcd55573852b622]) successfully deleted
I20260810 15:29:30.970605 19890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:30.965843 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.129:41377 (local address 127.0.0.1:55390)
0810 15:29:30.970482 (+ 4639us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:30.970559 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.129:41377: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":4605}
W20260810 15:29:30.974704 19046 catalog_manager.cc:4584] TS 7f388f9dfd214c3296c8d329ea6398ea (127.18.68.129:41377): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 5e57d4eb836647bbbdd5ba222ad5fbba: Network error: Client connection negotiation failed: client connection to 127.18.68.129:41377: connect: Connection refused (error 111)
I20260810 15:29:30.981122 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 19647
I20260810 15:29:30.998476 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 19022
2026-08-10T15:29:31Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (890 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786375520124696-18706-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 15:29:31 dist-test-slave-2p8l krb5kdc[19953](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 15:29:31 dist-test-slave-2p8l krb5kdc[19953](info): set up 2 sockets
Aug 10 15:29:31 dist-test-slave-2p8l krb5kdc[19953](info): commencing operation
krb5kdc: starting...
W20260810 15:29:32.310236 18706 mini_kdc.cc:121] Time spent starting KDC: real 1.281s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786375520124696-18706-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786375520124696-18706-0/krb5kdc/test-user.keytab.
Aug 10 15:29:32 dist-test-slave-2p8l krb5kdc[19953](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375772, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T15:29:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T15:29:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.68.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.68.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.68.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab.
Entry for principal kudu/127.18.68.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab.
I20260810 15:29:32.437071 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786375520124696-18706-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786375520124696-18706-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786375520124696-18706-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.190:41781
--webserver_interface=127.18.68.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab
--principal=kudu/127.18.68.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:36993
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.68.190:41781
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:29:32.519630 19977 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:29:32.519841 19977 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:29:32.519865 19977 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:29:32.521042 19977 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 15:29:32.521087 19977 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:29:32.521102 19977 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:29:32.521116 19977 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 15:29:32.521127 19977 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 15:29:32.522679 19977 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:36993
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786375520124696-18706-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786375520124696-18706-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.68.190:41781
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab
--principal=kudu/127.18.68.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.190:41781
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.68.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19977
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786375520124696-18706-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:29:32.522945 19977 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:29:32.523208 19977 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:29:32.528265 19997 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:29:32.528265 19984 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:29:32.528295 19987 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:29:32.528636 19977 server_base.cc:1034] running on GCE node
I20260810 15:29:32.528895 19977 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:29:32.529235 19977 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:29:32.530431 19977 hybrid_clock.cc:648] HybridClock initialized: now 1786375772530425 us; error 39 us; skew 500 ppm
Aug 10 15:29:32 dist-test-slave-2p8l krb5kdc[19953](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375772, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:29:32.533098 19977 init.cc:377] Logged in from keytab as kudu/127.18.68.190@KRBTEST.COM (short username kudu)
I20260810 15:29:32.533526 19977 webserver.cc:460] Webserver started at http://127.18.68.190:44533/ using document root <none> and password file <none>
I20260810 15:29:32.533738 19977 fs_manager.cc:359] Metadata directory not provided
I20260810 15:29:32.533780 19977 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:29:32.533869 19977 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:29:32.534951 19977 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786375520124696-18706-0/minicluster-data/master-0/data/instance:
uuid: "bc265c35943c45c5835a72840ea6a6b3"
format_stamp: "Formatted at 2026-08-10 15:29:32 on dist-test-slave-2p8l"
server_key: "c57cccd88f4b0d79dad1b3e176140712"
server_key_iv: "8d03440ec5372c60b05d7d25d5eb285d"
server_key_version: "encryptionkey@0"
I20260810 15:29:32.535262 19977 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786375520124696-18706-0/minicluster-data/master-0/wal/instance:
uuid: "bc265c35943c45c5835a72840ea6a6b3"
format_stamp: "Formatted at 2026-08-10 15:29:32 on dist-test-slave-2p8l"
server_key: "c57cccd88f4b0d79dad1b3e176140712"
server_key_iv: "8d03440ec5372c60b05d7d25d5eb285d"
server_key_version: "encryptionkey@0"
I20260810 15:29:32.536547 19977 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260810 15:29:32.537247 20007 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:29:32.537422 19977 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 15:29:32.537516 19977 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786375520124696-18706-0/minicluster-data/master-0/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786375520124696-18706-0/minicluster-data/master-0/wal
uuid: "bc265c35943c45c5835a72840ea6a6b3"
format_stamp: "Formatted at 2026-08-10 15:29:32 on dist-test-slave-2p8l"
server_key: "c57cccd88f4b0d79dad1b3e176140712"
server_key_iv: "8d03440ec5372c60b05d7d25d5eb285d"
server_key_version: "encryptionkey@0"
I20260810 15:29:32.537572 19977 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786375520124696-18706-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786375520124696-18706-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786375520124696-18706-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:29:32.548003 19977 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:29:32.550388 19977 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:29:32.550500 19977 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:29:32.554206 19977 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.190:41781
I20260810 15:29:32.554294 20099 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.190:41781 every 8 connection(s)
I20260810 15:29:32.554646 19977 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
I20260810 15:29:32.555536 20106 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:29:32.557812 20106 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bc265c35943c45c5835a72840ea6a6b3: Bootstrap starting.
I20260810 15:29:32.558481 20106 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bc265c35943c45c5835a72840ea6a6b3: Neither blocks nor log segments found. Creating new log.
I20260810 15:29:32.558815 20106 log.cc:824] T 00000000000000000000000000000000 P bc265c35943c45c5835a72840ea6a6b3: Log is configured to *not* fsync() on all Append() calls
I20260810 15:29:32.559679 20106 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bc265c35943c45c5835a72840ea6a6b3: No bootstrap required, opened a new log
I20260810 15:29:32.561358 20106 raft_consensus.cc:348] T 00000000000000000000000000000000 P bc265c35943c45c5835a72840ea6a6b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc265c35943c45c5835a72840ea6a6b3" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 41781 } }
I20260810 15:29:32.561537 20106 raft_consensus.cc:374] T 00000000000000000000000000000000 P bc265c35943c45c5835a72840ea6a6b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:29:32.561590 20106 raft_consensus.cc:729] T 00000000000000000000000000000000 P bc265c35943c45c5835a72840ea6a6b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc265c35943c45c5835a72840ea6a6b3, State: Initialized, Role: FOLLOWER
I20260810 15:29:32.561746 20106 consensus_queue.cc:260] T 00000000000000000000000000000000 P bc265c35943c45c5835a72840ea6a6b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc265c35943c45c5835a72840ea6a6b3" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 41781 } }
I20260810 15:29:32.561834 20106 raft_consensus.cc:388] T 00000000000000000000000000000000 P bc265c35943c45c5835a72840ea6a6b3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 15:29:32.561877 20106 raft_consensus.cc:482] T 00000000000000000000000000000000 P bc265c35943c45c5835a72840ea6a6b3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 15:29:32.561928 20106 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bc265c35943c45c5835a72840ea6a6b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:29:32.562310 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 19977
I20260810 15:29:32.562404 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786375520124696-18706-0/minicluster-data/master-0/wal/instance
I20260810 15:29:32.562623 18706 external_mini_cluster.cc:1428] Setting key ef56e6f2a5612753f0fb99cb5c3e2d38
I20260810 15:29:32.562649 20106 raft_consensus.cc:504] T 00000000000000000000000000000000 P bc265c35943c45c5835a72840ea6a6b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc265c35943c45c5835a72840ea6a6b3" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 41781 } }
I20260810 15:29:32.562780 20106 leader_election.cc:302] T 00000000000000000000000000000000 P bc265c35943c45c5835a72840ea6a6b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bc265c35943c45c5835a72840ea6a6b3; no voters:
I20260810 15:29:32.562999 20106 leader_election.cc:288] T 00000000000000000000000000000000 P bc265c35943c45c5835a72840ea6a6b3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 15:29:32.563028 20110 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bc265c35943c45c5835a72840ea6a6b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 15:29:32.563331 20110 raft_consensus.cc:686] T 00000000000000000000000000000000 P bc265c35943c45c5835a72840ea6a6b3 [term 1 LEADER]: Becoming Leader. State: Replica: bc265c35943c45c5835a72840ea6a6b3, State: Running, Role: LEADER
I20260810 15:29:32.563369 20106 sys_catalog.cc:564] T 00000000000000000000000000000000 P bc265c35943c45c5835a72840ea6a6b3 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 15:29:32.563472 20110 consensus_queue.cc:237] T 00000000000000000000000000000000 P bc265c35943c45c5835a72840ea6a6b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc265c35943c45c5835a72840ea6a6b3" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 41781 } }
I20260810 15:29:32.563845 20110 sys_catalog.cc:455] T 00000000000000000000000000000000 P bc265c35943c45c5835a72840ea6a6b3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bc265c35943c45c5835a72840ea6a6b3. Latest consensus state: current_term: 1 leader_uuid: "bc265c35943c45c5835a72840ea6a6b3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc265c35943c45c5835a72840ea6a6b3" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 41781 } } }
I20260810 15:29:32.563963 20110 sys_catalog.cc:458] T 00000000000000000000000000000000 P bc265c35943c45c5835a72840ea6a6b3 [sys.catalog]: This master's current role is: LEADER
I20260810 15:29:32.564075 20118 sys_catalog.cc:455] T 00000000000000000000000000000000 P bc265c35943c45c5835a72840ea6a6b3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bc265c35943c45c5835a72840ea6a6b3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc265c35943c45c5835a72840ea6a6b3" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 41781 } } }
I20260810 15:29:32.564201 20118 sys_catalog.cc:458] T 00000000000000000000000000000000 P bc265c35943c45c5835a72840ea6a6b3 [sys.catalog]: This master's current role is: LEADER
I20260810 15:29:32.564256 20133 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 15:29:32.564823 20133 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 15:29:32.566504 20133 catalog_manager.cc:1347] Generated new cluster ID: 63609622add342febcfb275c595dd142
I20260810 15:29:32.566555 20133 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 10 15:29:32 dist-test-slave-2p8l krb5kdc[19953](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375772, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
I20260810 15:29:32.574437 20119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:32.563189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43838 (local address 127.18.68.190:41781)
0810 15:29:32.563396 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0810 15:29:32.563407 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 15:29:32.563578 (+ 171us) server_negotiation.cc:407] Connection header received
0810 15:29:32.563710 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:29:32.563717 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:29:32.563772 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:29:32.563906 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:29:32.564943 (+ 1037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:32.566495 (+ 1552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:32.567278 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:32.567775 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:32.567909 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:32.570312 (+ 2403us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:29:32.570316 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:29:32.570317 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:29:32.570328 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:29:32.572616 (+ 2288us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:29:32.573102 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:29:32.573105 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:29:32.573105 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:29:32.573219 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:29:32.573443 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:29:32.573444 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:29:32.573444 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:29:32.573771 (+ 327us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:29:32.573942 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0810 15:29:32.574051 (+ 109us) server_negotiation.cc:299] Negotiation successful
0810 15:29:32.574216 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":100,"threads_started":1}
I20260810 15:29:32.577556 20133 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 15:29:32.578137 20133 catalog_manager.cc:1504] Loading token signing keys...
I20260810 15:29:32.585796 20133 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bc265c35943c45c5835a72840ea6a6b3: Generated new TSK 0
I20260810 15:29:32.585983 20133 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.18.68.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.68.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.68.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.129.keytab.
Entry for principal kudu/127.18.68.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.129.keytab.
I20260810 15:29:32.620267 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786375520124696-18706-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786375520124696-18706-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786375520124696-18706-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786375520124696-18706-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.68.129:0
--local_ip_for_outbound_sockets=127.18.68.129
--webserver_interface=127.18.68.129
--webserver_port=0
--tserver_master_addrs=127.18.68.190:41781
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.129.keytab
--principal=kudu/127.18.68.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:36993
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:29:32.740247 20157 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:29:32.740520 20157 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:29:32.740554 20157 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:29:32.742305 20157 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:29:32.742357 20157 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:29:32.742395 20157 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.68.129
I20260810 15:29:32.744626 20157 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:36993
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786375520124696-18706-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786375520124696-18706-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.129.keytab
--principal=kudu/127.18.68.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.68.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786375520124696-18706-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.68.129
--webserver_port=0
--tserver_master_addrs=127.18.68.190:41781
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20157
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.68.129
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786375520124696-18706-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:29:32.744885 20157 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:29:32.745157 20157 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:29:32.751035 20179 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:29:32.751045 20171 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:29:32.751268 20157 server_base.cc:1034] running on GCE node
W20260810 15:29:32.751056 20172 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:29:32.751575 20157 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:29:32.751814 20157 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:29:32.753054 20157 hybrid_clock.cc:648] HybridClock initialized: now 1786375772753045 us; error 36 us; skew 500 ppm
Aug 10 15:29:32 dist-test-slave-2p8l krb5kdc[19953](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375772, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:29:32.755856 20157 init.cc:377] Logged in from keytab as kudu/127.18.68.129@KRBTEST.COM (short username kudu)
I20260810 15:29:32.756389 20157 webserver.cc:460] Webserver started at http://127.18.68.129:37249/ using document root <none> and password file <none>
I20260810 15:29:32.756652 20157 fs_manager.cc:359] Metadata directory not provided
I20260810 15:29:32.756726 20157 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:29:32.756879 20157 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:29:32.758144 20157 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786375520124696-18706-0/minicluster-data/ts-0/data/instance:
uuid: "4c609b97e0424129b1f3191ad3610d6a"
format_stamp: "Formatted at 2026-08-10 15:29:32 on dist-test-slave-2p8l"
server_key: "b683ca06f96f7c4412f59695962f2644"
server_key_iv: "78e66be6ea14eb2c65bd2f8ee3034734"
server_key_version: "encryptionkey@0"
I20260810 15:29:32.758539 20157 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786375520124696-18706-0/minicluster-data/ts-0/wal/instance:
uuid: "4c609b97e0424129b1f3191ad3610d6a"
format_stamp: "Formatted at 2026-08-10 15:29:32 on dist-test-slave-2p8l"
server_key: "b683ca06f96f7c4412f59695962f2644"
server_key_iv: "78e66be6ea14eb2c65bd2f8ee3034734"
server_key_version: "encryptionkey@0"
I20260810 15:29:32.759979 20157 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260810 15:29:32.760862 20191 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:29:32.761138 20157 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 15:29:32.761255 20157 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786375520124696-18706-0/minicluster-data/ts-0/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786375520124696-18706-0/minicluster-data/ts-0/wal
uuid: "4c609b97e0424129b1f3191ad3610d6a"
format_stamp: "Formatted at 2026-08-10 15:29:32 on dist-test-slave-2p8l"
server_key: "b683ca06f96f7c4412f59695962f2644"
server_key_iv: "78e66be6ea14eb2c65bd2f8ee3034734"
server_key_version: "encryptionkey@0"
I20260810 15:29:32.761334 20157 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786375520124696-18706-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786375520124696-18706-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786375520124696-18706-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:29:32.783933 20157 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:29:32.786283 20157 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:29:32.786477 20157 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:29:32.786744 20157 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 15:29:32.787117 20157 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 15:29:32.787177 20157 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 15:29:32.787213 20157 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 15:29:32.787242 20157 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 15:29:32.793488 20157 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.129:44925
I20260810 15:29:32.793561 20384 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.129:44925 every 8 connection(s)
I20260810 15:29:32.793866 20157 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786375520124696-18706-0/minicluster-data/ts-0/data/info.pb
I20260810 15:29:32.796963 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 20157
I20260810 15:29:32.797153 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786375520124696-18706-0/minicluster-data/ts-0/wal/instance
I20260810 15:29:32.797420 18706 external_mini_cluster.cc:1428] Setting key 9ca9e02cd345566e38dfbcbfbc050c6e
Aug 10 15:29:32 dist-test-slave-2p8l krb5kdc[19953](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375772, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.129@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
I20260810 15:29:32.805651 20119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:32.794732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.129:38075 (local address 127.18.68.190:41781)
0810 15:29:32.794809 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0810 15:29:32.794811 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:29:32.795076 (+ 265us) server_negotiation.cc:407] Connection header received
0810 15:29:32.795579 (+ 503us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:29:32.795580 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:29:32.795591 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:29:32.795679 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:29:32.796731 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:32.797354 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:32.798994 (+ 1640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:32.799191 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:32.799250 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:32.802161 (+ 2911us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:29:32.802162 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:29:32.802163 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:29:32.802169 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:29:32.804036 (+ 1867us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:29:32.804474 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:29:32.804476 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:29:32.804476 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:29:32.804575 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:29:32.804843 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:29:32.804845 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:29:32.804845 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:29:32.805022 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:29:32.805113 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0810 15:29:32.805415 (+ 302us) server_negotiation.cc:299] Negotiation successful
0810 15:29:32.805532 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260810 15:29:32.805673 20390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:32.794700 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:41781 (local address 127.18.68.129:38075)
0810 15:29:32.794904 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:32.794952 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0810 15:29:32.795481 (+ 529us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:29:32.795766 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:29:32.795770 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:29:32.796412 (+ 642us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:29:32.796636 (+ 224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:29:32.796641 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:29:32.797454 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:29:32.797456 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:29:32.798902 (+ 1446us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:29:32.798906 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:29:32.799286 (+ 380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:29:32.799287 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:29:32.799447 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:32.800013 (+ 566us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:29:32.800025 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:29:32.801960 (+ 1935us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:29:32.804149 (+ 2189us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:29:32.804156 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:29:32.804158 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:29:32.804390 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:29:32.804667 (+ 277us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:29:32.804667 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:29:32.804667 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:29:32.804768 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:29:32.805124 (+ 356us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:29:32.805132 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:29:32.805259 (+ 127us) client_negotiation.cc:769] Sending connection context
0810 15:29:32.805355 (+ 96us) client_negotiation.cc:240] Negotiation successful
0810 15:29:32.805487 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":124,"threads_started":1}
I20260810 15:29:32.806310 20385 heartbeater.cc:347] Connected to a master server at 127.18.68.190:41781
I20260810 15:29:32.806448 20385 heartbeater.cc:464] Registering TS with master...
I20260810 15:29:32.806682 20385 heartbeater.cc:511] Master 127.18.68.190:41781 requested a full tablet report, sending...
I20260810 15:29:32.807338 20038 ts_manager.cc:194] Registered new tserver with Master: 4c609b97e0424129b1f3191ad3610d6a (127.18.68.129:44925)
I20260810 15:29:32.808452 20038 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.68.129@KRBTEST.COM'} at 127.18.68.129:38075
WARNING: no policy specified for kudu/127.18.68.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.68.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.68.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.130.keytab.
Entry for principal kudu/127.18.68.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.130.keytab.
I20260810 15:29:32.828871 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786375520124696-18706-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786375520124696-18706-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786375520124696-18706-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786375520124696-18706-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.68.130:0
--local_ip_for_outbound_sockets=127.18.68.130
--webserver_interface=127.18.68.130
--webserver_port=0
--tserver_master_addrs=127.18.68.190:41781
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.130.keytab
--principal=kudu/127.18.68.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:36993
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:29:32.918741 20393 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:29:32.918996 20393 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:29:32.919039 20393 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:29:32.920240 20393 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:29:32.920312 20393 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:29:32.920357 20393 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.68.130
I20260810 15:29:32.921923 20393 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:36993
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786375520124696-18706-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786375520124696-18706-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.130.keytab
--principal=kudu/127.18.68.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.68.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786375520124696-18706-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.68.130
--webserver_port=0
--tserver_master_addrs=127.18.68.190:41781
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20393
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.68.130
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786375520124696-18706-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:29:32.922253 20393 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:29:32.922508 20393 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:29:32.927898 20409 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:29:32.927955 20407 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:29:32.927908 20406 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:29:32.928282 20393 server_base.cc:1034] running on GCE node
I20260810 15:29:32.928633 20393 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:29:32.928889 20393 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:29:32.930124 20393 hybrid_clock.cc:648] HybridClock initialized: now 1786375772930014 us; error 71 us; skew 500 ppm
Aug 10 15:29:32 dist-test-slave-2p8l krb5kdc[19953](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375772, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:29:32.933048 20393 init.cc:377] Logged in from keytab as kudu/127.18.68.130@KRBTEST.COM (short username kudu)
I20260810 15:29:32.933569 20393 webserver.cc:460] Webserver started at http://127.18.68.130:33923/ using document root <none> and password file <none>
I20260810 15:29:32.933851 20393 fs_manager.cc:359] Metadata directory not provided
I20260810 15:29:32.933928 20393 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:29:32.934154 20393 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:29:32.935312 20393 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786375520124696-18706-0/minicluster-data/ts-1/data/instance:
uuid: "8a67922cba7d454b830dc7e7fa396d15"
format_stamp: "Formatted at 2026-08-10 15:29:32 on dist-test-slave-2p8l"
server_key: "c9fab4c311902cdc6d9828bf60e6d49d"
server_key_iv: "fc2938c7dbdf081293670b040de57b42"
server_key_version: "encryptionkey@0"
I20260810 15:29:32.935698 20393 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786375520124696-18706-0/minicluster-data/ts-1/wal/instance:
uuid: "8a67922cba7d454b830dc7e7fa396d15"
format_stamp: "Formatted at 2026-08-10 15:29:32 on dist-test-slave-2p8l"
server_key: "c9fab4c311902cdc6d9828bf60e6d49d"
server_key_iv: "fc2938c7dbdf081293670b040de57b42"
server_key_version: "encryptionkey@0"
I20260810 15:29:32.937165 20393 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 15:29:32.938123 20417 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:29:32.938333 20393 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:29:32.938448 20393 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786375520124696-18706-0/minicluster-data/ts-1/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786375520124696-18706-0/minicluster-data/ts-1/wal
uuid: "8a67922cba7d454b830dc7e7fa396d15"
format_stamp: "Formatted at 2026-08-10 15:29:32 on dist-test-slave-2p8l"
server_key: "c9fab4c311902cdc6d9828bf60e6d49d"
server_key_iv: "fc2938c7dbdf081293670b040de57b42"
server_key_version: "encryptionkey@0"
I20260810 15:29:32.938537 20393 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786375520124696-18706-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786375520124696-18706-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786375520124696-18706-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:29:32.946597 20393 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:29:32.949096 20393 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:29:32.949285 20393 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:29:32.949550 20393 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 15:29:32.949892 20393 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 15:29:32.949949 20393 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 15:29:32.949995 20393 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 15:29:32.950022 20393 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 15:29:32.956341 20393 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.130:36115
I20260810 15:29:32.956408 20617 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.130:36115 every 8 connection(s)
I20260810 15:29:32.956760 20393 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786375520124696-18706-0/minicluster-data/ts-1/data/info.pb
Aug 10 15:29:32 dist-test-slave-2p8l krb5kdc[19953](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375772, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.130@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
I20260810 15:29:32.965714 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 20393
I20260810 15:29:32.965852 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786375520124696-18706-0/minicluster-data/ts-1/wal/instance
I20260810 15:29:32.966190 18706 external_mini_cluster.cc:1428] Setting key e3d09ee93bba06f647b202954accfeb7
I20260810 15:29:32.968003 20119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:32.957861 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.130:47405 (local address 127.18.68.190:41781)
0810 15:29:32.957964 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0810 15:29:32.957966 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:29:32.958330 (+ 364us) server_negotiation.cc:407] Connection header received
0810 15:29:32.958959 (+ 629us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:29:32.958961 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:29:32.958980 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:29:32.959032 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:29:32.960145 (+ 1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:32.960669 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:32.961705 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:32.961912 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:32.962003 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:32.964567 (+ 2564us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:29:32.964568 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:29:32.964568 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:29:32.964575 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:29:32.966394 (+ 1819us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:29:32.966961 (+ 567us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:29:32.966962 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:29:32.966962 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:29:32.967026 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:29:32.967329 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:29:32.967330 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:29:32.967330 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:29:32.967457 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:29:32.967539 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0810 15:29:32.967822 (+ 283us) server_negotiation.cc:299] Negotiation successful
0810 15:29:32.967912 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260810 15:29:32.968231 20622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:32.957809 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:41781 (local address 127.18.68.130:47405)
0810 15:29:32.958044 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:32.958125 (+ 81us) client_negotiation.cc:174] Beginning negotiation
0810 15:29:32.958835 (+ 710us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:29:32.959116 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:29:32.959123 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:29:32.959750 (+ 627us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:29:32.960006 (+ 256us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:29:32.960012 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:29:32.960779 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:29:32.960780 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:29:32.961606 (+ 826us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:29:32.961608 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:29:32.962016 (+ 408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:29:32.962017 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:29:32.962222 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:32.962812 (+ 590us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:29:32.962821 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:29:32.964430 (+ 1609us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:29:32.966482 (+ 2052us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:29:32.966491 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:29:32.966494 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:29:32.966863 (+ 369us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:29:32.967129 (+ 266us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:29:32.967130 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:29:32.967130 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:29:32.967251 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:29:32.967529 (+ 278us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:29:32.967536 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:29:32.967686 (+ 150us) client_negotiation.cc:769] Sending connection context
0810 15:29:32.967800 (+ 114us) client_negotiation.cc:240] Negotiation successful
0810 15:29:32.967971 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":104,"threads_started":1}
I20260810 15:29:32.968739 20618 heartbeater.cc:347] Connected to a master server at 127.18.68.190:41781
I20260810 15:29:32.968830 20618 heartbeater.cc:464] Registering TS with master...
I20260810 15:29:32.969058 20618 heartbeater.cc:511] Master 127.18.68.190:41781 requested a full tablet report, sending...
I20260810 15:29:32.969550 20038 ts_manager.cc:194] Registered new tserver with Master: 8a67922cba7d454b830dc7e7fa396d15 (127.18.68.130:36115)
I20260810 15:29:32.970157 20038 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.68.130@KRBTEST.COM'} at 127.18.68.130:47405
WARNING: no policy specified for kudu/127.18.68.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.68.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.68.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.131.keytab.
Entry for principal kudu/127.18.68.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.131.keytab.
I20260810 15:29:32.995502 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786375520124696-18706-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786375520124696-18706-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786375520124696-18706-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786375520124696-18706-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.68.131:0
--local_ip_for_outbound_sockets=127.18.68.131
--webserver_interface=127.18.68.131
--webserver_port=0
--tserver_master_addrs=127.18.68.190:41781
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.131.keytab
--principal=kudu/127.18.68.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:36993
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:29:33.084940 20625 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:29:33.085150 20625 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:29:33.085175 20625 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:29:33.086599 20625 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:29:33.086645 20625 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:29:33.086673 20625 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.68.131
I20260810 15:29:33.088125 20625 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:36993
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786375520124696-18706-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786375520124696-18706-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.131.keytab
--principal=kudu/127.18.68.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.68.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786375520124696-18706-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.68.131
--webserver_port=0
--tserver_master_addrs=127.18.68.190:41781
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20625
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.68.131
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786375520124696-18706-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:29:33.088374 20625 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:29:33.088617 20625 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:29:33.093767 20637 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:29:33.093786 20634 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:29:33.093825 20633 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:29:33.094143 20625 server_base.cc:1034] running on GCE node
I20260810 15:29:33.094424 20625 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:29:33.094686 20625 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:29:33.095885 20625 hybrid_clock.cc:648] HybridClock initialized: now 1786375773095874 us; error 41 us; skew 500 ppm
Aug 10 15:29:33 dist-test-slave-2p8l krb5kdc[19953](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375773, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:29:33.098698 20625 init.cc:377] Logged in from keytab as kudu/127.18.68.131@KRBTEST.COM (short username kudu)
I20260810 15:29:33.099195 20625 webserver.cc:460] Webserver started at http://127.18.68.131:39153/ using document root <none> and password file <none>
I20260810 15:29:33.099426 20625 fs_manager.cc:359] Metadata directory not provided
I20260810 15:29:33.099499 20625 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:29:33.099669 20625 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:29:33.100759 20625 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786375520124696-18706-0/minicluster-data/ts-2/data/instance:
uuid: "65880cc10b4f4dde96e1658729310c88"
format_stamp: "Formatted at 2026-08-10 15:29:33 on dist-test-slave-2p8l"
server_key: "4675ad94864b2e56aa832793508d85ea"
server_key_iv: "b9f6744089d24ebd3542f96a2dfc70ca"
server_key_version: "encryptionkey@0"
I20260810 15:29:33.101133 20625 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786375520124696-18706-0/minicluster-data/ts-2/wal/instance:
uuid: "65880cc10b4f4dde96e1658729310c88"
format_stamp: "Formatted at 2026-08-10 15:29:33 on dist-test-slave-2p8l"
server_key: "4675ad94864b2e56aa832793508d85ea"
server_key_iv: "b9f6744089d24ebd3542f96a2dfc70ca"
server_key_version: "encryptionkey@0"
I20260810 15:29:33.102608 20625 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 15:29:33.103390 20648 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:29:33.103593 20625 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 15:29:33.103714 20625 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786375520124696-18706-0/minicluster-data/ts-2/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786375520124696-18706-0/minicluster-data/ts-2/wal
uuid: "65880cc10b4f4dde96e1658729310c88"
format_stamp: "Formatted at 2026-08-10 15:29:33 on dist-test-slave-2p8l"
server_key: "4675ad94864b2e56aa832793508d85ea"
server_key_iv: "b9f6744089d24ebd3542f96a2dfc70ca"
server_key_version: "encryptionkey@0"
I20260810 15:29:33.103796 20625 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786375520124696-18706-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786375520124696-18706-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786375520124696-18706-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:29:33.132274 20625 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:29:33.134938 20625 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:29:33.135119 20625 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:29:33.135407 20625 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 15:29:33.135752 20625 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 15:29:33.135809 20625 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 15:29:33.135843 20625 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 15:29:33.135874 20625 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 15:29:33.142529 20625 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.131:39361
I20260810 15:29:33.142576 20860 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.131:39361 every 8 connection(s)
I20260810 15:29:33.142952 20625 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786375520124696-18706-0/minicluster-data/ts-2/data/info.pb
Aug 10 15:29:33 dist-test-slave-2p8l krb5kdc[19953](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375773, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.131@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
I20260810 15:29:33.151716 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 20625
I20260810 15:29:33.151834 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786375520124696-18706-0/minicluster-data/ts-2/wal/instance
I20260810 15:29:33.152057 18706 external_mini_cluster.cc:1428] Setting key 6c5f87beac61047c80a90db97aa7afc0
I20260810 15:29:33.152907 20119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:33.143824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.131:47821 (local address 127.18.68.190:41781)
0810 15:29:33.143901 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0810 15:29:33.143903 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:29:33.144146 (+ 243us) server_negotiation.cc:407] Connection header received
0810 15:29:33.144695 (+ 549us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:29:33.144696 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:29:33.144708 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:29:33.144767 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:29:33.145791 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:33.146396 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:33.147407 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:33.147627 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:33.147708 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:33.149987 (+ 2279us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:29:33.149988 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:29:33.149988 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:29:33.149995 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:29:33.151330 (+ 1335us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:29:33.151759 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:29:33.151761 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:29:33.151761 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:29:33.151820 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:29:33.152154 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:29:33.152155 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:29:33.152156 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:29:33.152281 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:29:33.152365 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0810 15:29:33.152728 (+ 363us) server_negotiation.cc:299] Negotiation successful
0810 15:29:33.152819 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260810 15:29:33.153280 20863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:33.143812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:41781 (local address 127.18.68.131:47821)
0810 15:29:33.144010 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:33.144047 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0810 15:29:33.144580 (+ 533us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:29:33.144842 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:29:33.144846 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:29:33.145414 (+ 568us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:29:33.145666 (+ 252us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:29:33.145671 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:29:33.146496 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:29:33.146497 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:29:33.147307 (+ 810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:29:33.147309 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:29:33.147716 (+ 407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:29:33.147717 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:29:33.147845 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:33.148390 (+ 545us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:29:33.148398 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:29:33.149879 (+ 1481us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:29:33.151428 (+ 1549us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:29:33.151435 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:29:33.151437 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:29:33.151676 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:29:33.151906 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:29:33.151907 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:29:33.151908 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:29:33.152062 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:29:33.152356 (+ 294us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:29:33.152364 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:29:33.152536 (+ 172us) client_negotiation.cc:769] Sending connection context
0810 15:29:33.152688 (+ 152us) client_negotiation.cc:240] Negotiation successful
0810 15:29:33.152860 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":103,"threads_started":1}
I20260810 15:29:33.153751 20861 heartbeater.cc:347] Connected to a master server at 127.18.68.190:41781
I20260810 15:29:33.153848 20861 heartbeater.cc:464] Registering TS with master...
I20260810 15:29:33.154002 20861 heartbeater.cc:511] Master 127.18.68.190:41781 requested a full tablet report, sending...
I20260810 15:29:33.154425 20038 ts_manager.cc:194] Registered new tserver with Master: 65880cc10b4f4dde96e1658729310c88 (127.18.68.131:39361)
I20260810 15:29:33.154767 20038 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.18.68.131@KRBTEST.COM'} at 127.18.68.131:47821
I20260810 15:29:33.164088 18706 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 15:29:33.171813 20119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:33.165808 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43852 (local address 127.18.68.190:41781)
0810 15:29:33.165856 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0810 15:29:33.165858 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:29:33.165996 (+ 138us) server_negotiation.cc:407] Connection header received
0810 15:29:33.166037 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:29:33.166038 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:29:33.166047 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:29:33.166143 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:29:33.166678 (+ 535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:33.167147 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:33.167843 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:33.168029 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:33.168101 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:33.169357 (+ 1256us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:29:33.169358 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:29:33.169358 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:29:33.169363 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:29:33.170658 (+ 1295us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:29:33.170987 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:29:33.170988 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:29:33.170989 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:29:33.171052 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:29:33.171257 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:29:33.171258 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:29:33.171258 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:29:33.171412 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:29:33.171497 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0810 15:29:33.171586 (+ 89us) server_negotiation.cc:299] Negotiation successful
0810 15:29:33.171660 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260810 15:29:33.173388 20038 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43852:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 15:29:33.175160 20038 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 15:29:33.181998 20885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:33.177820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35506 (local address 127.18.68.130:36115)
0810 15:29:33.178181 (+ 361us) server_negotiation.cc:206] Beginning negotiation
0810 15:29:33.178185 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 15:29:33.178195 (+ 10us) server_negotiation.cc:407] Connection header received
0810 15:29:33.178236 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:29:33.178238 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:29:33.178256 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:29:33.178335 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:29:33.178507 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:33.179785 (+ 1278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:33.181010 (+ 1225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:33.181560 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:33.181674 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:33.181740 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0810 15:29:33.181870 (+ 130us) server_negotiation.cc:299] Negotiation successful
0810 15:29:33.181915 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":330,"thread_start_us":133,"threads_started":1}
I20260810 15:29:33.181988 20881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:33.177628 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.129:44925 (local address 127.0.0.1:45338)
0810 15:29:33.178155 (+ 527us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:33.178167 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 15:29:33.178247 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:29:33.178566 (+ 319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:29:33.178567 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:29:33.178569 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:29:33.178624 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:29:33.178626 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:29:33.179977 (+ 1351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:29:33.179979 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:29:33.180992 (+ 1013us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:29:33.180996 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:29:33.181654 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:29:33.181656 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:29:33.181746 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:33.181761 (+ 15us) client_negotiation.cc:769] Sending connection context
0810 15:29:33.181840 (+ 79us) client_negotiation.cc:240] Negotiation successful
0810 15:29:33.181899 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":503,"thread_start_us":111,"threads_started":1}
I20260810 15:29:33.181994 20882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:33.177612 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.130:36115 (local address 127.0.0.1:35506)
0810 15:29:33.177915 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:33.177961 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0810 15:29:33.178032 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:29:33.178337 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:29:33.178341 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:29:33.178343 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:29:33.178413 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:29:33.178415 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:29:33.179897 (+ 1482us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:29:33.179898 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:29:33.180919 (+ 1021us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:29:33.180921 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:29:33.181688 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:29:33.181689 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:29:33.181754 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:33.181765 (+ 11us) client_negotiation.cc:769] Sending connection context
0810 15:29:33.181851 (+ 86us) client_negotiation.cc:240] Negotiation successful
0810 15:29:33.181899 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":263,"thread_start_us":54,"threads_started":1}
I20260810 15:29:33.182384 20887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:33.177908 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45338 (local address 127.18.68.129:44925)
0810 15:29:33.178145 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0810 15:29:33.178150 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 15:29:33.178322 (+ 172us) server_negotiation.cc:407] Connection header received
0810 15:29:33.178374 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:29:33.178377 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:29:33.178395 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:29:33.178478 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:29:33.178716 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:33.179886 (+ 1170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:33.181083 (+ 1197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:33.181556 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:33.181613 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:33.181689 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0810 15:29:33.182243 (+ 554us) server_negotiation.cc:299] Negotiation successful
0810 15:29:33.182295 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":201,"thread_start_us":94,"threads_started":1}
I20260810 15:29:33.183002 20503 tablet_service.cc:1467] Processing CreateTablet for tablet 3bcc1093b01a452b97e3eadac8dc9e26 (DEFAULT_TABLE table=test-table [id=f64499539d2c449f9dbb6ade4bd69e8d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 15:29:33.183073 20265 tablet_service.cc:1467] Processing CreateTablet for tablet 3bcc1093b01a452b97e3eadac8dc9e26 (DEFAULT_TABLE table=test-table [id=f64499539d2c449f9dbb6ade4bd69e8d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 15:29:33.183264 20878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:33.177647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.131:39361 (local address 127.0.0.1:37640)
0810 15:29:33.178201 (+ 554us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:33.178211 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 15:29:33.178251 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:29:33.178675 (+ 424us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:29:33.178676 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:29:33.178678 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:29:33.178724 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:29:33.178726 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:29:33.179574 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:29:33.179576 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:29:33.180912 (+ 1336us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:29:33.180914 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:29:33.183021 (+ 2107us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:29:33.183022 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:29:33.183090 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:33.183095 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 15:29:33.183152 (+ 57us) client_negotiation.cc:240] Negotiation successful
0810 15:29:33.183195 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":538,"thread_start_us":81,"threads_started":1}
I20260810 15:29:33.183393 20503 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3bcc1093b01a452b97e3eadac8dc9e26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:29:33.183478 20265 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3bcc1093b01a452b97e3eadac8dc9e26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:29:33.183527 20883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:33.177833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37640 (local address 127.18.68.131:39361)
0810 15:29:33.178492 (+ 659us) server_negotiation.cc:206] Beginning negotiation
0810 15:29:33.178497 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 15:29:33.178507 (+ 10us) server_negotiation.cc:407] Connection header received
0810 15:29:33.178545 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:29:33.178548 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:29:33.178562 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:29:33.178660 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:29:33.178783 (+ 123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:33.179470 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:33.181782 (+ 2312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:33.182855 (+ 1073us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:33.182928 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:33.182983 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0810 15:29:33.183374 (+ 391us) server_negotiation.cc:299] Negotiation successful
0810 15:29:33.183431 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":617,"thread_start_us":109,"threads_started":1}
I20260810 15:29:33.186007 20888 tablet_bootstrap.cc:492] T 3bcc1093b01a452b97e3eadac8dc9e26 P 8a67922cba7d454b830dc7e7fa396d15: Bootstrap starting.
I20260810 15:29:33.186121 20889 tablet_bootstrap.cc:492] T 3bcc1093b01a452b97e3eadac8dc9e26 P 4c609b97e0424129b1f3191ad3610d6a: Bootstrap starting.
I20260810 15:29:33.186836 20888 tablet_bootstrap.cc:654] T 3bcc1093b01a452b97e3eadac8dc9e26 P 8a67922cba7d454b830dc7e7fa396d15: Neither blocks nor log segments found. Creating new log.
I20260810 15:29:33.186913 20889 tablet_bootstrap.cc:654] T 3bcc1093b01a452b97e3eadac8dc9e26 P 4c609b97e0424129b1f3191ad3610d6a: Neither blocks nor log segments found. Creating new log.
I20260810 15:29:33.186925 20733 tablet_service.cc:1467] Processing CreateTablet for tablet 3bcc1093b01a452b97e3eadac8dc9e26 (DEFAULT_TABLE table=test-table [id=f64499539d2c449f9dbb6ade4bd69e8d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 15:29:33.187335 20733 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3bcc1093b01a452b97e3eadac8dc9e26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:29:33.187479 20888 log.cc:824] T 3bcc1093b01a452b97e3eadac8dc9e26 P 8a67922cba7d454b830dc7e7fa396d15: Log is configured to *not* fsync() on all Append() calls
I20260810 15:29:33.187577 20889 log.cc:824] T 3bcc1093b01a452b97e3eadac8dc9e26 P 4c609b97e0424129b1f3191ad3610d6a: Log is configured to *not* fsync() on all Append() calls
I20260810 15:29:33.188311 20889 tablet_bootstrap.cc:492] T 3bcc1093b01a452b97e3eadac8dc9e26 P 4c609b97e0424129b1f3191ad3610d6a: No bootstrap required, opened a new log
I20260810 15:29:33.188329 20888 tablet_bootstrap.cc:492] T 3bcc1093b01a452b97e3eadac8dc9e26 P 8a67922cba7d454b830dc7e7fa396d15: No bootstrap required, opened a new log
I20260810 15:29:33.188395 20888 ts_tablet_manager.cc:1397] T 3bcc1093b01a452b97e3eadac8dc9e26 P 8a67922cba7d454b830dc7e7fa396d15: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 15:29:33.188397 20889 ts_tablet_manager.cc:1397] T 3bcc1093b01a452b97e3eadac8dc9e26 P 4c609b97e0424129b1f3191ad3610d6a: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 15:29:33.190196 20889 raft_consensus.cc:348] T 3bcc1093b01a452b97e3eadac8dc9e26 P 4c609b97e0424129b1f3191ad3610d6a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a67922cba7d454b830dc7e7fa396d15" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 36115 } } peers { permanent_uuid: "65880cc10b4f4dde96e1658729310c88" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 39361 } } peers { permanent_uuid: "4c609b97e0424129b1f3191ad3610d6a" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 44925 } }
I20260810 15:29:33.190389 20889 raft_consensus.cc:374] T 3bcc1093b01a452b97e3eadac8dc9e26 P 4c609b97e0424129b1f3191ad3610d6a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:29:33.190436 20889 raft_consensus.cc:729] T 3bcc1093b01a452b97e3eadac8dc9e26 P 4c609b97e0424129b1f3191ad3610d6a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c609b97e0424129b1f3191ad3610d6a, State: Initialized, Role: FOLLOWER
I20260810 15:29:33.190582 20889 consensus_queue.cc:260] T 3bcc1093b01a452b97e3eadac8dc9e26 P 4c609b97e0424129b1f3191ad3610d6a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a67922cba7d454b830dc7e7fa396d15" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 36115 } } peers { permanent_uuid: "65880cc10b4f4dde96e1658729310c88" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 39361 } } peers { permanent_uuid: "4c609b97e0424129b1f3191ad3610d6a" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 44925 } }
I20260810 15:29:33.190644 20888 raft_consensus.cc:348] T 3bcc1093b01a452b97e3eadac8dc9e26 P 8a67922cba7d454b830dc7e7fa396d15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a67922cba7d454b830dc7e7fa396d15" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 36115 } } peers { permanent_uuid: "65880cc10b4f4dde96e1658729310c88" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 39361 } } peers { permanent_uuid: "4c609b97e0424129b1f3191ad3610d6a" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 44925 } }
I20260810 15:29:33.190847 20888 raft_consensus.cc:374] T 3bcc1093b01a452b97e3eadac8dc9e26 P 8a67922cba7d454b830dc7e7fa396d15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:29:33.190887 20889 ts_tablet_manager.cc:1428] T 3bcc1093b01a452b97e3eadac8dc9e26 P 4c609b97e0424129b1f3191ad3610d6a: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260810 15:29:33.190898 20888 raft_consensus.cc:729] T 3bcc1093b01a452b97e3eadac8dc9e26 P 8a67922cba7d454b830dc7e7fa396d15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a67922cba7d454b830dc7e7fa396d15, State: Initialized, Role: FOLLOWER
I20260810 15:29:33.191045 20888 consensus_queue.cc:260] T 3bcc1093b01a452b97e3eadac8dc9e26 P 8a67922cba7d454b830dc7e7fa396d15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a67922cba7d454b830dc7e7fa396d15" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 36115 } } peers { permanent_uuid: "65880cc10b4f4dde96e1658729310c88" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 39361 } } peers { permanent_uuid: "4c609b97e0424129b1f3191ad3610d6a" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 44925 } }
I20260810 15:29:33.191171 20385 heartbeater.cc:503] Master 127.18.68.190:41781 was elected leader, sending a full tablet report...
I20260810 15:29:33.191344 20888 ts_tablet_manager.cc:1428] T 3bcc1093b01a452b97e3eadac8dc9e26 P 8a67922cba7d454b830dc7e7fa396d15: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 15:29:33.191497 20618 heartbeater.cc:503] Master 127.18.68.190:41781 was elected leader, sending a full tablet report...
I20260810 15:29:33.191649 20895 tablet_bootstrap.cc:492] T 3bcc1093b01a452b97e3eadac8dc9e26 P 65880cc10b4f4dde96e1658729310c88: Bootstrap starting.
I20260810 15:29:33.192402 20895 tablet_bootstrap.cc:654] T 3bcc1093b01a452b97e3eadac8dc9e26 P 65880cc10b4f4dde96e1658729310c88: Neither blocks nor log segments found. Creating new log.
I20260810 15:29:33.193066 20895 log.cc:824] T 3bcc1093b01a452b97e3eadac8dc9e26 P 65880cc10b4f4dde96e1658729310c88: Log is configured to *not* fsync() on all Append() calls
I20260810 15:29:33.193960 20895 tablet_bootstrap.cc:492] T 3bcc1093b01a452b97e3eadac8dc9e26 P 65880cc10b4f4dde96e1658729310c88: No bootstrap required, opened a new log
I20260810 15:29:33.194051 20895 ts_tablet_manager.cc:1397] T 3bcc1093b01a452b97e3eadac8dc9e26 P 65880cc10b4f4dde96e1658729310c88: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 15:29:33.195376 20895 raft_consensus.cc:348] T 3bcc1093b01a452b97e3eadac8dc9e26 P 65880cc10b4f4dde96e1658729310c88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a67922cba7d454b830dc7e7fa396d15" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 36115 } } peers { permanent_uuid: "65880cc10b4f4dde96e1658729310c88" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 39361 } } peers { permanent_uuid: "4c609b97e0424129b1f3191ad3610d6a" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 44925 } }
I20260810 15:29:33.195533 20895 raft_consensus.cc:374] T 3bcc1093b01a452b97e3eadac8dc9e26 P 65880cc10b4f4dde96e1658729310c88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:29:33.195614 20895 raft_consensus.cc:729] T 3bcc1093b01a452b97e3eadac8dc9e26 P 65880cc10b4f4dde96e1658729310c88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65880cc10b4f4dde96e1658729310c88, State: Initialized, Role: FOLLOWER
I20260810 15:29:33.195734 20895 consensus_queue.cc:260] T 3bcc1093b01a452b97e3eadac8dc9e26 P 65880cc10b4f4dde96e1658729310c88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a67922cba7d454b830dc7e7fa396d15" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 36115 } } peers { permanent_uuid: "65880cc10b4f4dde96e1658729310c88" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 39361 } } peers { permanent_uuid: "4c609b97e0424129b1f3191ad3610d6a" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 44925 } }
I20260810 15:29:33.195991 20895 ts_tablet_manager.cc:1428] T 3bcc1093b01a452b97e3eadac8dc9e26 P 65880cc10b4f4dde96e1658729310c88: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 15:29:33.196053 20861 heartbeater.cc:503] Master 127.18.68.190:41781 was elected leader, sending a full tablet report...
W20260810 15:29:33.207383 20619 tablet.cc:2369] T 3bcc1093b01a452b97e3eadac8dc9e26 P 8a67922cba7d454b830dc7e7fa396d15: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 15:29:33.253293 20901 raft_consensus.cc:482] T 3bcc1093b01a452b97e3eadac8dc9e26 P 65880cc10b4f4dde96e1658729310c88 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 15:29:33.253437 20901 raft_consensus.cc:504] T 3bcc1093b01a452b97e3eadac8dc9e26 P 65880cc10b4f4dde96e1658729310c88 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a67922cba7d454b830dc7e7fa396d15" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 36115 } } peers { permanent_uuid: "65880cc10b4f4dde96e1658729310c88" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 39361 } } peers { permanent_uuid: "4c609b97e0424129b1f3191ad3610d6a" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 44925 } }
I20260810 15:29:33.253791 20901 leader_election.cc:288] T 3bcc1093b01a452b97e3eadac8dc9e26 P 65880cc10b4f4dde96e1658729310c88 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a67922cba7d454b830dc7e7fa396d15 (127.18.68.130:36115), 4c609b97e0424129b1f3191ad3610d6a (127.18.68.129:44925)
I20260810 15:29:33.257994 20887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:33.254178 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.131:34483 (local address 127.18.68.129:44925)
0810 15:29:33.254224 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0810 15:29:33.254226 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:29:33.254363 (+ 137us) server_negotiation.cc:407] Connection header received
0810 15:29:33.254419 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:29:33.254420 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:29:33.254430 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:29:33.254504 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:29:33.254723 (+ 219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:33.255486 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:33.256956 (+ 1470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:33.257570 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:33.257668 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:33.257676 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0810 15:29:33.257876 (+ 200us) server_negotiation.cc:299] Negotiation successful
0810 15:29:33.257922 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260810 15:29:33.257994 20885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:33.254104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.131:47451 (local address 127.18.68.130:36115)
0810 15:29:33.254233 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0810 15:29:33.254236 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 15:29:33.254248 (+ 12us) server_negotiation.cc:407] Connection header received
0810 15:29:33.254284 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:29:33.254285 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:29:33.254301 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:29:33.254384 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:29:33.254605 (+ 221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:33.255462 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:33.256957 (+ 1495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:33.257589 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:33.257661 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:33.257671 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0810 15:29:33.257876 (+ 205us) server_negotiation.cc:299] Negotiation successful
0810 15:29:33.257922 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102}
I20260810 15:29:33.258026 20863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:33.253999 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.130:36115 (local address 127.18.68.131:47451)
0810 15:29:33.254121 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:33.254135 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 15:29:33.254185 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:29:33.254408 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:29:33.254409 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:29:33.254411 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:29:33.254511 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:29:33.254513 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:29:33.255575 (+ 1062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:29:33.255576 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:29:33.256829 (+ 1253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:29:33.256832 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:29:33.257693 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:29:33.257694 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:29:33.257783 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:33.257785 (+ 2us) client_negotiation.cc:769] Sending connection context
0810 15:29:33.257851 (+ 66us) client_negotiation.cc:240] Negotiation successful
0810 15:29:33.257905 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":100,"mutex_wait_us":47}
I20260810 15:29:33.258036 20906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:33.254048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.129:44925 (local address 127.18.68.131:34483)
0810 15:29:33.254293 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:33.254301 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0810 15:29:33.254364 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:29:33.254557 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:29:33.254558 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:29:33.254559 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:29:33.254645 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:29:33.254648 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:29:33.255575 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:29:33.255576 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:29:33.256829 (+ 1253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:29:33.256832 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:29:33.257693 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:29:33.257694 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:29:33.257780 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:33.257785 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 15:29:33.257851 (+ 66us) client_negotiation.cc:240] Negotiation successful
0810 15:29:33.257905 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":223,"mutex_wait_us":46,"thread_start_us":149,"threads_started":1}
I20260810 15:29:33.258468 20534 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bcc1093b01a452b97e3eadac8dc9e26" candidate_uuid: "65880cc10b4f4dde96e1658729310c88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a67922cba7d454b830dc7e7fa396d15" is_pre_election: true
I20260810 15:29:33.258467 20305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bcc1093b01a452b97e3eadac8dc9e26" candidate_uuid: "65880cc10b4f4dde96e1658729310c88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c609b97e0424129b1f3191ad3610d6a" is_pre_election: true
I20260810 15:29:33.258642 20534 raft_consensus.cc:2454] T 3bcc1093b01a452b97e3eadac8dc9e26 P 8a67922cba7d454b830dc7e7fa396d15 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65880cc10b4f4dde96e1658729310c88 in term 0.
I20260810 15:29:33.258651 20305 raft_consensus.cc:2454] T 3bcc1093b01a452b97e3eadac8dc9e26 P 4c609b97e0424129b1f3191ad3610d6a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65880cc10b4f4dde96e1658729310c88 in term 0.
I20260810 15:29:33.258958 20656 leader_election.cc:302] T 3bcc1093b01a452b97e3eadac8dc9e26 P 65880cc10b4f4dde96e1658729310c88 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65880cc10b4f4dde96e1658729310c88, 8a67922cba7d454b830dc7e7fa396d15; no voters:
I20260810 15:29:33.259102 20901 raft_consensus.cc:2781] T 3bcc1093b01a452b97e3eadac8dc9e26 P 65880cc10b4f4dde96e1658729310c88 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 15:29:33.259179 20901 raft_consensus.cc:482] T 3bcc1093b01a452b97e3eadac8dc9e26 P 65880cc10b4f4dde96e1658729310c88 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 15:29:33.259212 20901 raft_consensus.cc:3037] T 3bcc1093b01a452b97e3eadac8dc9e26 P 65880cc10b4f4dde96e1658729310c88 [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:29:33.259919 20901 raft_consensus.cc:504] T 3bcc1093b01a452b97e3eadac8dc9e26 P 65880cc10b4f4dde96e1658729310c88 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a67922cba7d454b830dc7e7fa396d15" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 36115 } } peers { permanent_uuid: "65880cc10b4f4dde96e1658729310c88" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 39361 } } peers { permanent_uuid: "4c609b97e0424129b1f3191ad3610d6a" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 44925 } }
I20260810 15:29:33.260156 20901 leader_election.cc:288] T 3bcc1093b01a452b97e3eadac8dc9e26 P 65880cc10b4f4dde96e1658729310c88 [CANDIDATE]: Term 1 election: Requested vote from peers 8a67922cba7d454b830dc7e7fa396d15 (127.18.68.130:36115), 4c609b97e0424129b1f3191ad3610d6a (127.18.68.129:44925)
I20260810 15:29:33.260259 20534 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bcc1093b01a452b97e3eadac8dc9e26" candidate_uuid: "65880cc10b4f4dde96e1658729310c88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a67922cba7d454b830dc7e7fa396d15"
I20260810 15:29:33.260248 20305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bcc1093b01a452b97e3eadac8dc9e26" candidate_uuid: "65880cc10b4f4dde96e1658729310c88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c609b97e0424129b1f3191ad3610d6a"
I20260810 15:29:33.260346 20534 raft_consensus.cc:3037] T 3bcc1093b01a452b97e3eadac8dc9e26 P 8a67922cba7d454b830dc7e7fa396d15 [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:29:33.260357 20305 raft_consensus.cc:3037] T 3bcc1093b01a452b97e3eadac8dc9e26 P 4c609b97e0424129b1f3191ad3610d6a [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:29:33.261175 20305 raft_consensus.cc:2454] T 3bcc1093b01a452b97e3eadac8dc9e26 P 4c609b97e0424129b1f3191ad3610d6a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65880cc10b4f4dde96e1658729310c88 in term 1.
I20260810 15:29:33.261250 20534 raft_consensus.cc:2454] T 3bcc1093b01a452b97e3eadac8dc9e26 P 8a67922cba7d454b830dc7e7fa396d15 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65880cc10b4f4dde96e1658729310c88 in term 1.
I20260810 15:29:33.261443 20650 leader_election.cc:302] T 3bcc1093b01a452b97e3eadac8dc9e26 P 65880cc10b4f4dde96e1658729310c88 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c609b97e0424129b1f3191ad3610d6a, 65880cc10b4f4dde96e1658729310c88; no voters:
I20260810 15:29:33.261569 20901 raft_consensus.cc:2781] T 3bcc1093b01a452b97e3eadac8dc9e26 P 65880cc10b4f4dde96e1658729310c88 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 15:29:33.261771 20901 raft_consensus.cc:686] T 3bcc1093b01a452b97e3eadac8dc9e26 P 65880cc10b4f4dde96e1658729310c88 [term 1 LEADER]: Becoming Leader. State: Replica: 65880cc10b4f4dde96e1658729310c88, State: Running, Role: LEADER
I20260810 15:29:33.261873 20901 consensus_queue.cc:237] T 3bcc1093b01a452b97e3eadac8dc9e26 P 65880cc10b4f4dde96e1658729310c88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a67922cba7d454b830dc7e7fa396d15" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 36115 } } peers { permanent_uuid: "65880cc10b4f4dde96e1658729310c88" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 39361 } } peers { permanent_uuid: "4c609b97e0424129b1f3191ad3610d6a" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 44925 } }
I20260810 15:29:33.262868 20038 catalog_manager.cc:5495] T 3bcc1093b01a452b97e3eadac8dc9e26 P 65880cc10b4f4dde96e1658729310c88 reported cstate change: term changed from 0 to 1, leader changed from <none> to 65880cc10b4f4dde96e1658729310c88 (127.18.68.131). New cstate: current_term: 1 leader_uuid: "65880cc10b4f4dde96e1658729310c88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a67922cba7d454b830dc7e7fa396d15" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 36115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65880cc10b4f4dde96e1658729310c88" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 39361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c609b97e0424129b1f3191ad3610d6a" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 44925 } health_report { overall_health: UNKNOWN } } }
I20260810 15:29:33.278424 20883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:33.275879 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37644 (local address 127.18.68.131:39361)
0810 15:29:33.275947 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0810 15:29:33.275949 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:29:33.275959 (+ 10us) server_negotiation.cc:407] Connection header received
0810 15:29:33.276006 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:29:33.276007 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:29:33.276030 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:29:33.276137 (+ 107us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 15:29:33.276279 (+ 142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:33.276772 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:33.277541 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:33.277756 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:33.277832 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:33.278012 (+ 180us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 15:29:33.278193 (+ 181us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 15:29:33.278291 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0810 15:29:33.278311 (+ 20us) server_negotiation.cc:299] Negotiation successful
0810 15:29:33.278332 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260810 15:29:33.280458 20534 raft_consensus.cc:1261] T 3bcc1093b01a452b97e3eadac8dc9e26 P 8a67922cba7d454b830dc7e7fa396d15 [term 1 FOLLOWER]: Refusing update from remote peer 65880cc10b4f4dde96e1658729310c88: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 15:29:33.280458 20305 raft_consensus.cc:1261] T 3bcc1093b01a452b97e3eadac8dc9e26 P 4c609b97e0424129b1f3191ad3610d6a [term 1 FOLLOWER]: Refusing update from remote peer 65880cc10b4f4dde96e1658729310c88: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 15:29:33.280877 20908 consensus_queue.cc:1035] T 3bcc1093b01a452b97e3eadac8dc9e26 P 65880cc10b4f4dde96e1658729310c88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a67922cba7d454b830dc7e7fa396d15" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 36115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 15:29:33.281068 20901 consensus_queue.cc:1035] T 3bcc1093b01a452b97e3eadac8dc9e26 P 65880cc10b4f4dde96e1658729310c88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c609b97e0424129b1f3191ad3610d6a" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 44925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 15:29:33.283954 20915 mvcc.cc:205] Tried to move back new op lower bound from 7316995167353618432 to 7316995167281537024. Current Snapshot: MvccSnapshot[applied={T|T < 7316995167353618432 or (T in {7316995167353618432})}]
I20260810 15:29:33.284108 20918 mvcc.cc:205] Tried to move back new op lower bound from 7316995167353618432 to 7316995167281537024. Current Snapshot: MvccSnapshot[applied={T|T < 7316995167353618432}]
I20260810 15:29:33.285867 20038 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43852:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 15:29:33.285975 20038 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43852:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 15:29:33.286821 20038 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bc265c35943c45c5835a72840ea6a6b3: Sending DeleteTablet for 3 replicas of tablet 3bcc1093b01a452b97e3eadac8dc9e26
I20260810 15:29:33.287190 20265 tablet_service.cc:1514] Processing DeleteTablet for tablet 3bcc1093b01a452b97e3eadac8dc9e26 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 15:29:33 UTC) from {username='kudu', principal='kudu/127.18.68.190@KRBTEST.COM'} at 127.0.0.1:45338
I20260810 15:29:33.287204 20733 tablet_service.cc:1514] Processing DeleteTablet for tablet 3bcc1093b01a452b97e3eadac8dc9e26 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 15:29:33 UTC) from {username='kudu', principal='kudu/127.18.68.190@KRBTEST.COM'} at 127.0.0.1:37640
I20260810 15:29:33.287457 20937 tablet_replica.cc:330] T 3bcc1093b01a452b97e3eadac8dc9e26 P 4c609b97e0424129b1f3191ad3610d6a: stopping tablet replica
I20260810 15:29:33.287456 20503 tablet_service.cc:1514] Processing DeleteTablet for tablet 3bcc1093b01a452b97e3eadac8dc9e26 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 15:29:33 UTC) from {username='kudu', principal='kudu/127.18.68.190@KRBTEST.COM'} at 127.0.0.1:35506
I20260810 15:29:33.287570 20937 raft_consensus.cc:2229] T 3bcc1093b01a452b97e3eadac8dc9e26 P 4c609b97e0424129b1f3191ad3610d6a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 15:29:33.287698 20937 raft_consensus.cc:2258] T 3bcc1093b01a452b97e3eadac8dc9e26 P 4c609b97e0424129b1f3191ad3610d6a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 15:29:33.287709 20940 tablet_replica.cc:330] T 3bcc1093b01a452b97e3eadac8dc9e26 P 8a67922cba7d454b830dc7e7fa396d15: stopping tablet replica
I20260810 15:29:33.287851 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 20157
I20260810 15:29:33.287889 20940 raft_consensus.cc:2229] T 3bcc1093b01a452b97e3eadac8dc9e26 P 8a67922cba7d454b830dc7e7fa396d15 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 15:29:33.288465 20938 tablet_replica.cc:330] T 3bcc1093b01a452b97e3eadac8dc9e26 P 65880cc10b4f4dde96e1658729310c88: stopping tablet replica
I20260810 15:29:33.288560 20938 raft_consensus.cc:2229] T 3bcc1093b01a452b97e3eadac8dc9e26 P 65880cc10b4f4dde96e1658729310c88 [term 1 LEADER]: Raft consensus shutting down.
I20260810 15:29:33.288690 20938 raft_consensus.cc:2258] T 3bcc1093b01a452b97e3eadac8dc9e26 P 65880cc10b4f4dde96e1658729310c88 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 15:29:33.288811 20940 raft_consensus.cc:2258] T 3bcc1093b01a452b97e3eadac8dc9e26 P 8a67922cba7d454b830dc7e7fa396d15 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 15:29:33.294888 20940 ts_tablet_manager.cc:1905] T 3bcc1093b01a452b97e3eadac8dc9e26 P 8a67922cba7d454b830dc7e7fa396d15: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 15:29:33.296041 20938 ts_tablet_manager.cc:1905] T 3bcc1093b01a452b97e3eadac8dc9e26 P 65880cc10b4f4dde96e1658729310c88: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 15:29:33.296757 20940 ts_tablet_manager.cc:1918] T 3bcc1093b01a452b97e3eadac8dc9e26 P 8a67922cba7d454b830dc7e7fa396d15: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 15:29:33.296911 20940 log.cc:1196] T 3bcc1093b01a452b97e3eadac8dc9e26 P 8a67922cba7d454b830dc7e7fa396d15: Deleting WAL directory at /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786375520124696-18706-0/minicluster-data/ts-1/wal/wals/3bcc1093b01a452b97e3eadac8dc9e26
I20260810 15:29:33.297290 20940 ts_tablet_manager.cc:1939] T 3bcc1093b01a452b97e3eadac8dc9e26 P 8a67922cba7d454b830dc7e7fa396d15: Deleting consensus metadata
I20260810 15:29:33.297817 20016 catalog_manager.cc:4841] TS 8a67922cba7d454b830dc7e7fa396d15 (127.18.68.130:36115): tablet 3bcc1093b01a452b97e3eadac8dc9e26 (table test-table [id=f64499539d2c449f9dbb6ade4bd69e8d]) successfully deleted
I20260810 15:29:33.297858 20938 ts_tablet_manager.cc:1918] T 3bcc1093b01a452b97e3eadac8dc9e26 P 65880cc10b4f4dde96e1658729310c88: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 15:29:33.297923 20938 log.cc:1196] T 3bcc1093b01a452b97e3eadac8dc9e26 P 65880cc10b4f4dde96e1658729310c88: Deleting WAL directory at /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786375520124696-18706-0/minicluster-data/ts-2/wal/wals/3bcc1093b01a452b97e3eadac8dc9e26
I20260810 15:29:33.298233 20938 ts_tablet_manager.cc:1939] T 3bcc1093b01a452b97e3eadac8dc9e26 P 65880cc10b4f4dde96e1658729310c88: Deleting consensus metadata
I20260810 15:29:33.305291 20012 catalog_manager.cc:4841] TS 65880cc10b4f4dde96e1658729310c88 (127.18.68.131:39361): tablet 3bcc1093b01a452b97e3eadac8dc9e26 (table test-table [id=f64499539d2c449f9dbb6ade4bd69e8d]) successfully deleted
W20260810 15:29:33.309616 20008 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.18.68.129:44925 (error 108)
I20260810 15:29:33.310252 20882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:33.310115 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.129:44925 (local address 127.0.0.1:45342)
0810 15:29:33.310164 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:33.310209 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.129:44925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
I20260810 15:29:33.310375 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 20393
W20260810 15:29:33.317868 20008 catalog_manager.cc:4584] TS 4c609b97e0424129b1f3191ad3610d6a (127.18.68.129:44925): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 3bcc1093b01a452b97e3eadac8dc9e26: Network error: Client connection negotiation failed: client connection to 127.18.68.129:44925: connect: Connection refused (error 111)
I20260810 15:29:33.322657 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 20625
I20260810 15:29:33.335057 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 19977
2026-08-10T15:29:33Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2333 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-10T15:29:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T15:29:33Z Disabled control of system clock
I20260810 15:29:33.371243 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786375520124696-18706-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786375520124696-18706-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786375520124696-18706-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.190:46705
--webserver_interface=127.18.68.190
--webserver_port=0
--builtin_ntp_servers=127.18.68.148:44565
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.68.190:46705
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260810 15:29:33.453105 20949 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:29:33.453315 20949 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:29:33.453336 20949 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:29:33.454443 20949 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 15:29:33.454480 20949 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:29:33.454493 20949 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:29:33.454506 20949 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 15:29:33.454519 20949 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 15:29:33.455791 20949 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:44565
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786375520124696-18706-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786375520124696-18706-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.68.190:46705
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.190:46705
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.68.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20949
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786375520124696-18706-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:29:33.455983 20949 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:29:33.456220 20949 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:29:33.461205 20963 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:29:33.461177 20964 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:29:33.461198 20967 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:29:33.461539 20949 server_base.cc:1034] running on GCE node
I20260810 15:29:33.461790 20949 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:29:33.462190 20949 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:29:33.463361 20949 hybrid_clock.cc:648] HybridClock initialized: now 1786375773463349 us; error 40 us; skew 500 ppm
I20260810 15:29:33.464797 20949 webserver.cc:460] Webserver started at http://127.18.68.190:38287/ using document root <none> and password file <none>
I20260810 15:29:33.465080 20949 fs_manager.cc:359] Metadata directory not provided
I20260810 15:29:33.465152 20949 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:29:33.465309 20949 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:29:33.466552 20949 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786375520124696-18706-0/minicluster-data/master-0/data/instance:
uuid: "4e1e93d5773c4e7295521d934e714cba"
format_stamp: "Formatted at 2026-08-10 15:29:33 on dist-test-slave-2p8l"
server_key: "e7168bf36138ba785c1c8bbed1c119df"
server_key_iv: "c77807f9d375a4459cc907497c3dc334"
server_key_version: "encryptionkey@0"
I20260810 15:29:33.466948 20949 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786375520124696-18706-0/minicluster-data/master-0/wal/instance:
uuid: "4e1e93d5773c4e7295521d934e714cba"
format_stamp: "Formatted at 2026-08-10 15:29:33 on dist-test-slave-2p8l"
server_key: "e7168bf36138ba785c1c8bbed1c119df"
server_key_iv: "c77807f9d375a4459cc907497c3dc334"
server_key_version: "encryptionkey@0"
I20260810 15:29:33.468322 20949 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260810 15:29:33.469177 20982 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:29:33.469362 20949 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:29:33.469455 20949 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786375520124696-18706-0/minicluster-data/master-0/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786375520124696-18706-0/minicluster-data/master-0/wal
uuid: "4e1e93d5773c4e7295521d934e714cba"
format_stamp: "Formatted at 2026-08-10 15:29:33 on dist-test-slave-2p8l"
server_key: "e7168bf36138ba785c1c8bbed1c119df"
server_key_iv: "c77807f9d375a4459cc907497c3dc334"
server_key_version: "encryptionkey@0"
I20260810 15:29:33.469543 20949 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786375520124696-18706-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786375520124696-18706-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786375520124696-18706-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:29:33.487609 20949 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:29:33.487927 20949 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:29:33.488037 20949 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:29:33.492148 20949 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.190:46705
I20260810 15:29:33.492187 21088 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.190:46705 every 8 connection(s)
I20260810 15:29:33.492551 20949 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
I20260810 15:29:33.493724 21089 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:29:33.496199 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 20949
I20260810 15:29:33.496320 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786375520124696-18706-0/minicluster-data/master-0/wal/instance
I20260810 15:29:33.496435 21089 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4e1e93d5773c4e7295521d934e714cba: Bootstrap starting.
I20260810 15:29:33.496536 18706 external_mini_cluster.cc:1428] Setting key cd3ca1d94b1290527636a194fbeb33f5
I20260810 15:29:33.497227 21089 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4e1e93d5773c4e7295521d934e714cba: Neither blocks nor log segments found. Creating new log.
I20260810 15:29:33.497592 21089 log.cc:824] T 00000000000000000000000000000000 P 4e1e93d5773c4e7295521d934e714cba: Log is configured to *not* fsync() on all Append() calls
I20260810 15:29:33.498466 21089 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4e1e93d5773c4e7295521d934e714cba: No bootstrap required, opened a new log
I20260810 15:29:33.500589 21089 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4e1e93d5773c4e7295521d934e714cba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e1e93d5773c4e7295521d934e714cba" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46705 } }
I20260810 15:29:33.500795 21089 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4e1e93d5773c4e7295521d934e714cba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:29:33.500849 21089 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4e1e93d5773c4e7295521d934e714cba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e1e93d5773c4e7295521d934e714cba, State: Initialized, Role: FOLLOWER
I20260810 15:29:33.500984 21089 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4e1e93d5773c4e7295521d934e714cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e1e93d5773c4e7295521d934e714cba" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46705 } }
I20260810 15:29:33.501070 21089 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4e1e93d5773c4e7295521d934e714cba [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 15:29:33.501120 21089 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4e1e93d5773c4e7295521d934e714cba [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 15:29:33.501170 21089 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4e1e93d5773c4e7295521d934e714cba [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:29:33.501976 21089 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4e1e93d5773c4e7295521d934e714cba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e1e93d5773c4e7295521d934e714cba" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46705 } }
I20260810 15:29:33.502130 21089 leader_election.cc:302] T 00000000000000000000000000000000 P 4e1e93d5773c4e7295521d934e714cba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4e1e93d5773c4e7295521d934e714cba; no voters:
I20260810 15:29:33.502336 21089 leader_election.cc:288] T 00000000000000000000000000000000 P 4e1e93d5773c4e7295521d934e714cba [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 15:29:33.502404 21095 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4e1e93d5773c4e7295521d934e714cba [term 1 FOLLOWER]: Leader election won for term 1
I20260810 15:29:33.502646 21089 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4e1e93d5773c4e7295521d934e714cba [sys.catalog]: configured and running, proceeding with master startup.
I20260810 15:29:33.502629 21095 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4e1e93d5773c4e7295521d934e714cba [term 1 LEADER]: Becoming Leader. State: Replica: 4e1e93d5773c4e7295521d934e714cba, State: Running, Role: LEADER
I20260810 15:29:33.502880 21095 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4e1e93d5773c4e7295521d934e714cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e1e93d5773c4e7295521d934e714cba" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46705 } }
I20260810 15:29:33.503204 21092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:33.497130 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54506 (local address 127.18.68.190:46705)
0810 15:29:33.497358 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0810 15:29:33.497371 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0810 15:29:33.497400 (+ 29us) server_negotiation.cc:407] Connection header received
0810 15:29:33.497929 (+ 529us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:29:33.497937 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:29:33.498001 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:29:33.498216 (+ 215us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:29:33.498471 (+ 255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:33.499434 (+ 963us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:33.500654 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:33.501299 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:33.501400 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:33.502191 (+ 791us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:29:33.502195 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:29:33.502196 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 15:29:33.502415 (+ 219us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:29:33.502465 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 15:29:33.502481 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:29:33.502853 (+ 372us) server_negotiation.cc:1035] Waiting for connection context
0810 15:29:33.502889 (+ 36us) server_negotiation.cc:299] Negotiation successful
0810 15:29:33.502986 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":100,"threads_started":1}
I20260810 15:29:33.503278 21097 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4e1e93d5773c4e7295521d934e714cba [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4e1e93d5773c4e7295521d934e714cba. Latest consensus state: current_term: 1 leader_uuid: "4e1e93d5773c4e7295521d934e714cba" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e1e93d5773c4e7295521d934e714cba" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46705 } } }
I20260810 15:29:33.503288 21096 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4e1e93d5773c4e7295521d934e714cba [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4e1e93d5773c4e7295521d934e714cba" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e1e93d5773c4e7295521d934e714cba" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46705 } } }
I20260810 15:29:33.504029 21096 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4e1e93d5773c4e7295521d934e714cba [sys.catalog]: This master's current role is: LEADER
I20260810 15:29:33.504014 21097 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4e1e93d5773c4e7295521d934e714cba [sys.catalog]: This master's current role is: LEADER
W20260810 15:29:33.504596 21115 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 4e1e93d5773c4e7295521d934e714cba: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 15:29:33.504659 21115 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 15:29:33.504745 21117 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 15:29:33.504964 21117 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 15:29:33.506464 21117 catalog_manager.cc:1347] Generated new cluster ID: 25850876aa7743f2a44dc7971958905b
I20260810 15:29:33.506521 21117 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 15:29:33.514683 21117 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 15:29:33.515230 21117 catalog_manager.cc:1504] Loading token signing keys...
I20260810 15:29:33.521072 21117 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4e1e93d5773c4e7295521d934e714cba: Generated new TSK 0
I20260810 15:29:33.521297 21117 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 15:29:33.525977 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786375520124696-18706-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786375520124696-18706-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786375520124696-18706-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786375520124696-18706-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.68.129:0
--local_ip_for_outbound_sockets=127.18.68.129
--webserver_interface=127.18.68.129
--webserver_port=0
--tserver_master_addrs=127.18.68.190:46705
--builtin_ntp_servers=127.18.68.148:44565
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260810 15:29:33.610471 21128 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:29:33.610728 21128 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:29:33.610754 21128 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:29:33.612097 21128 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:29:33.612147 21128 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:29:33.612177 21128 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.68.129
I20260810 15:29:33.613687 21128 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:44565
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786375520124696-18706-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786375520124696-18706-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.68.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786375520124696-18706-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.18.68.129
--webserver_port=0
--tserver_master_addrs=127.18.68.190:46705
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21128
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.68.129
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786375520124696-18706-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:29:33.613967 21128 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:29:33.614329 21128 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:29:33.620754 21148 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:29:33.620720 21141 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:29:33.620746 21128 server_base.cc:1034] running on GCE node
W20260810 15:29:33.620728 21142 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:29:33.621254 21128 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:29:33.621546 21128 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:29:33.622777 21128 hybrid_clock.cc:648] HybridClock initialized: now 1786375773622748 us; error 44 us; skew 500 ppm
I20260810 15:29:33.624195 21128 webserver.cc:460] Webserver started at http://127.18.68.129:42945/ using document root <none> and password file <none>
I20260810 15:29:33.624492 21128 fs_manager.cc:359] Metadata directory not provided
I20260810 15:29:33.624588 21128 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:29:33.624789 21128 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:29:33.625921 21128 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786375520124696-18706-0/minicluster-data/ts-0/data/instance:
uuid: "9c4e561a7e064a74b6d6e22965191b55"
format_stamp: "Formatted at 2026-08-10 15:29:33 on dist-test-slave-2p8l"
server_key: "c24cd59c42f5d3a86fc238e0003d46bd"
server_key_iv: "484ab6a97aa3fd11e3826ff907d54fea"
server_key_version: "encryptionkey@0"
I20260810 15:29:33.626365 21128 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786375520124696-18706-0/minicluster-data/ts-0/wal/instance:
uuid: "9c4e561a7e064a74b6d6e22965191b55"
format_stamp: "Formatted at 2026-08-10 15:29:33 on dist-test-slave-2p8l"
server_key: "c24cd59c42f5d3a86fc238e0003d46bd"
server_key_iv: "484ab6a97aa3fd11e3826ff907d54fea"
server_key_version: "encryptionkey@0"
I20260810 15:29:33.627817 21128 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:29:33.628641 21158 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:29:33.628827 21128 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:29:33.628939 21128 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786375520124696-18706-0/minicluster-data/ts-0/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786375520124696-18706-0/minicluster-data/ts-0/wal
uuid: "9c4e561a7e064a74b6d6e22965191b55"
format_stamp: "Formatted at 2026-08-10 15:29:33 on dist-test-slave-2p8l"
server_key: "c24cd59c42f5d3a86fc238e0003d46bd"
server_key_iv: "484ab6a97aa3fd11e3826ff907d54fea"
server_key_version: "encryptionkey@0"
I20260810 15:29:33.629019 21128 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786375520124696-18706-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786375520124696-18706-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786375520124696-18706-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:29:33.654345 21128 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:29:33.654723 21128 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:29:33.654898 21128 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:29:33.655184 21128 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 15:29:33.655568 21128 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 15:29:33.655627 21128 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 15:29:33.655671 21128 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 15:29:33.655715 21128 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 15:29:33.662177 21128 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.129:36833
I20260810 15:29:33.662192 21370 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.129:36833 every 8 connection(s)
I20260810 15:29:33.662722 21128 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786375520124696-18706-0/minicluster-data/ts-0/data/info.pb
I20260810 15:29:33.669076 21092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:33.663661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.129:39659 (local address 127.18.68.190:46705)
0810 15:29:33.663709 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0810 15:29:33.663711 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:29:33.664018 (+ 307us) server_negotiation.cc:407] Connection header received
0810 15:29:33.664622 (+ 604us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:29:33.664624 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:29:33.664636 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:29:33.664712 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:29:33.665505 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:33.666043 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:33.667172 (+ 1129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:33.667393 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:33.667463 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:33.668658 (+ 1195us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:29:33.668660 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:29:33.668660 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 15:29:33.668667 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:29:33.668700 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 15:29:33.668706 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:29:33.668757 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0810 15:29:33.668919 (+ 162us) server_negotiation.cc:299] Negotiation successful
0810 15:29:33.668951 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260810 15:29:33.669652 21382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:33.663616 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46705 (local address 127.18.68.129:39659)
0810 15:29:33.663847 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:33.663896 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0810 15:29:33.664454 (+ 558us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:29:33.664817 (+ 363us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:29:33.664821 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:29:33.664829 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:29:33.665399 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:29:33.665404 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:29:33.666223 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:29:33.666224 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:29:33.667029 (+ 805us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:29:33.667032 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:29:33.667495 (+ 463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:29:33.667496 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:29:33.667648 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:33.668398 (+ 750us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 15:29:33.668398 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:29:33.668445 (+ 47us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 15:29:33.668488 (+ 43us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:29:33.668781 (+ 293us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:29:33.668789 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:29:33.668792 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 15:29:33.669263 (+ 471us) client_negotiation.cc:240] Negotiation successful
0810 15:29:33.669381 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":111,"threads_started":1}
I20260810 15:29:33.670286 21371 heartbeater.cc:347] Connected to a master server at 127.18.68.190:46705
I20260810 15:29:33.670396 21371 heartbeater.cc:464] Registering TS with master...
I20260810 15:29:33.670598 21371 heartbeater.cc:511] Master 127.18.68.190:46705 requested a full tablet report, sending...
I20260810 15:29:33.671259 21017 ts_manager.cc:194] Registered new tserver with Master: 9c4e561a7e064a74b6d6e22965191b55 (127.18.68.129:36833)
I20260810 15:29:33.671918 21017 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.18.68.129:39659
I20260810 15:29:33.672660 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 21128
I20260810 15:29:33.672756 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786375520124696-18706-0/minicluster-data/ts-0/wal/instance
I20260810 15:29:33.672983 18706 external_mini_cluster.cc:1428] Setting key e866ffb668dff98245e812ca2a176c97
I20260810 15:29:33.674165 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786375520124696-18706-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786375520124696-18706-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786375520124696-18706-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786375520124696-18706-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.68.130:0
--local_ip_for_outbound_sockets=127.18.68.130
--webserver_interface=127.18.68.130
--webserver_port=0
--tserver_master_addrs=127.18.68.190:46705
--builtin_ntp_servers=127.18.68.148:44565
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260810 15:29:33.767779 21383 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:29:33.768072 21383 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:29:33.768110 21383 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:29:33.769419 21383 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:29:33.769500 21383 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:29:33.769546 21383 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.68.130
I20260810 15:29:33.771157 21383 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:44565
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786375520124696-18706-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786375520124696-18706-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.68.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786375520124696-18706-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.18.68.130
--webserver_port=0
--tserver_master_addrs=127.18.68.190:46705
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21383
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.68.130
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786375520124696-18706-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:29:33.771484 21383 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:29:33.771901 21383 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:29:33.777701 21391 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:29:33.777694 21389 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:29:33.777730 21383 server_base.cc:1034] running on GCE node
W20260810 15:29:33.777695 21395 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:29:33.778189 21383 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:29:33.778469 21383 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:29:33.779641 21383 hybrid_clock.cc:648] HybridClock initialized: now 1786375773779617 us; error 40 us; skew 500 ppm
I20260810 15:29:33.781191 21383 webserver.cc:460] Webserver started at http://127.18.68.130:35431/ using document root <none> and password file <none>
I20260810 15:29:33.781478 21383 fs_manager.cc:359] Metadata directory not provided
I20260810 15:29:33.781526 21383 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:29:33.781626 21383 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:29:33.782795 21383 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786375520124696-18706-0/minicluster-data/ts-1/data/instance:
uuid: "55ffc1d14c2044e680254b23b9fe3c30"
format_stamp: "Formatted at 2026-08-10 15:29:33 on dist-test-slave-2p8l"
server_key: "fc1246c0d9ebd7b1ed546594c6b4ce0e"
server_key_iv: "267aa6f09e1fdb849ad0f45481a3b595"
server_key_version: "encryptionkey@0"
I20260810 15:29:33.783138 21383 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786375520124696-18706-0/minicluster-data/ts-1/wal/instance:
uuid: "55ffc1d14c2044e680254b23b9fe3c30"
format_stamp: "Formatted at 2026-08-10 15:29:33 on dist-test-slave-2p8l"
server_key: "fc1246c0d9ebd7b1ed546594c6b4ce0e"
server_key_iv: "267aa6f09e1fdb849ad0f45481a3b595"
server_key_version: "encryptionkey@0"
I20260810 15:29:33.784498 21383 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 15:29:33.785420 21408 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:29:33.785625 21383 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:29:33.785723 21383 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786375520124696-18706-0/minicluster-data/ts-1/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786375520124696-18706-0/minicluster-data/ts-1/wal
uuid: "55ffc1d14c2044e680254b23b9fe3c30"
format_stamp: "Formatted at 2026-08-10 15:29:33 on dist-test-slave-2p8l"
server_key: "fc1246c0d9ebd7b1ed546594c6b4ce0e"
server_key_iv: "267aa6f09e1fdb849ad0f45481a3b595"
server_key_version: "encryptionkey@0"
I20260810 15:29:33.785785 21383 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786375520124696-18706-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786375520124696-18706-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786375520124696-18706-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:29:33.799844 21383 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:29:33.800159 21383 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:29:33.800269 21383 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:29:33.800544 21383 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 15:29:33.800935 21383 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 15:29:33.800972 21383 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 15:29:33.800997 21383 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 15:29:33.801009 21383 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 15:29:33.807222 21383 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.130:37977
I20260810 15:29:33.807345 21617 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.130:37977 every 8 connection(s)
I20260810 15:29:33.807659 21383 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786375520124696-18706-0/minicluster-data/ts-1/data/info.pb
I20260810 15:29:33.810634 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 21383
I20260810 15:29:33.810770 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786375520124696-18706-0/minicluster-data/ts-1/wal/instance
I20260810 15:29:33.810990 18706 external_mini_cluster.cc:1428] Setting key d6386ceaf3c1fd9bc77e4fbeec9ee424
I20260810 15:29:33.811956 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786375520124696-18706-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786375520124696-18706-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786375520124696-18706-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786375520124696-18706-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.18.68.131:0
--local_ip_for_outbound_sockets=127.18.68.131
--webserver_interface=127.18.68.131
--webserver_port=0
--tserver_master_addrs=127.18.68.190:46705
--builtin_ntp_servers=127.18.68.148:44565
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260810 15:29:33.813603 21092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:33.808484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.130:45005 (local address 127.18.68.190:46705)
0810 15:29:33.808560 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0810 15:29:33.808563 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 15:29:33.808875 (+ 312us) server_negotiation.cc:407] Connection header received
0810 15:29:33.809380 (+ 505us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:29:33.809381 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:29:33.809393 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:29:33.809450 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:29:33.810200 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:33.810928 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:33.812164 (+ 1236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:33.812358 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:33.812392 (+ 34us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:33.813311 (+ 919us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:29:33.813313 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:29:33.813313 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 15:29:33.813318 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:29:33.813337 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 15:29:33.813341 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:29:33.813409 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0810 15:29:33.813462 (+ 53us) server_negotiation.cc:299] Negotiation successful
0810 15:29:33.813491 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260810 15:29:33.813750 21622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:33.808460 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46705 (local address 127.18.68.130:45005)
0810 15:29:33.808699 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:33.808774 (+ 75us) client_negotiation.cc:174] Beginning negotiation
0810 15:29:33.809285 (+ 511us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:29:33.809526 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:29:33.809530 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:29:33.809539 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:29:33.810051 (+ 512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:29:33.810055 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:29:33.811025 (+ 970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:29:33.811041 (+ 16us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:29:33.812020 (+ 979us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:29:33.812023 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:29:33.812468 (+ 445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:29:33.812468 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:29:33.812575 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:33.813167 (+ 592us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 15:29:33.813167 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:29:33.813196 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 15:29:33.813220 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:29:33.813410 (+ 190us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:29:33.813413 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:29:33.813415 (+ 2us) client_negotiation.cc:769] Sending connection context
0810 15:29:33.813463 (+ 48us) client_negotiation.cc:240] Negotiation successful
0810 15:29:33.813540 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":113,"threads_started":1}
I20260810 15:29:33.814296 21619 heartbeater.cc:347] Connected to a master server at 127.18.68.190:46705
I20260810 15:29:33.814411 21619 heartbeater.cc:464] Registering TS with master...
I20260810 15:29:33.814591 21619 heartbeater.cc:511] Master 127.18.68.190:46705 requested a full tablet report, sending...
I20260810 15:29:33.815001 21017 ts_manager.cc:194] Registered new tserver with Master: 55ffc1d14c2044e680254b23b9fe3c30 (127.18.68.130:37977)
I20260810 15:29:33.815502 21017 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.18.68.130:45005
W20260810 15:29:33.900548 21624 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:29:33.900777 21624 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:29:33.900804 21624 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:29:33.902011 21624 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:29:33.902048 21624 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:29:33.902158 21624 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.68.131
I20260810 15:29:33.903885 21624 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:44565
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786375520124696-18706-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786375520124696-18706-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.18.68.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786375520124696-18706-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.18.68.131
--webserver_port=0
--tserver_master_addrs=127.18.68.190:46705
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21624
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.18.68.131
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786375520124696-18706-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:29:33.904090 21624 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:29:33.904362 21624 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:29:33.909761 21637 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:29:33.909751 21639 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:29:33.909898 21624 server_base.cc:1034] running on GCE node
W20260810 15:29:33.909731 21636 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:29:33.910176 21624 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:29:33.910470 21624 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:29:33.911660 21624 hybrid_clock.cc:648] HybridClock initialized: now 1786375773911638 us; error 38 us; skew 500 ppm
I20260810 15:29:33.912990 21624 webserver.cc:460] Webserver started at http://127.18.68.131:36699/ using document root <none> and password file <none>
I20260810 15:29:33.913301 21624 fs_manager.cc:359] Metadata directory not provided
I20260810 15:29:33.913381 21624 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:29:33.913558 21624 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:29:33.914832 21624 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786375520124696-18706-0/minicluster-data/ts-2/data/instance:
uuid: "ce5d5831f0854ed99fa9eadbe245cd14"
format_stamp: "Formatted at 2026-08-10 15:29:33 on dist-test-slave-2p8l"
server_key: "bbad89c513458f59f036820a2626821c"
server_key_iv: "5f38349270024e79cd247df3526ecb5f"
server_key_version: "encryptionkey@0"
I20260810 15:29:33.915236 21624 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786375520124696-18706-0/minicluster-data/ts-2/wal/instance:
uuid: "ce5d5831f0854ed99fa9eadbe245cd14"
format_stamp: "Formatted at 2026-08-10 15:29:33 on dist-test-slave-2p8l"
server_key: "bbad89c513458f59f036820a2626821c"
server_key_iv: "5f38349270024e79cd247df3526ecb5f"
server_key_version: "encryptionkey@0"
I20260810 15:29:33.916669 21624 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 15:29:33.917503 21649 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:29:33.917719 21624 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:29:33.917840 21624 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786375520124696-18706-0/minicluster-data/ts-2/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786375520124696-18706-0/minicluster-data/ts-2/wal
uuid: "ce5d5831f0854ed99fa9eadbe245cd14"
format_stamp: "Formatted at 2026-08-10 15:29:33 on dist-test-slave-2p8l"
server_key: "bbad89c513458f59f036820a2626821c"
server_key_iv: "5f38349270024e79cd247df3526ecb5f"
server_key_version: "encryptionkey@0"
I20260810 15:29:33.917922 21624 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786375520124696-18706-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786375520124696-18706-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786375520124696-18706-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:29:33.939213 21624 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:29:33.939610 21624 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:29:33.939793 21624 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:29:33.940074 21624 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 15:29:33.940470 21624 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 15:29:33.940532 21624 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 15:29:33.940594 21624 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 15:29:33.940627 21624 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 15:29:33.947527 21624 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.131:35323
I20260810 15:29:33.947597 21846 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.131:35323 every 8 connection(s)
I20260810 15:29:33.947970 21624 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786375520124696-18706-0/minicluster-data/ts-2/data/info.pb
I20260810 15:29:33.948627 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 21624
I20260810 15:29:33.948805 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786375520124696-18706-0/minicluster-data/ts-2/wal/instance
I20260810 15:29:33.949064 18706 external_mini_cluster.cc:1428] Setting key 9187a3ef396fa573da1ca8200c0ca836
I20260810 15:29:33.953666 21092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:33.948838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.131:46441 (local address 127.18.68.190:46705)
0810 15:29:33.948892 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0810 15:29:33.948894 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:29:33.949198 (+ 304us) server_negotiation.cc:407] Connection header received
0810 15:29:33.949808 (+ 610us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:29:33.949810 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:29:33.949823 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:29:33.949879 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:29:33.950723 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:33.951268 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:33.952268 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:33.952470 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:33.952532 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:33.953392 (+ 860us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:29:33.953393 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:29:33.953394 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 15:29:33.953399 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:29:33.953414 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 15:29:33.953418 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:29:33.953465 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0810 15:29:33.953546 (+ 81us) server_negotiation.cc:299] Negotiation successful
0810 15:29:33.953602 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260810 15:29:33.953835 21849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:33.948797 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46705 (local address 127.18.68.131:46441)
0810 15:29:33.949043 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:33.949091 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0810 15:29:33.949707 (+ 616us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:29:33.949952 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:29:33.949956 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:29:33.949966 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:29:33.950633 (+ 667us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:29:33.950639 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:29:33.951366 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:29:33.951366 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:29:33.952182 (+ 816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:29:33.952184 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:29:33.952553 (+ 369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:29:33.952554 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:29:33.952701 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:33.953255 (+ 554us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 15:29:33.953255 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:29:33.953283 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 15:29:33.953307 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:29:33.953474 (+ 167us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:29:33.953478 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:29:33.953480 (+ 2us) client_negotiation.cc:769] Sending connection context
0810 15:29:33.953533 (+ 53us) client_negotiation.cc:240] Negotiation successful
0810 15:29:33.953633 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":112,"threads_started":1}
I20260810 15:29:33.954303 21847 heartbeater.cc:347] Connected to a master server at 127.18.68.190:46705
I20260810 15:29:33.954383 21847 heartbeater.cc:464] Registering TS with master...
I20260810 15:29:33.954568 21847 heartbeater.cc:511] Master 127.18.68.190:46705 requested a full tablet report, sending...
I20260810 15:29:33.954916 21017 ts_manager.cc:194] Registered new tserver with Master: ce5d5831f0854ed99fa9eadbe245cd14 (127.18.68.131:35323)
I20260810 15:29:33.955322 21017 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.18.68.131:46441
I20260810 15:29:33.960947 18706 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 15:29:33.965337 21092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:33.962446 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54508 (local address 127.18.68.190:46705)
0810 15:29:33.962524 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0810 15:29:33.962526 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:29:33.962674 (+ 148us) server_negotiation.cc:407] Connection header received
0810 15:29:33.962704 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:29:33.962705 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:29:33.962715 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:29:33.962761 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:29:33.962931 (+ 170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:33.963403 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:33.964150 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:33.964342 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:33.964427 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:33.965068 (+ 641us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:29:33.965070 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:29:33.965070 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 15:29:33.965075 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:29:33.965090 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 15:29:33.965094 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:29:33.965143 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0810 15:29:33.965228 (+ 85us) server_negotiation.cc:299] Negotiation successful
0810 15:29:33.965250 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260810 15:29:33.966883 21017 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54508:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 15:29:33.968520 21017 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 15:29:33.975057 21858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:33.970913 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.129:36833 (local address 127.0.0.1:34898)
0810 15:29:33.971039 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:33.971080 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0810 15:29:33.971141 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:29:33.971462 (+ 321us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:29:33.971465 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:29:33.971467 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:29:33.971537 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:29:33.971539 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:29:33.972648 (+ 1109us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:29:33.972649 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:29:33.973823 (+ 1174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:29:33.973826 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:29:33.974765 (+ 939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:29:33.974766 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:29:33.974840 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:33.974853 (+ 13us) client_negotiation.cc:769] Sending connection context
0810 15:29:33.974929 (+ 76us) client_negotiation.cc:240] Negotiation successful
0810 15:29:33.974980 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":102,"mutex_wait_us":1,"thread_start_us":80,"threads_started":1}
I20260810 15:29:33.975067 21859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:33.971014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34898 (local address 127.18.68.129:36833)
0810 15:29:33.971204 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0810 15:29:33.971209 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 15:29:33.971222 (+ 13us) server_negotiation.cc:407] Connection header received
0810 15:29:33.971267 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:29:33.971270 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:29:33.971288 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:29:33.971372 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:29:33.971627 (+ 255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:33.972563 (+ 936us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:33.973913 (+ 1350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:33.974679 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:33.974765 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:33.974863 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0810 15:29:33.974944 (+ 81us) server_negotiation.cc:299] Negotiation successful
0810 15:29:33.974984 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":151,"thread_start_us":113,"threads_started":1}
I20260810 15:29:33.975493 21867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:33.971313 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.130:37977 (local address 127.0.0.1:49910)
0810 15:29:33.971432 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:33.971441 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 15:29:33.971479 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:29:33.971986 (+ 507us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:29:33.971986 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:29:33.971988 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:29:33.972018 (+ 30us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:29:33.972019 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:29:33.973341 (+ 1322us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:29:33.973342 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:29:33.974353 (+ 1011us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:29:33.974355 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:29:33.975276 (+ 921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:29:33.975277 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:29:33.975332 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:33.975336 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 15:29:33.975381 (+ 45us) client_negotiation.cc:240] Negotiation successful
0810 15:29:33.975416 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":77,"threads_started":1}
I20260810 15:29:33.975524 21872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:33.971519 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49910 (local address 127.18.68.130:37977)
0810 15:29:33.971822 (+ 303us) server_negotiation.cc:206] Beginning negotiation
0810 15:29:33.971826 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 15:29:33.971835 (+ 9us) server_negotiation.cc:407] Connection header received
0810 15:29:33.971874 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:29:33.971876 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:29:33.971891 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:29:33.972089 (+ 198us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:29:33.972157 (+ 68us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:33.973260 (+ 1103us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:33.974440 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:33.975193 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:33.975277 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:33.975371 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0810 15:29:33.975397 (+ 26us) server_negotiation.cc:299] Negotiation successful
0810 15:29:33.975440 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":260,"thread_start_us":123,"threads_started":1}
I20260810 15:29:33.975669 21860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:33.971159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.131:35323 (local address 127.0.0.1:33064)
0810 15:29:33.971249 (+ 90us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:33.971260 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 15:29:33.971317 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:29:33.971955 (+ 638us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:29:33.971956 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:29:33.971959 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:29:33.972013 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:29:33.972015 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:29:33.973372 (+ 1357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:29:33.973373 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:29:33.974466 (+ 1093us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:29:33.974469 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:29:33.975347 (+ 878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:29:33.975348 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:29:33.975412 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:33.975416 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 15:29:33.975446 (+ 30us) client_negotiation.cc:240] Negotiation successful
0810 15:29:33.975486 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":77,"thread_start_us":52,"threads_started":1}
I20260810 15:29:33.975880 21870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:33.971338 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33064 (local address 127.18.68.131:35323)
0810 15:29:33.971766 (+ 428us) server_negotiation.cc:206] Beginning negotiation
0810 15:29:33.971772 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 15:29:33.971782 (+ 10us) server_negotiation.cc:407] Connection header received
0810 15:29:33.971826 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:29:33.971828 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:29:33.971847 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:29:33.972089 (+ 242us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:29:33.972161 (+ 72us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:33.973252 (+ 1091us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:33.974555 (+ 1303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:33.975251 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:33.975546 (+ 295us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:33.975737 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0810 15:29:33.975766 (+ 29us) server_negotiation.cc:299] Negotiation successful
0810 15:29:33.975809 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":383,"thread_start_us":77,"threads_started":1}
I20260810 15:29:33.976197 21243 tablet_service.cc:1467] Processing CreateTablet for tablet 0bdfebd8a709425b8e1ff308bd2fa68e (DEFAULT_TABLE table=test-table [id=d12f1f3497a84a09a449a73554e80edb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 15:29:33.976658 21243 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0bdfebd8a709425b8e1ff308bd2fa68e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:29:33.976800 21739 tablet_service.cc:1467] Processing CreateTablet for tablet 0bdfebd8a709425b8e1ff308bd2fa68e (DEFAULT_TABLE table=test-table [id=d12f1f3497a84a09a449a73554e80edb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 15:29:33.977156 21739 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0bdfebd8a709425b8e1ff308bd2fa68e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:29:33.979655 21874 tablet_bootstrap.cc:492] T 0bdfebd8a709425b8e1ff308bd2fa68e P 9c4e561a7e064a74b6d6e22965191b55: Bootstrap starting.
I20260810 15:29:33.980123 21487 tablet_service.cc:1467] Processing CreateTablet for tablet 0bdfebd8a709425b8e1ff308bd2fa68e (DEFAULT_TABLE table=test-table [id=d12f1f3497a84a09a449a73554e80edb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 15:29:33.980335 21874 tablet_bootstrap.cc:654] T 0bdfebd8a709425b8e1ff308bd2fa68e P 9c4e561a7e064a74b6d6e22965191b55: Neither blocks nor log segments found. Creating new log.
I20260810 15:29:33.980419 21487 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0bdfebd8a709425b8e1ff308bd2fa68e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:29:33.980643 21874 log.cc:824] T 0bdfebd8a709425b8e1ff308bd2fa68e P 9c4e561a7e064a74b6d6e22965191b55: Log is configured to *not* fsync() on all Append() calls
I20260810 15:29:33.981444 21874 tablet_bootstrap.cc:492] T 0bdfebd8a709425b8e1ff308bd2fa68e P 9c4e561a7e064a74b6d6e22965191b55: No bootstrap required, opened a new log
I20260810 15:29:33.981598 21874 ts_tablet_manager.cc:1397] T 0bdfebd8a709425b8e1ff308bd2fa68e P 9c4e561a7e064a74b6d6e22965191b55: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 15:29:33.982326 21875 tablet_bootstrap.cc:492] T 0bdfebd8a709425b8e1ff308bd2fa68e P ce5d5831f0854ed99fa9eadbe245cd14: Bootstrap starting.
I20260810 15:29:33.983119 21875 tablet_bootstrap.cc:654] T 0bdfebd8a709425b8e1ff308bd2fa68e P ce5d5831f0854ed99fa9eadbe245cd14: Neither blocks nor log segments found. Creating new log.
I20260810 15:29:33.983443 21875 log.cc:824] T 0bdfebd8a709425b8e1ff308bd2fa68e P ce5d5831f0854ed99fa9eadbe245cd14: Log is configured to *not* fsync() on all Append() calls
I20260810 15:29:33.983666 21879 tablet_bootstrap.cc:492] T 0bdfebd8a709425b8e1ff308bd2fa68e P 55ffc1d14c2044e680254b23b9fe3c30: Bootstrap starting.
I20260810 15:29:33.984232 21879 tablet_bootstrap.cc:654] T 0bdfebd8a709425b8e1ff308bd2fa68e P 55ffc1d14c2044e680254b23b9fe3c30: Neither blocks nor log segments found. Creating new log.
I20260810 15:29:33.984195 21874 raft_consensus.cc:348] T 0bdfebd8a709425b8e1ff308bd2fa68e P 9c4e561a7e064a74b6d6e22965191b55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4e561a7e064a74b6d6e22965191b55" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 36833 } } peers { permanent_uuid: "ce5d5831f0854ed99fa9eadbe245cd14" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 35323 } } peers { permanent_uuid: "55ffc1d14c2044e680254b23b9fe3c30" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 37977 } }
I20260810 15:29:33.984390 21874 raft_consensus.cc:374] T 0bdfebd8a709425b8e1ff308bd2fa68e P 9c4e561a7e064a74b6d6e22965191b55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:29:33.984438 21874 raft_consensus.cc:729] T 0bdfebd8a709425b8e1ff308bd2fa68e P 9c4e561a7e064a74b6d6e22965191b55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c4e561a7e064a74b6d6e22965191b55, State: Initialized, Role: FOLLOWER
I20260810 15:29:33.984563 21879 log.cc:824] T 0bdfebd8a709425b8e1ff308bd2fa68e P 55ffc1d14c2044e680254b23b9fe3c30: Log is configured to *not* fsync() on all Append() calls
I20260810 15:29:33.984577 21874 consensus_queue.cc:260] T 0bdfebd8a709425b8e1ff308bd2fa68e P 9c4e561a7e064a74b6d6e22965191b55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4e561a7e064a74b6d6e22965191b55" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 36833 } } peers { permanent_uuid: "ce5d5831f0854ed99fa9eadbe245cd14" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 35323 } } peers { permanent_uuid: "55ffc1d14c2044e680254b23b9fe3c30" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 37977 } }
I20260810 15:29:33.984863 21874 ts_tablet_manager.cc:1428] T 0bdfebd8a709425b8e1ff308bd2fa68e P 9c4e561a7e064a74b6d6e22965191b55: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260810 15:29:33.984915 21371 heartbeater.cc:503] Master 127.18.68.190:46705 was elected leader, sending a full tablet report...
I20260810 15:29:33.985355 21879 tablet_bootstrap.cc:492] T 0bdfebd8a709425b8e1ff308bd2fa68e P 55ffc1d14c2044e680254b23b9fe3c30: No bootstrap required, opened a new log
I20260810 15:29:33.985431 21879 ts_tablet_manager.cc:1397] T 0bdfebd8a709425b8e1ff308bd2fa68e P 55ffc1d14c2044e680254b23b9fe3c30: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 15:29:33.985532 21875 tablet_bootstrap.cc:492] T 0bdfebd8a709425b8e1ff308bd2fa68e P ce5d5831f0854ed99fa9eadbe245cd14: No bootstrap required, opened a new log
I20260810 15:29:33.985599 21875 ts_tablet_manager.cc:1397] T 0bdfebd8a709425b8e1ff308bd2fa68e P ce5d5831f0854ed99fa9eadbe245cd14: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260810 15:29:33.988013 21879 raft_consensus.cc:348] T 0bdfebd8a709425b8e1ff308bd2fa68e P 55ffc1d14c2044e680254b23b9fe3c30 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4e561a7e064a74b6d6e22965191b55" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 36833 } } peers { permanent_uuid: "ce5d5831f0854ed99fa9eadbe245cd14" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 35323 } } peers { permanent_uuid: "55ffc1d14c2044e680254b23b9fe3c30" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 37977 } }
I20260810 15:29:33.988204 21879 raft_consensus.cc:374] T 0bdfebd8a709425b8e1ff308bd2fa68e P 55ffc1d14c2044e680254b23b9fe3c30 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:29:33.988241 21879 raft_consensus.cc:729] T 0bdfebd8a709425b8e1ff308bd2fa68e P 55ffc1d14c2044e680254b23b9fe3c30 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55ffc1d14c2044e680254b23b9fe3c30, State: Initialized, Role: FOLLOWER
I20260810 15:29:33.988306 21875 raft_consensus.cc:348] T 0bdfebd8a709425b8e1ff308bd2fa68e P ce5d5831f0854ed99fa9eadbe245cd14 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4e561a7e064a74b6d6e22965191b55" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 36833 } } peers { permanent_uuid: "ce5d5831f0854ed99fa9eadbe245cd14" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 35323 } } peers { permanent_uuid: "55ffc1d14c2044e680254b23b9fe3c30" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 37977 } }
I20260810 15:29:33.988389 21879 consensus_queue.cc:260] T 0bdfebd8a709425b8e1ff308bd2fa68e P 55ffc1d14c2044e680254b23b9fe3c30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4e561a7e064a74b6d6e22965191b55" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 36833 } } peers { permanent_uuid: "ce5d5831f0854ed99fa9eadbe245cd14" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 35323 } } peers { permanent_uuid: "55ffc1d14c2044e680254b23b9fe3c30" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 37977 } }
I20260810 15:29:33.988461 21875 raft_consensus.cc:374] T 0bdfebd8a709425b8e1ff308bd2fa68e P ce5d5831f0854ed99fa9eadbe245cd14 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:29:33.988502 21875 raft_consensus.cc:729] T 0bdfebd8a709425b8e1ff308bd2fa68e P ce5d5831f0854ed99fa9eadbe245cd14 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce5d5831f0854ed99fa9eadbe245cd14, State: Initialized, Role: FOLLOWER
I20260810 15:29:33.988654 21879 ts_tablet_manager.cc:1428] T 0bdfebd8a709425b8e1ff308bd2fa68e P 55ffc1d14c2044e680254b23b9fe3c30: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 15:29:33.988631 21875 consensus_queue.cc:260] T 0bdfebd8a709425b8e1ff308bd2fa68e P ce5d5831f0854ed99fa9eadbe245cd14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4e561a7e064a74b6d6e22965191b55" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 36833 } } peers { permanent_uuid: "ce5d5831f0854ed99fa9eadbe245cd14" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 35323 } } peers { permanent_uuid: "55ffc1d14c2044e680254b23b9fe3c30" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 37977 } }
I20260810 15:29:33.988695 21619 heartbeater.cc:503] Master 127.18.68.190:46705 was elected leader, sending a full tablet report...
I20260810 15:29:33.988881 21875 ts_tablet_manager.cc:1428] T 0bdfebd8a709425b8e1ff308bd2fa68e P ce5d5831f0854ed99fa9eadbe245cd14: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260810 15:29:33.988976 21847 heartbeater.cc:503] Master 127.18.68.190:46705 was elected leader, sending a full tablet report...
W20260810 15:29:34.058271 21621 tablet.cc:2369] T 0bdfebd8a709425b8e1ff308bd2fa68e P 55ffc1d14c2044e680254b23b9fe3c30: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 15:29:34.152266 21886 raft_consensus.cc:482] T 0bdfebd8a709425b8e1ff308bd2fa68e P 9c4e561a7e064a74b6d6e22965191b55 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 15:29:34.152449 21886 raft_consensus.cc:504] T 0bdfebd8a709425b8e1ff308bd2fa68e P 9c4e561a7e064a74b6d6e22965191b55 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4e561a7e064a74b6d6e22965191b55" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 36833 } } peers { permanent_uuid: "ce5d5831f0854ed99fa9eadbe245cd14" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 35323 } } peers { permanent_uuid: "55ffc1d14c2044e680254b23b9fe3c30" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 37977 } }
I20260810 15:29:34.152822 21886 leader_election.cc:288] T 0bdfebd8a709425b8e1ff308bd2fa68e P 9c4e561a7e064a74b6d6e22965191b55 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce5d5831f0854ed99fa9eadbe245cd14 (127.18.68.131:35323), 55ffc1d14c2044e680254b23b9fe3c30 (127.18.68.130:37977)
I20260810 15:29:34.155683 21870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:34.153102 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.129:52285 (local address 127.18.68.131:35323)
0810 15:29:34.153155 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0810 15:29:34.153158 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 15:29:34.153168 (+ 10us) server_negotiation.cc:407] Connection header received
0810 15:29:34.153201 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:29:34.153202 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:29:34.153221 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:29:34.153293 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:29:34.153463 (+ 170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:34.153939 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:34.154939 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:34.155315 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:34.155400 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:34.155408 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0810 15:29:34.155579 (+ 171us) server_negotiation.cc:299] Negotiation successful
0810 15:29:34.155621 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260810 15:29:34.155683 21382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:34.153001 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.131:35323 (local address 127.18.68.129:52285)
0810 15:29:34.153058 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:34.153070 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 15:29:34.153135 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:29:34.153299 (+ 164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:29:34.153300 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:29:34.153302 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:29:34.153375 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:29:34.153377 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:29:34.154024 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:29:34.154025 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:29:34.154836 (+ 811us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:29:34.154838 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:29:34.155408 (+ 570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:29:34.155409 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:29:34.155479 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:34.155483 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 15:29:34.155568 (+ 85us) client_negotiation.cc:240] Negotiation successful
0810 15:29:34.155610 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260810 15:29:34.155788 21892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:34.153130 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.130:37977 (local address 127.18.68.129:57807)
0810 15:29:34.153233 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:34.153243 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 15:29:34.153282 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:29:34.153432 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:29:34.153433 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:29:34.153434 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 15:29:34.153516 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:29:34.153518 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:29:34.154220 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:29:34.154221 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:29:34.154966 (+ 745us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:29:34.154967 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:29:34.155515 (+ 548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:29:34.155516 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:29:34.155592 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:34.155602 (+ 10us) client_negotiation.cc:769] Sending connection context
0810 15:29:34.155668 (+ 66us) client_negotiation.cc:240] Negotiation successful
0810 15:29:34.155706 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":91,"thread_start_us":65,"threads_started":1}
I20260810 15:29:34.155776 21872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:34.153212 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.18.68.129:57807 (local address 127.18.68.130:37977)
0810 15:29:34.153268 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0810 15:29:34.153270 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:29:34.153280 (+ 10us) server_negotiation.cc:407] Connection header received
0810 15:29:34.153347 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:29:34.153348 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:29:34.153367 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:29:34.153428 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 15:29:34.153595 (+ 167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:34.154139 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:34.155058 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:34.155419 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:34.155502 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:34.155510 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0810 15:29:34.155673 (+ 163us) server_negotiation.cc:299] Negotiation successful
0810 15:29:34.155710 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260810 15:29:34.156473 21769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0bdfebd8a709425b8e1ff308bd2fa68e" candidate_uuid: "9c4e561a7e064a74b6d6e22965191b55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce5d5831f0854ed99fa9eadbe245cd14" is_pre_election: true
I20260810 15:29:34.156461 21536 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0bdfebd8a709425b8e1ff308bd2fa68e" candidate_uuid: "9c4e561a7e064a74b6d6e22965191b55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55ffc1d14c2044e680254b23b9fe3c30" is_pre_election: true
I20260810 15:29:34.156625 21769 raft_consensus.cc:2454] T 0bdfebd8a709425b8e1ff308bd2fa68e P ce5d5831f0854ed99fa9eadbe245cd14 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9c4e561a7e064a74b6d6e22965191b55 in term 0.
I20260810 15:29:34.156626 21536 raft_consensus.cc:2454] T 0bdfebd8a709425b8e1ff308bd2fa68e P 55ffc1d14c2044e680254b23b9fe3c30 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9c4e561a7e064a74b6d6e22965191b55 in term 0.
I20260810 15:29:34.156872 21159 leader_election.cc:302] T 0bdfebd8a709425b8e1ff308bd2fa68e P 9c4e561a7e064a74b6d6e22965191b55 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55ffc1d14c2044e680254b23b9fe3c30, 9c4e561a7e064a74b6d6e22965191b55; no voters:
I20260810 15:29:34.156998 21886 raft_consensus.cc:2781] T 0bdfebd8a709425b8e1ff308bd2fa68e P 9c4e561a7e064a74b6d6e22965191b55 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 15:29:34.157064 21886 raft_consensus.cc:482] T 0bdfebd8a709425b8e1ff308bd2fa68e P 9c4e561a7e064a74b6d6e22965191b55 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 15:29:34.157090 21886 raft_consensus.cc:3037] T 0bdfebd8a709425b8e1ff308bd2fa68e P 9c4e561a7e064a74b6d6e22965191b55 [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:29:34.157790 21886 raft_consensus.cc:504] T 0bdfebd8a709425b8e1ff308bd2fa68e P 9c4e561a7e064a74b6d6e22965191b55 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4e561a7e064a74b6d6e22965191b55" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 36833 } } peers { permanent_uuid: "ce5d5831f0854ed99fa9eadbe245cd14" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 35323 } } peers { permanent_uuid: "55ffc1d14c2044e680254b23b9fe3c30" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 37977 } }
I20260810 15:29:34.157927 21886 leader_election.cc:288] T 0bdfebd8a709425b8e1ff308bd2fa68e P 9c4e561a7e064a74b6d6e22965191b55 [CANDIDATE]: Term 1 election: Requested vote from peers ce5d5831f0854ed99fa9eadbe245cd14 (127.18.68.131:35323), 55ffc1d14c2044e680254b23b9fe3c30 (127.18.68.130:37977)
I20260810 15:29:34.158124 21536 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0bdfebd8a709425b8e1ff308bd2fa68e" candidate_uuid: "9c4e561a7e064a74b6d6e22965191b55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55ffc1d14c2044e680254b23b9fe3c30"
I20260810 15:29:34.158136 21769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0bdfebd8a709425b8e1ff308bd2fa68e" candidate_uuid: "9c4e561a7e064a74b6d6e22965191b55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce5d5831f0854ed99fa9eadbe245cd14"
I20260810 15:29:34.158211 21536 raft_consensus.cc:3037] T 0bdfebd8a709425b8e1ff308bd2fa68e P 55ffc1d14c2044e680254b23b9fe3c30 [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:29:34.158211 21769 raft_consensus.cc:3037] T 0bdfebd8a709425b8e1ff308bd2fa68e P ce5d5831f0854ed99fa9eadbe245cd14 [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:29:34.159137 21769 raft_consensus.cc:2454] T 0bdfebd8a709425b8e1ff308bd2fa68e P ce5d5831f0854ed99fa9eadbe245cd14 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c4e561a7e064a74b6d6e22965191b55 in term 1.
I20260810 15:29:34.159137 21536 raft_consensus.cc:2454] T 0bdfebd8a709425b8e1ff308bd2fa68e P 55ffc1d14c2044e680254b23b9fe3c30 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c4e561a7e064a74b6d6e22965191b55 in term 1.
I20260810 15:29:34.159320 21159 leader_election.cc:302] T 0bdfebd8a709425b8e1ff308bd2fa68e P 9c4e561a7e064a74b6d6e22965191b55 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55ffc1d14c2044e680254b23b9fe3c30, 9c4e561a7e064a74b6d6e22965191b55; no voters:
I20260810 15:29:34.159412 21886 raft_consensus.cc:2781] T 0bdfebd8a709425b8e1ff308bd2fa68e P 9c4e561a7e064a74b6d6e22965191b55 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 15:29:34.159559 21886 raft_consensus.cc:686] T 0bdfebd8a709425b8e1ff308bd2fa68e P 9c4e561a7e064a74b6d6e22965191b55 [term 1 LEADER]: Becoming Leader. State: Replica: 9c4e561a7e064a74b6d6e22965191b55, State: Running, Role: LEADER
I20260810 15:29:34.159631 21886 consensus_queue.cc:237] T 0bdfebd8a709425b8e1ff308bd2fa68e P 9c4e561a7e064a74b6d6e22965191b55 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4e561a7e064a74b6d6e22965191b55" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 36833 } } peers { permanent_uuid: "ce5d5831f0854ed99fa9eadbe245cd14" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 35323 } } peers { permanent_uuid: "55ffc1d14c2044e680254b23b9fe3c30" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 37977 } }
I20260810 15:29:34.160473 21017 catalog_manager.cc:5495] T 0bdfebd8a709425b8e1ff308bd2fa68e P 9c4e561a7e064a74b6d6e22965191b55 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9c4e561a7e064a74b6d6e22965191b55 (127.18.68.129). New cstate: current_term: 1 leader_uuid: "9c4e561a7e064a74b6d6e22965191b55" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4e561a7e064a74b6d6e22965191b55" member_type: VOTER last_known_addr { host: "127.18.68.129" port: 36833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce5d5831f0854ed99fa9eadbe245cd14" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 35323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55ffc1d14c2044e680254b23b9fe3c30" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 37977 } health_report { overall_health: UNKNOWN } } }
W20260810 15:29:34.163482 21373 tablet.cc:2369] T 0bdfebd8a709425b8e1ff308bd2fa68e P 9c4e561a7e064a74b6d6e22965191b55: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 15:29:34.198570 21848 tablet.cc:2369] T 0bdfebd8a709425b8e1ff308bd2fa68e P ce5d5831f0854ed99fa9eadbe245cd14: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 15:29:34.201967 21859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:34.199486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34910 (local address 127.18.68.129:36833)
0810 15:29:34.199559 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0810 15:29:34.199561 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:29:34.199571 (+ 10us) server_negotiation.cc:407] Connection header received
0810 15:29:34.199620 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:29:34.199620 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:29:34.199641 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:29:34.199716 (+ 75us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 15:29:34.199863 (+ 147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:34.200335 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:34.201136 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:34.201346 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:34.201427 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:34.201608 (+ 181us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 15:29:34.201711 (+ 103us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 15:29:34.201808 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0810 15:29:34.201828 (+ 20us) server_negotiation.cc:299] Negotiation successful
0810 15:29:34.201848 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260810 15:29:34.204115 21769 raft_consensus.cc:1261] T 0bdfebd8a709425b8e1ff308bd2fa68e P ce5d5831f0854ed99fa9eadbe245cd14 [term 1 FOLLOWER]: Refusing update from remote peer 9c4e561a7e064a74b6d6e22965191b55: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 15:29:34.204152 21536 raft_consensus.cc:1261] T 0bdfebd8a709425b8e1ff308bd2fa68e P 55ffc1d14c2044e680254b23b9fe3c30 [term 1 FOLLOWER]: Refusing update from remote peer 9c4e561a7e064a74b6d6e22965191b55: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 15:29:34.204557 21893 consensus_queue.cc:1035] T 0bdfebd8a709425b8e1ff308bd2fa68e P 9c4e561a7e064a74b6d6e22965191b55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55ffc1d14c2044e680254b23b9fe3c30" member_type: VOTER last_known_addr { host: "127.18.68.130" port: 37977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 15:29:34.204710 21886 consensus_queue.cc:1035] T 0bdfebd8a709425b8e1ff308bd2fa68e P 9c4e561a7e064a74b6d6e22965191b55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce5d5831f0854ed99fa9eadbe245cd14" member_type: VOTER last_known_addr { host: "127.18.68.131" port: 35323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 15:29:34.207912 21898 mvcc.cc:205] Tried to move back new op lower bound from 7316995171136970752 to 7316995170958462976. Current Snapshot: MvccSnapshot[applied={T|T < 7316995171136970752 or (T in {7316995171136970752})}]
I20260810 15:29:34.208248 21902 mvcc.cc:205] Tried to move back new op lower bound from 7316995171136970752 to 7316995170958462976. Current Snapshot: MvccSnapshot[applied={T|T < 7316995171136970752}]
I20260810 15:29:34.209491 21015 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:54508:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 15:29:34.209582 21015 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:54508:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 15:29:34.210451 21015 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4e1e93d5773c4e7295521d934e714cba: Sending DeleteTablet for 3 replicas of tablet 0bdfebd8a709425b8e1ff308bd2fa68e
I20260810 15:29:34.210841 21243 tablet_service.cc:1514] Processing DeleteTablet for tablet 0bdfebd8a709425b8e1ff308bd2fa68e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 15:29:34 UTC) from {username='slave'} at 127.0.0.1:34898
I20260810 15:29:34.210883 21739 tablet_service.cc:1514] Processing DeleteTablet for tablet 0bdfebd8a709425b8e1ff308bd2fa68e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 15:29:34 UTC) from {username='slave'} at 127.0.0.1:33064
I20260810 15:29:34.211054 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 21128
I20260810 15:29:34.211068 21487 tablet_service.cc:1514] Processing DeleteTablet for tablet 0bdfebd8a709425b8e1ff308bd2fa68e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 15:29:34 UTC) from {username='slave'} at 127.0.0.1:49910
I20260810 15:29:34.217811 21918 tablet_replica.cc:330] T 0bdfebd8a709425b8e1ff308bd2fa68e P 55ffc1d14c2044e680254b23b9fe3c30: stopping tablet replica
I20260810 15:29:34.217974 21918 raft_consensus.cc:2229] T 0bdfebd8a709425b8e1ff308bd2fa68e P 55ffc1d14c2044e680254b23b9fe3c30 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 15:29:34.218138 21918 raft_consensus.cc:2258] T 0bdfebd8a709425b8e1ff308bd2fa68e P 55ffc1d14c2044e680254b23b9fe3c30 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 15:29:34.219022 21918 ts_tablet_manager.cc:1905] T 0bdfebd8a709425b8e1ff308bd2fa68e P 55ffc1d14c2044e680254b23b9fe3c30: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 15:29:34.221235 21918 ts_tablet_manager.cc:1918] T 0bdfebd8a709425b8e1ff308bd2fa68e P 55ffc1d14c2044e680254b23b9fe3c30: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 15:29:34.221341 21918 log.cc:1196] T 0bdfebd8a709425b8e1ff308bd2fa68e P 55ffc1d14c2044e680254b23b9fe3c30: Deleting WAL directory at /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786375520124696-18706-0/minicluster-data/ts-1/wal/wals/0bdfebd8a709425b8e1ff308bd2fa68e
I20260810 15:29:34.221698 21918 ts_tablet_manager.cc:1939] T 0bdfebd8a709425b8e1ff308bd2fa68e P 55ffc1d14c2044e680254b23b9fe3c30: Deleting consensus metadata
I20260810 15:29:34.222358 20984 catalog_manager.cc:4841] TS 55ffc1d14c2044e680254b23b9fe3c30 (127.18.68.130:37977): tablet 0bdfebd8a709425b8e1ff308bd2fa68e (table test-table [id=d12f1f3497a84a09a449a73554e80edb]) successfully deleted
I20260810 15:29:34.226207 21917 tablet_replica.cc:330] T 0bdfebd8a709425b8e1ff308bd2fa68e P ce5d5831f0854ed99fa9eadbe245cd14: stopping tablet replica
I20260810 15:29:34.226349 21917 raft_consensus.cc:2229] T 0bdfebd8a709425b8e1ff308bd2fa68e P ce5d5831f0854ed99fa9eadbe245cd14 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 15:29:34.226495 21917 raft_consensus.cc:2258] T 0bdfebd8a709425b8e1ff308bd2fa68e P ce5d5831f0854ed99fa9eadbe245cd14 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 15:29:34.226933 21917 ts_tablet_manager.cc:1905] T 0bdfebd8a709425b8e1ff308bd2fa68e P ce5d5831f0854ed99fa9eadbe245cd14: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 15:29:34.227747 20984 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.18.68.129:36833 (error 108)
I20260810 15:29:34.227989 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 21383
I20260810 15:29:34.230643 21860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:34.228133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.129:36833 (local address 127.0.0.1:34912)
0810 15:29:34.230547 (+ 2414us) negotiation.cc:107] Waiting for socket to connect
0810 15:29:34.230604 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.129:36833: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2386}
I20260810 15:29:34.232437 21917 ts_tablet_manager.cc:1918] T 0bdfebd8a709425b8e1ff308bd2fa68e P ce5d5831f0854ed99fa9eadbe245cd14: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 15:29:34.232530 21917 log.cc:1196] T 0bdfebd8a709425b8e1ff308bd2fa68e P ce5d5831f0854ed99fa9eadbe245cd14: Deleting WAL directory at /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786375520124696-18706-0/minicluster-data/ts-2/wal/wals/0bdfebd8a709425b8e1ff308bd2fa68e
I20260810 15:29:34.232854 21917 ts_tablet_manager.cc:1939] T 0bdfebd8a709425b8e1ff308bd2fa68e P ce5d5831f0854ed99fa9eadbe245cd14: Deleting consensus metadata
W20260810 15:29:34.234027 20984 catalog_manager.cc:4584] TS 9c4e561a7e064a74b6d6e22965191b55 (127.18.68.129:36833): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 0bdfebd8a709425b8e1ff308bd2fa68e: Network error: Client connection negotiation failed: client connection to 127.18.68.129:36833: connect: Connection refused (error 111)
I20260810 15:29:34.234937 20984 catalog_manager.cc:4841] TS ce5d5831f0854ed99fa9eadbe245cd14 (127.18.68.131:35323): tablet 0bdfebd8a709425b8e1ff308bd2fa68e (table test-table [id=d12f1f3497a84a09a449a73554e80edb]) successfully deleted
I20260810 15:29:34.248522 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 21624
I20260810 15:29:34.255788 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 20949
2026-08-10T15:29:34Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (922 ms)
[----------] 6 tests from EncryptionPolicyTest (9766 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786375520124696-18706-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 15:29:34 dist-test-slave-2p8l krb5kdc[21925](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 15:29:34 dist-test-slave-2p8l krb5kdc[21925](info): set up 2 sockets
Aug 10 15:29:34 dist-test-slave-2p8l krb5kdc[21925](info): commencing operation
krb5kdc: starting...
W20260810 15:29:35.559546 18706 mini_kdc.cc:121] Time spent starting KDC: real 1.274s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786375520124696-18706-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786375520124696-18706-0/krb5kdc/test-user.keytab.
Aug 10 15:29:35 dist-test-slave-2p8l krb5kdc[21925](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375775, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T15:29:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T15:29:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786375520124696-18706-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786375520124696-18706-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 15:29:35.689201 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786375520124696-18706-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786375520124696-18706-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786375520124696-18706-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34925
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786375520124696-18706-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39305
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34925
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:29:35.774811 21946 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:29:35.775065 21946 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:29:35.775104 21946 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:29:35.776273 21946 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 15:29:35.776350 21946 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:29:35.776374 21946 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:29:35.776396 21946 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 15:29:35.776424 21946 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 15:29:35.777952 21946 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39305
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786375520124696-18706-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786375520124696-18706-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34925
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786375520124696-18706-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34925
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21946
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786375520124696-18706-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:29:35.778276 21946 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:29:35.778527 21946 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:29:35.783653 21956 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:29:35.783684 21953 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:29:35.783844 21946 server_base.cc:1034] running on GCE node
W20260810 15:29:35.783718 21954 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:29:35.784181 21946 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:29:35.784550 21946 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:29:35.785708 21946 hybrid_clock.cc:648] HybridClock initialized: now 1786375775785698 us; error 32 us; skew 500 ppm
Aug 10 15:29:35 dist-test-slave-2p8l krb5kdc[21925](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375775, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:29:35.791953 21946 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 15:29:35.792434 21946 webserver.cc:460] Webserver started at http://127.0.0.1:45653/ using document root <none> and password file <none>
I20260810 15:29:35.792682 21946 fs_manager.cc:359] Metadata directory not provided
I20260810 15:29:35.792727 21946 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:29:35.792821 21946 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:29:35.793828 21946 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786375520124696-18706-0/minicluster-data/master-0/data/instance:
uuid: "2ccd6fc51f6f4fd4a0cd4940dd0c29d2"
format_stamp: "Formatted at 2026-08-10 15:29:35 on dist-test-slave-2p8l"
server_key: "206b3899a5a9b94b7f665e50343ccea2"
server_key_iv: "c36fd1eb7ef151b1abf8c66bbd68f395"
server_key_version: "encryptionkey@0"
I20260810 15:29:35.794215 21946 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786375520124696-18706-0/minicluster-data/master-0/wal/instance:
uuid: "2ccd6fc51f6f4fd4a0cd4940dd0c29d2"
format_stamp: "Formatted at 2026-08-10 15:29:35 on dist-test-slave-2p8l"
server_key: "206b3899a5a9b94b7f665e50343ccea2"
server_key_iv: "c36fd1eb7ef151b1abf8c66bbd68f395"
server_key_version: "encryptionkey@0"
I20260810 15:29:35.795594 21946 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260810 15:29:35.796327 21966 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:29:35.796519 21946 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 15:29:35.796664 21946 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786375520124696-18706-0/minicluster-data/master-0/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786375520124696-18706-0/minicluster-data/master-0/wal
uuid: "2ccd6fc51f6f4fd4a0cd4940dd0c29d2"
format_stamp: "Formatted at 2026-08-10 15:29:35 on dist-test-slave-2p8l"
server_key: "206b3899a5a9b94b7f665e50343ccea2"
server_key_iv: "c36fd1eb7ef151b1abf8c66bbd68f395"
server_key_version: "encryptionkey@0"
I20260810 15:29:35.796741 21946 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786375520124696-18706-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786375520124696-18706-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786375520124696-18706-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:29:35.812619 21946 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:29:35.814908 21946 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:29:35.815094 21946 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:29:35.819931 21946 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34925
I20260810 15:29:35.819974 22064 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34925 every 8 connection(s)
I20260810 15:29:35.820432 21946 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
I20260810 15:29:35.821399 22066 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:29:35.823781 22066 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2ccd6fc51f6f4fd4a0cd4940dd0c29d2: Bootstrap starting.
I20260810 15:29:35.824402 22066 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2ccd6fc51f6f4fd4a0cd4940dd0c29d2: Neither blocks nor log segments found. Creating new log.
I20260810 15:29:35.824703 22066 log.cc:824] T 00000000000000000000000000000000 P 2ccd6fc51f6f4fd4a0cd4940dd0c29d2: Log is configured to *not* fsync() on all Append() calls
I20260810 15:29:35.825014 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 21946
I20260810 15:29:35.825138 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786375520124696-18706-0/minicluster-data/master-0/wal/instance
I20260810 15:29:35.825356 18706 external_mini_cluster.cc:1428] Setting key 0a4112b38f839361554c747a1e16e488
I20260810 15:29:35.825625 22066 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2ccd6fc51f6f4fd4a0cd4940dd0c29d2: No bootstrap required, opened a new log
I20260810 15:29:35.828015 22066 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2ccd6fc51f6f4fd4a0cd4940dd0c29d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ccd6fc51f6f4fd4a0cd4940dd0c29d2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34925 } }
I20260810 15:29:35.828154 22066 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2ccd6fc51f6f4fd4a0cd4940dd0c29d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:29:35.828177 22066 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2ccd6fc51f6f4fd4a0cd4940dd0c29d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ccd6fc51f6f4fd4a0cd4940dd0c29d2, State: Initialized, Role: FOLLOWER
I20260810 15:29:35.828305 22066 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2ccd6fc51f6f4fd4a0cd4940dd0c29d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ccd6fc51f6f4fd4a0cd4940dd0c29d2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34925 } }
I20260810 15:29:35.828383 22066 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2ccd6fc51f6f4fd4a0cd4940dd0c29d2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 15:29:35.828406 22066 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2ccd6fc51f6f4fd4a0cd4940dd0c29d2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 15:29:35.828466 22066 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2ccd6fc51f6f4fd4a0cd4940dd0c29d2 [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:29:35.829038 22066 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2ccd6fc51f6f4fd4a0cd4940dd0c29d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ccd6fc51f6f4fd4a0cd4940dd0c29d2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34925 } }
I20260810 15:29:35.829129 22066 leader_election.cc:302] T 00000000000000000000000000000000 P 2ccd6fc51f6f4fd4a0cd4940dd0c29d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2ccd6fc51f6f4fd4a0cd4940dd0c29d2; no voters:
I20260810 15:29:35.829320 22066 leader_election.cc:288] T 00000000000000000000000000000000 P 2ccd6fc51f6f4fd4a0cd4940dd0c29d2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 15:29:35.829365 22074 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2ccd6fc51f6f4fd4a0cd4940dd0c29d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 15:29:35.829526 22074 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2ccd6fc51f6f4fd4a0cd4940dd0c29d2 [term 1 LEADER]: Becoming Leader. State: Replica: 2ccd6fc51f6f4fd4a0cd4940dd0c29d2, State: Running, Role: LEADER
I20260810 15:29:35.829618 22066 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2ccd6fc51f6f4fd4a0cd4940dd0c29d2 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 15:29:35.829622 22074 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2ccd6fc51f6f4fd4a0cd4940dd0c29d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ccd6fc51f6f4fd4a0cd4940dd0c29d2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34925 } }
I20260810 15:29:35.830003 22074 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2ccd6fc51f6f4fd4a0cd4940dd0c29d2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2ccd6fc51f6f4fd4a0cd4940dd0c29d2. Latest consensus state: current_term: 1 leader_uuid: "2ccd6fc51f6f4fd4a0cd4940dd0c29d2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ccd6fc51f6f4fd4a0cd4940dd0c29d2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34925 } } }
I20260810 15:29:35.830078 22074 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2ccd6fc51f6f4fd4a0cd4940dd0c29d2 [sys.catalog]: This master's current role is: LEADER
I20260810 15:29:35.830021 22075 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2ccd6fc51f6f4fd4a0cd4940dd0c29d2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2ccd6fc51f6f4fd4a0cd4940dd0c29d2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ccd6fc51f6f4fd4a0cd4940dd0c29d2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34925 } } }
I20260810 15:29:35.830298 22075 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2ccd6fc51f6f4fd4a0cd4940dd0c29d2 [sys.catalog]: This master's current role is: LEADER
I20260810 15:29:35.830323 22084 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 15:29:35.830926 22084 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 15:29:35.833158 22084 catalog_manager.cc:1347] Generated new cluster ID: b18784b20a364764b1ea98ee007f1e5c
I20260810 15:29:35.833205 22084 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 10 15:29:35 dist-test-slave-2p8l krb5kdc[21925](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375775, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260810 15:29:35.837510 22072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:35.825974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47291 (local address 127.0.0.1:34925)
0810 15:29:35.826202 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0810 15:29:35.826209 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 15:29:35.826240 (+ 31us) server_negotiation.cc:407] Connection header received
0810 15:29:35.826946 (+ 706us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:29:35.826954 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:29:35.827003 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:29:35.827119 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:29:35.827929 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:35.829375 (+ 1446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:35.830522 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:35.831264 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:35.831374 (+ 110us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:35.834215 (+ 2841us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:29:35.834219 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:29:35.834219 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:29:35.834230 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:29:35.835973 (+ 1743us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:29:35.836389 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:29:35.836392 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:29:35.836392 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:29:35.836472 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:29:35.836718 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:29:35.836719 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:29:35.836720 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:29:35.836944 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:29:35.837128 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0810 15:29:35.837227 (+ 99us) server_negotiation.cc:299] Negotiation successful
0810 15:29:35.837327 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":153,"thread_start_us":114,"threads_started":1}
I20260810 15:29:35.838688 18706 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 15:29:35.843559 22084 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 15:29:35.844246 22084 catalog_manager.cc:1504] Loading token signing keys...
I20260810 15:29:35.849957 22072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:35.842398 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34181 (local address 127.0.0.1:34925)
0810 15:29:35.842437 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0810 15:29:35.842440 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 15:29:35.842624 (+ 184us) server_negotiation.cc:407] Connection header received
0810 15:29:35.842686 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:29:35.842687 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:29:35.842699 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:29:35.842755 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:29:35.843383 (+ 628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:35.844183 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:35.845233 (+ 1050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:35.845549 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:35.845622 (+ 73us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:35.847120 (+ 1498us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:29:35.847122 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:29:35.847122 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:29:35.847129 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:29:35.848703 (+ 1574us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:29:35.849140 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:29:35.849141 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:29:35.849142 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:29:35.849200 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:29:35.849428 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:29:35.849429 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:29:35.849429 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:29:35.849545 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:29:35.849641 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0810 15:29:35.849799 (+ 158us) server_negotiation.cc:299] Negotiation successful
0810 15:29:35.849865 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260810 15:29:35.851089 22084 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2ccd6fc51f6f4fd4a0cd4940dd0c29d2: Generated new TSK 0
I20260810 15:29:35.851248 22084 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 15:29:35.857570 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 21946
W20260810 15:29:35.872331 21922 connection.cc:535] client connection to 127.0.0.1:34925 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:34925): Connection reset by peer (error 104)
2026-08-10T15:29:35Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1601 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786375520124696-18706-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 15:29:35 dist-test-slave-2p8l krb5kdc[22118](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 15:29:35 dist-test-slave-2p8l krb5kdc[22118](info): set up 2 sockets
Aug 10 15:29:35 dist-test-slave-2p8l krb5kdc[22118](info): commencing operation
krb5kdc: starting...
W20260810 15:29:37.160238 18706 mini_kdc.cc:121] Time spent starting KDC: real 1.273s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786375520124696-18706-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786375520124696-18706-0/krb5kdc/test-user.keytab.
Aug 10 15:29:37 dist-test-slave-2p8l krb5kdc[22118](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375777, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T15:29:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T15:29:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786375520124696-18706-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786375520124696-18706-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 15:29:37.289743 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786375520124696-18706-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786375520124696-18706-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786375520124696-18706-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44397
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786375520124696-18706-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37737
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44397
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:29:37.372059 22141 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:29:37.372310 22141 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:29:37.372349 22141 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:29:37.373478 22141 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 15:29:37.373553 22141 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:29:37.373575 22141 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:29:37.373595 22141 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 15:29:37.373632 22141 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 15:29:37.375195 22141 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37737
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786375520124696-18706-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786375520124696-18706-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44397
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786375520124696-18706-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44397
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22141
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786375520124696-18706-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:29:37.375499 22141 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:29:37.375737 22141 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:29:37.380869 22159 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:29:37.380867 22160 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:29:37.380863 22164 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:29:37.380893 22141 server_base.cc:1034] running on GCE node
I20260810 15:29:37.381312 22141 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:29:37.381596 22141 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:29:37.382773 22141 hybrid_clock.cc:648] HybridClock initialized: now 1786375777382750 us; error 33 us; skew 500 ppm
Aug 10 15:29:37 dist-test-slave-2p8l krb5kdc[22118](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375777, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:29:37.385378 22141 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 15:29:37.385807 22141 webserver.cc:460] Webserver started at http://127.0.0.1:34963/ using document root <none> and password file <none>
I20260810 15:29:37.386052 22141 fs_manager.cc:359] Metadata directory not provided
I20260810 15:29:37.386188 22141 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:29:37.386330 22141 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:29:37.387459 22141 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786375520124696-18706-0/minicluster-data/master-0/data/instance:
uuid: "5eb3d30812a14fe29ce127304d44037f"
format_stamp: "Formatted at 2026-08-10 15:29:37 on dist-test-slave-2p8l"
server_key: "285dc003e921c152153eb27ed3405785"
server_key_iv: "94413619f1bf5227cde2874ff03602a8"
server_key_version: "encryptionkey@0"
I20260810 15:29:37.387830 22141 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786375520124696-18706-0/minicluster-data/master-0/wal/instance:
uuid: "5eb3d30812a14fe29ce127304d44037f"
format_stamp: "Formatted at 2026-08-10 15:29:37 on dist-test-slave-2p8l"
server_key: "285dc003e921c152153eb27ed3405785"
server_key_iv: "94413619f1bf5227cde2874ff03602a8"
server_key_version: "encryptionkey@0"
I20260810 15:29:37.389212 22141 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 15:29:37.390043 22175 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:29:37.390275 22141 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 15:29:37.390388 22141 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786375520124696-18706-0/minicluster-data/master-0/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786375520124696-18706-0/minicluster-data/master-0/wal
uuid: "5eb3d30812a14fe29ce127304d44037f"
format_stamp: "Formatted at 2026-08-10 15:29:37 on dist-test-slave-2p8l"
server_key: "285dc003e921c152153eb27ed3405785"
server_key_iv: "94413619f1bf5227cde2874ff03602a8"
server_key_version: "encryptionkey@0"
I20260810 15:29:37.390478 22141 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786375520124696-18706-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786375520124696-18706-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786375520124696-18706-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:29:37.409920 22141 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:29:37.411911 22141 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:29:37.412091 22141 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:29:37.416481 22141 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44397
I20260810 15:29:37.416513 22274 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44397 every 8 connection(s)
I20260810 15:29:37.416883 22141 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
I20260810 15:29:37.417829 22276 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:29:37.420047 22276 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5eb3d30812a14fe29ce127304d44037f: Bootstrap starting.
I20260810 15:29:37.420643 22276 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5eb3d30812a14fe29ce127304d44037f: Neither blocks nor log segments found. Creating new log.
I20260810 15:29:37.420924 22276 log.cc:824] T 00000000000000000000000000000000 P 5eb3d30812a14fe29ce127304d44037f: Log is configured to *not* fsync() on all Append() calls
I20260810 15:29:37.421646 22276 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5eb3d30812a14fe29ce127304d44037f: No bootstrap required, opened a new log
I20260810 15:29:37.423306 22276 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5eb3d30812a14fe29ce127304d44037f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5eb3d30812a14fe29ce127304d44037f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44397 } }
I20260810 15:29:37.423442 22276 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5eb3d30812a14fe29ce127304d44037f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:29:37.423465 22276 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5eb3d30812a14fe29ce127304d44037f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eb3d30812a14fe29ce127304d44037f, State: Initialized, Role: FOLLOWER
I20260810 15:29:37.423633 22276 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5eb3d30812a14fe29ce127304d44037f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5eb3d30812a14fe29ce127304d44037f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44397 } }
I20260810 15:29:37.423696 22276 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5eb3d30812a14fe29ce127304d44037f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 15:29:37.423738 22276 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5eb3d30812a14fe29ce127304d44037f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 15:29:37.423787 22276 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5eb3d30812a14fe29ce127304d44037f [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:29:37.424296 22276 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5eb3d30812a14fe29ce127304d44037f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5eb3d30812a14fe29ce127304d44037f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44397 } }
I20260810 15:29:37.424409 22276 leader_election.cc:302] T 00000000000000000000000000000000 P 5eb3d30812a14fe29ce127304d44037f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5eb3d30812a14fe29ce127304d44037f; no voters:
I20260810 15:29:37.424618 22276 leader_election.cc:288] T 00000000000000000000000000000000 P 5eb3d30812a14fe29ce127304d44037f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 15:29:37.424646 22282 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5eb3d30812a14fe29ce127304d44037f [term 1 FOLLOWER]: Leader election won for term 1
I20260810 15:29:37.424876 22276 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5eb3d30812a14fe29ce127304d44037f [sys.catalog]: configured and running, proceeding with master startup.
I20260810 15:29:37.424907 22282 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5eb3d30812a14fe29ce127304d44037f [term 1 LEADER]: Becoming Leader. State: Replica: 5eb3d30812a14fe29ce127304d44037f, State: Running, Role: LEADER
I20260810 15:29:37.424997 22282 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5eb3d30812a14fe29ce127304d44037f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5eb3d30812a14fe29ce127304d44037f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44397 } }
I20260810 15:29:37.425494 22285 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5eb3d30812a14fe29ce127304d44037f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5eb3d30812a14fe29ce127304d44037f. Latest consensus state: current_term: 1 leader_uuid: "5eb3d30812a14fe29ce127304d44037f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5eb3d30812a14fe29ce127304d44037f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44397 } } }
I20260810 15:29:37.425570 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 22141
I20260810 15:29:37.425598 22285 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5eb3d30812a14fe29ce127304d44037f [sys.catalog]: This master's current role is: LEADER
I20260810 15:29:37.425700 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786375520124696-18706-0/minicluster-data/master-0/wal/instance
I20260810 15:29:37.425662 22283 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5eb3d30812a14fe29ce127304d44037f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5eb3d30812a14fe29ce127304d44037f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5eb3d30812a14fe29ce127304d44037f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44397 } } }
I20260810 15:29:37.425747 22283 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5eb3d30812a14fe29ce127304d44037f [sys.catalog]: This master's current role is: LEADER
I20260810 15:29:37.425803 22298 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 15:29:37.425936 18706 external_mini_cluster.cc:1428] Setting key 0277ea29c30beb783f149854f96a7daf
I20260810 15:29:37.426409 22298 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 15:29:37.428431 22298 catalog_manager.cc:1347] Generated new cluster ID: 17d9133dacd049bd86f213c6e560f158
I20260810 15:29:37.428485 22298 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 15:29:37.434955 22298 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 15:29:37.435634 22298 catalog_manager.cc:1504] Loading token signing keys...
I20260810 15:29:37.435838 22310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:37.426913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33655 (local address 127.0.0.1:44397)
0810 15:29:37.427152 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0810 15:29:37.427162 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 15:29:37.427201 (+ 39us) server_negotiation.cc:407] Connection header received
0810 15:29:37.427329 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:29:37.427336 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:29:37.427407 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:29:37.427540 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:29:37.430453 (+ 2913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:37.431855 (+ 1402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:37.433138 (+ 1283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:37.433743 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:37.433845 (+ 102us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:37.434845 (+ 1000us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:29:37.434849 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:29:37.434850 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 15:29:37.435089 (+ 239us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:29:37.435132 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 15:29:37.435149 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:29:37.435243 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0810 15:29:37.435528 (+ 285us) server_negotiation.cc:299] Negotiation successful
0810 15:29:37.435575 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":82,"threads_started":1}
I20260810 15:29:37.436883 18706 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 15:29:37.440937 22298 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5eb3d30812a14fe29ce127304d44037f: Generated new TSK 0
I20260810 15:29:37.441097 22298 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 15:29:37.442348 22310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:37.438623 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45195 (local address 127.0.0.1:44397)
0810 15:29:37.438659 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0810 15:29:37.438661 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:29:37.438708 (+ 47us) server_negotiation.cc:407] Connection header received
0810 15:29:37.438777 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:29:37.438778 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:29:37.438788 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:29:37.438847 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:29:37.438962 (+ 115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:37.439844 (+ 882us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:37.440866 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:37.441268 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:37.441348 (+ 80us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:37.442054 (+ 706us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:29:37.442086 (+ 32us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:29:37.442086 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 15:29:37.442092 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:29:37.442107 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 15:29:37.442112 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:29:37.442196 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0810 15:29:37.442256 (+ 60us) server_negotiation.cc:299] Negotiation successful
0810 15:29:37.442270 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260810 15:29:37.444099 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 22141
W20260810 15:29:37.459231 22116 connection.cc:535] client connection to 127.0.0.1:44397 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:44397): Connection reset by peer (error 104)
2026-08-10T15:29:37Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1586 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786375520124696-18706-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 15:29:37 dist-test-slave-2p8l krb5kdc[22326](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 15:29:37 dist-test-slave-2p8l krb5kdc[22326](info): set up 2 sockets
Aug 10 15:29:37 dist-test-slave-2p8l krb5kdc[22326](info): commencing operation
krb5kdc: starting...
W20260810 15:29:38.754328 18706 mini_kdc.cc:121] Time spent starting KDC: real 1.281s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786375520124696-18706-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786375520124696-18706-0/krb5kdc/test-user.keytab.
Aug 10 15:29:38 dist-test-slave-2p8l krb5kdc[22326](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375778, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T15:29:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T15:29:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786375520124696-18706-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786375520124696-18706-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 15:29:38.884620 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786375520124696-18706-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786375520124696-18706-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786375520124696-18706-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42203
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786375520124696-18706-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38483
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42203
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:29:38.968021 22344 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:29:38.968240 22344 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:29:38.968262 22344 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:29:38.969444 22344 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 15:29:38.969494 22344 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:29:38.969509 22344 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:29:38.969522 22344 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 15:29:38.969534 22344 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 15:29:38.971122 22344 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38483
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786375520124696-18706-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786375520124696-18706-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42203
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786375520124696-18706-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42203
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22344
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786375520124696-18706-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:29:38.971397 22344 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:29:38.971642 22344 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:29:38.976608 22359 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:29:38.976645 22355 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:29:38.976668 22352 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:29:38.976953 22344 server_base.cc:1034] running on GCE node
I20260810 15:29:38.977200 22344 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:29:38.977450 22344 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:29:38.978617 22344 hybrid_clock.cc:648] HybridClock initialized: now 1786375778978588 us; error 41 us; skew 500 ppm
Aug 10 15:29:38 dist-test-slave-2p8l krb5kdc[22326](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375778, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:29:38.981176 22344 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 15:29:38.981642 22344 webserver.cc:460] Webserver started at http://127.0.0.1:33441/ using document root <none> and password file <none>
I20260810 15:29:38.981870 22344 fs_manager.cc:359] Metadata directory not provided
I20260810 15:29:38.981941 22344 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:29:38.982152 22344 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:29:38.983235 22344 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786375520124696-18706-0/minicluster-data/master-0/data/instance:
uuid: "aed8591c08534924aef127e91dfa7a02"
format_stamp: "Formatted at 2026-08-10 15:29:38 on dist-test-slave-2p8l"
server_key: "e67f717132d388f17bac77b718bec7d0"
server_key_iv: "21570fdaa81c9dd62a8746c3a030259a"
server_key_version: "encryptionkey@0"
I20260810 15:29:38.983613 22344 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786375520124696-18706-0/minicluster-data/master-0/wal/instance:
uuid: "aed8591c08534924aef127e91dfa7a02"
format_stamp: "Formatted at 2026-08-10 15:29:38 on dist-test-slave-2p8l"
server_key: "e67f717132d388f17bac77b718bec7d0"
server_key_iv: "21570fdaa81c9dd62a8746c3a030259a"
server_key_version: "encryptionkey@0"
I20260810 15:29:38.985045 22344 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 15:29:38.985922 22371 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:29:38.986199 22344 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:29:38.986315 22344 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786375520124696-18706-0/minicluster-data/master-0/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786375520124696-18706-0/minicluster-data/master-0/wal
uuid: "aed8591c08534924aef127e91dfa7a02"
format_stamp: "Formatted at 2026-08-10 15:29:38 on dist-test-slave-2p8l"
server_key: "e67f717132d388f17bac77b718bec7d0"
server_key_iv: "21570fdaa81c9dd62a8746c3a030259a"
server_key_version: "encryptionkey@0"
I20260810 15:29:38.986407 22344 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786375520124696-18706-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786375520124696-18706-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786375520124696-18706-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:29:38.989769 22344 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:29:38.991899 22344 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:29:38.992060 22344 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:29:38.995944 22344 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42203
I20260810 15:29:38.995978 22475 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42203 every 8 connection(s)
I20260810 15:29:38.996316 22344 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
I20260810 15:29:38.997229 22476 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:29:38.999590 22476 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aed8591c08534924aef127e91dfa7a02: Bootstrap starting.
I20260810 15:29:39.000206 22476 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P aed8591c08534924aef127e91dfa7a02: Neither blocks nor log segments found. Creating new log.
I20260810 15:29:39.000491 22476 log.cc:824] T 00000000000000000000000000000000 P aed8591c08534924aef127e91dfa7a02: Log is configured to *not* fsync() on all Append() calls
I20260810 15:29:39.000815 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 22344
I20260810 15:29:39.000955 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786375520124696-18706-0/minicluster-data/master-0/wal/instance
I20260810 15:29:39.001202 18706 external_mini_cluster.cc:1428] Setting key cc555b5b18f9a2db51865d9d3294edfa
I20260810 15:29:39.001211 22476 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aed8591c08534924aef127e91dfa7a02: No bootstrap required, opened a new log
I20260810 15:29:39.003441 22476 raft_consensus.cc:348] T 00000000000000000000000000000000 P aed8591c08534924aef127e91dfa7a02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aed8591c08534924aef127e91dfa7a02" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42203 } }
I20260810 15:29:39.003577 22476 raft_consensus.cc:374] T 00000000000000000000000000000000 P aed8591c08534924aef127e91dfa7a02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:29:39.003599 22476 raft_consensus.cc:729] T 00000000000000000000000000000000 P aed8591c08534924aef127e91dfa7a02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aed8591c08534924aef127e91dfa7a02, State: Initialized, Role: FOLLOWER
I20260810 15:29:39.003748 22476 consensus_queue.cc:260] T 00000000000000000000000000000000 P aed8591c08534924aef127e91dfa7a02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aed8591c08534924aef127e91dfa7a02" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42203 } }
I20260810 15:29:39.004136 22476 raft_consensus.cc:388] T 00000000000000000000000000000000 P aed8591c08534924aef127e91dfa7a02 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 15:29:39.004194 22476 raft_consensus.cc:482] T 00000000000000000000000000000000 P aed8591c08534924aef127e91dfa7a02 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 15:29:39.004194 22481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:39.001767 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37197 (local address 127.0.0.1:42203)
0810 15:29:39.001997 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0810 15:29:39.002007 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 15:29:39.002044 (+ 37us) server_negotiation.cc:407] Connection header received
0810 15:29:39.002584 (+ 540us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:29:39.002593 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:29:39.002621 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:29:39.002789 (+ 168us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:29:39.003529 (+ 740us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:29:39.003532 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:29:39.003533 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 15:29:39.003537 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:29:39.003663 (+ 126us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 15:29:39.003684 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:29:39.003759 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0810 15:29:39.003885 (+ 126us) server_negotiation.cc:299] Negotiation successful
0810 15:29:39.003945 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":166,"thread_start_us":98,"threads_started":1}
I20260810 15:29:39.004283 22476 raft_consensus.cc:3037] T 00000000000000000000000000000000 P aed8591c08534924aef127e91dfa7a02 [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:29:39.004899 22476 raft_consensus.cc:504] T 00000000000000000000000000000000 P aed8591c08534924aef127e91dfa7a02 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aed8591c08534924aef127e91dfa7a02" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42203 } }
I20260810 15:29:39.005036 22476 leader_election.cc:302] T 00000000000000000000000000000000 P aed8591c08534924aef127e91dfa7a02 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: aed8591c08534924aef127e91dfa7a02; no voters:
I20260810 15:29:39.005247 22476 leader_election.cc:288] T 00000000000000000000000000000000 P aed8591c08534924aef127e91dfa7a02 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 15:29:39.005272 22484 raft_consensus.cc:2781] T 00000000000000000000000000000000 P aed8591c08534924aef127e91dfa7a02 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 15:29:39.005359 18706 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 15:29:39.005398 22484 raft_consensus.cc:686] T 00000000000000000000000000000000 P aed8591c08534924aef127e91dfa7a02 [term 1 LEADER]: Becoming Leader. State: Replica: aed8591c08534924aef127e91dfa7a02, State: Running, Role: LEADER
I20260810 15:29:39.005484 22484 consensus_queue.cc:237] T 00000000000000000000000000000000 P aed8591c08534924aef127e91dfa7a02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aed8591c08534924aef127e91dfa7a02" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42203 } }
I20260810 15:29:39.005519 22476 sys_catalog.cc:564] T 00000000000000000000000000000000 P aed8591c08534924aef127e91dfa7a02 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 15:29:39.005843 22484 sys_catalog.cc:455] T 00000000000000000000000000000000 P aed8591c08534924aef127e91dfa7a02 [sys.catalog]: SysCatalogTable state changed. Reason: New leader aed8591c08534924aef127e91dfa7a02. Latest consensus state: current_term: 1 leader_uuid: "aed8591c08534924aef127e91dfa7a02" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aed8591c08534924aef127e91dfa7a02" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42203 } } }
I20260810 15:29:39.005924 22484 sys_catalog.cc:458] T 00000000000000000000000000000000 P aed8591c08534924aef127e91dfa7a02 [sys.catalog]: This master's current role is: LEADER
I20260810 15:29:39.005870 22488 sys_catalog.cc:455] T 00000000000000000000000000000000 P aed8591c08534924aef127e91dfa7a02 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "aed8591c08534924aef127e91dfa7a02" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aed8591c08534924aef127e91dfa7a02" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42203 } } }
I20260810 15:29:39.006129 22488 sys_catalog.cc:458] T 00000000000000000000000000000000 P aed8591c08534924aef127e91dfa7a02 [sys.catalog]: This master's current role is: LEADER
W20260810 15:29:39.007619 22524 catalog_manager.cc:1558] T 00000000000000000000000000000000 P aed8591c08534924aef127e91dfa7a02: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 15:29:39.007695 22524 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 15:29:39.007766 22500 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 15:29:39.007967 22500 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 15:29:39.008443 22481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:39.007253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48503 (local address 127.0.0.1:42203)
0810 15:29:39.007289 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0810 15:29:39.007291 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:29:39.007341 (+ 50us) server_negotiation.cc:407] Connection header received
0810 15:29:39.007411 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:29:39.007412 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:29:39.007417 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:29:39.007484 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:29:39.008256 (+ 772us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:29:39.008257 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:29:39.008258 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 15:29:39.008262 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:29:39.008275 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 15:29:39.008279 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:29:39.008333 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0810 15:29:39.008386 (+ 53us) server_negotiation.cc:299] Negotiation successful
0810 15:29:39.008397 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260810 15:29:39.010001 22500 catalog_manager.cc:1347] Generated new cluster ID: 5dddb4c309b44484819a1b696c053559
I20260810 15:29:39.010087 22500 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 15:29:39.024674 22500 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 15:29:39.024868 22500 catalog_manager.cc:1504] Loading token signing keys...
I20260810 15:29:39.040828 22500 catalog_manager.cc:5868] T 00000000000000000000000000000000 P aed8591c08534924aef127e91dfa7a02: Generated new TSK 0
I20260810 15:29:39.041108 22500 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 15:29:39.049122 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 22344
2026-08-10T15:29:39Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1604 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786375520124696-18706-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 15:29:39 dist-test-slave-2p8l krb5kdc[22535](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 15:29:39 dist-test-slave-2p8l krb5kdc[22535](info): set up 2 sockets
Aug 10 15:29:39 dist-test-slave-2p8l krb5kdc[22535](info): commencing operation
krb5kdc: starting...
W20260810 15:29:40.407513 18706 mini_kdc.cc:121] Time spent starting KDC: real 1.330s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786375520124696-18706-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786375520124696-18706-0/krb5kdc/test-user.keytab.
Aug 10 15:29:40 dist-test-slave-2p8l krb5kdc[22535](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375780, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T15:29:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T15:29:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786375520124696-18706-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786375520124696-18706-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 15:29:40.529783 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786375520124696-18706-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786375520124696-18706-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786375520124696-18706-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33543
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786375520124696-18706-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37445
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33543
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:29:40.611061 22554 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:29:40.611284 22554 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:29:40.611308 22554 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:29:40.612540 22554 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 15:29:40.612584 22554 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:29:40.612599 22554 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:29:40.612615 22554 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 15:29:40.612663 22554 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 15:29:40.614200 22554 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37445
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786375520124696-18706-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786375520124696-18706-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33543
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786375520124696-18706-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33543
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22554
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786375520124696-18706-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:29:40.614447 22554 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:29:40.614672 22554 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:29:40.619470 22563 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:29:40.619472 22568 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:29:40.619481 22566 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:29:40.619925 22554 server_base.cc:1034] running on GCE node
I20260810 15:29:40.620193 22554 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:29:40.620479 22554 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:29:40.621668 22554 hybrid_clock.cc:648] HybridClock initialized: now 1786375780621654 us; error 30 us; skew 500 ppm
Aug 10 15:29:40 dist-test-slave-2p8l krb5kdc[22535](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375780, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:29:40.624388 22554 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 15:29:40.625010 22554 webserver.cc:460] Webserver started at http://127.0.0.1:41087/ using document root <none> and password file <none>
I20260810 15:29:40.625247 22554 fs_manager.cc:359] Metadata directory not provided
I20260810 15:29:40.625316 22554 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:29:40.625463 22554 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:29:40.626642 22554 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786375520124696-18706-0/minicluster-data/master-0/data/instance:
uuid: "187971c1102e4e4d83cf8a7bd2a6fa84"
format_stamp: "Formatted at 2026-08-10 15:29:40 on dist-test-slave-2p8l"
server_key: "aa7a4db060739201de2e1febe5190558"
server_key_iv: "5e01511bfda4744b683dafc5efb49604"
server_key_version: "encryptionkey@0"
I20260810 15:29:40.627022 22554 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786375520124696-18706-0/minicluster-data/master-0/wal/instance:
uuid: "187971c1102e4e4d83cf8a7bd2a6fa84"
format_stamp: "Formatted at 2026-08-10 15:29:40 on dist-test-slave-2p8l"
server_key: "aa7a4db060739201de2e1febe5190558"
server_key_iv: "5e01511bfda4744b683dafc5efb49604"
server_key_version: "encryptionkey@0"
I20260810 15:29:40.628374 22554 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 15:29:40.629158 22582 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:29:40.629346 22554 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:29:40.629455 22554 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786375520124696-18706-0/minicluster-data/master-0/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786375520124696-18706-0/minicluster-data/master-0/wal
uuid: "187971c1102e4e4d83cf8a7bd2a6fa84"
format_stamp: "Formatted at 2026-08-10 15:29:40 on dist-test-slave-2p8l"
server_key: "aa7a4db060739201de2e1febe5190558"
server_key_iv: "5e01511bfda4744b683dafc5efb49604"
server_key_version: "encryptionkey@0"
I20260810 15:29:40.629528 22554 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786375520124696-18706-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786375520124696-18706-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786375520124696-18706-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:29:40.641343 22554 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:29:40.643287 22554 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:29:40.643448 22554 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:29:40.647670 22554 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33543
I20260810 15:29:40.647722 22675 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33543 every 8 connection(s)
I20260810 15:29:40.648087 22554 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
I20260810 15:29:40.648967 22676 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:29:40.651400 22676 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 187971c1102e4e4d83cf8a7bd2a6fa84: Bootstrap starting.
I20260810 15:29:40.651986 22676 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 187971c1102e4e4d83cf8a7bd2a6fa84: Neither blocks nor log segments found. Creating new log.
I20260810 15:29:40.652221 22676 log.cc:824] T 00000000000000000000000000000000 P 187971c1102e4e4d83cf8a7bd2a6fa84: Log is configured to *not* fsync() on all Append() calls
I20260810 15:29:40.652942 22676 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 187971c1102e4e4d83cf8a7bd2a6fa84: No bootstrap required, opened a new log
I20260810 15:29:40.654387 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 22554
I20260810 15:29:40.654512 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786375520124696-18706-0/minicluster-data/master-0/wal/instance
I20260810 15:29:40.654726 18706 external_mini_cluster.cc:1428] Setting key 8050679a4a59b82bf40435c1cf332f72
I20260810 15:29:40.654961 22676 raft_consensus.cc:348] T 00000000000000000000000000000000 P 187971c1102e4e4d83cf8a7bd2a6fa84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "187971c1102e4e4d83cf8a7bd2a6fa84" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33543 } }
I20260810 15:29:40.655138 22676 raft_consensus.cc:374] T 00000000000000000000000000000000 P 187971c1102e4e4d83cf8a7bd2a6fa84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:29:40.655175 22676 raft_consensus.cc:729] T 00000000000000000000000000000000 P 187971c1102e4e4d83cf8a7bd2a6fa84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 187971c1102e4e4d83cf8a7bd2a6fa84, State: Initialized, Role: FOLLOWER
I20260810 15:29:40.655342 22676 consensus_queue.cc:260] T 00000000000000000000000000000000 P 187971c1102e4e4d83cf8a7bd2a6fa84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "187971c1102e4e4d83cf8a7bd2a6fa84" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33543 } }
I20260810 15:29:40.655517 22676 raft_consensus.cc:388] T 00000000000000000000000000000000 P 187971c1102e4e4d83cf8a7bd2a6fa84 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 15:29:40.655580 22676 raft_consensus.cc:482] T 00000000000000000000000000000000 P 187971c1102e4e4d83cf8a7bd2a6fa84 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 15:29:40.655647 22676 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 187971c1102e4e4d83cf8a7bd2a6fa84 [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:29:40.656554 22676 raft_consensus.cc:504] T 00000000000000000000000000000000 P 187971c1102e4e4d83cf8a7bd2a6fa84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "187971c1102e4e4d83cf8a7bd2a6fa84" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33543 } }
I20260810 15:29:40.656685 22676 leader_election.cc:302] T 00000000000000000000000000000000 P 187971c1102e4e4d83cf8a7bd2a6fa84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 187971c1102e4e4d83cf8a7bd2a6fa84; no voters:
I20260810 15:29:40.656888 22676 leader_election.cc:288] T 00000000000000000000000000000000 P 187971c1102e4e4d83cf8a7bd2a6fa84 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 15:29:40.656917 22685 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 187971c1102e4e4d83cf8a7bd2a6fa84 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 15:29:40.657030 22685 raft_consensus.cc:686] T 00000000000000000000000000000000 P 187971c1102e4e4d83cf8a7bd2a6fa84 [term 1 LEADER]: Becoming Leader. State: Replica: 187971c1102e4e4d83cf8a7bd2a6fa84, State: Running, Role: LEADER
I20260810 15:29:40.657177 22676 sys_catalog.cc:564] T 00000000000000000000000000000000 P 187971c1102e4e4d83cf8a7bd2a6fa84 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 15:29:40.657204 22685 consensus_queue.cc:237] T 00000000000000000000000000000000 P 187971c1102e4e4d83cf8a7bd2a6fa84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "187971c1102e4e4d83cf8a7bd2a6fa84" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33543 } }
I20260810 15:29:40.657672 22690 sys_catalog.cc:455] T 00000000000000000000000000000000 P 187971c1102e4e4d83cf8a7bd2a6fa84 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "187971c1102e4e4d83cf8a7bd2a6fa84" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "187971c1102e4e4d83cf8a7bd2a6fa84" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33543 } } }
I20260810 15:29:40.657893 22690 sys_catalog.cc:458] T 00000000000000000000000000000000 P 187971c1102e4e4d83cf8a7bd2a6fa84 [sys.catalog]: This master's current role is: LEADER
I20260810 15:29:40.657835 22689 sys_catalog.cc:455] T 00000000000000000000000000000000 P 187971c1102e4e4d83cf8a7bd2a6fa84 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 187971c1102e4e4d83cf8a7bd2a6fa84. Latest consensus state: current_term: 1 leader_uuid: "187971c1102e4e4d83cf8a7bd2a6fa84" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "187971c1102e4e4d83cf8a7bd2a6fa84" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33543 } } }
I20260810 15:29:40.658210 22689 sys_catalog.cc:458] T 00000000000000000000000000000000 P 187971c1102e4e4d83cf8a7bd2a6fa84 [sys.catalog]: This master's current role is: LEADER
I20260810 15:29:40.658416 22700 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 15:29:40.659006 22700 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 15:29:40.660912 22700 catalog_manager.cc:1347] Generated new cluster ID: 9122a7cb610d432bb78441778cdea2cc
I20260810 15:29:40.660966 22700 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 10 15:29:40 dist-test-slave-2p8l krb5kdc[22535](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375780, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260810 15:29:40.666725 22683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:40.655290 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43727 (local address 127.0.0.1:33543)
0810 15:29:40.655512 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0810 15:29:40.655524 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 15:29:40.655570 (+ 46us) server_negotiation.cc:407] Connection header received
0810 15:29:40.655765 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:29:40.655778 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:29:40.655828 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:29:40.655968 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:29:40.656705 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:40.658253 (+ 1548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:40.659465 (+ 1212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:40.660068 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:40.660208 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:40.662974 (+ 2766us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:29:40.662979 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:29:40.662979 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:29:40.662993 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:29:40.664911 (+ 1918us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:29:40.665335 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:29:40.665339 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:29:40.665339 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:29:40.665453 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:29:40.665687 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:29:40.665689 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:29:40.665689 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:29:40.665966 (+ 277us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:29:40.666181 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0810 15:29:40.666289 (+ 108us) server_negotiation.cc:299] Negotiation successful
0810 15:29:40.666559 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":102,"threads_started":1}
I20260810 15:29:40.667733 18706 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 15:29:40.674113 22700 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 15:29:40.674784 22700 catalog_manager.cc:1504] Loading token signing keys...
I20260810 15:29:40.676126 22683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:40.669254 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52009 (local address 127.0.0.1:33543)
0810 15:29:40.669295 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0810 15:29:40.669297 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:29:40.669435 (+ 138us) server_negotiation.cc:407] Connection header received
0810 15:29:40.669528 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:29:40.669529 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:29:40.669540 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:29:40.669596 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:29:40.670225 (+ 629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:40.670748 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:40.671521 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:40.671756 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:40.671847 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:40.673175 (+ 1328us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:29:40.673176 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:29:40.673176 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:29:40.673184 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:29:40.674843 (+ 1659us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:29:40.675269 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:29:40.675270 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:29:40.675271 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:29:40.675330 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:29:40.675546 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:29:40.675554 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:29:40.675554 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:29:40.675676 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:29:40.675802 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0810 15:29:40.675917 (+ 115us) server_negotiation.cc:299] Negotiation successful
0810 15:29:40.676015 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260810 15:29:40.681210 22700 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 187971c1102e4e4d83cf8a7bd2a6fa84: Generated new TSK 0
I20260810 15:29:40.681387 22700 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 15:29:40.683791 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 22554
2026-08-10T15:29:40Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1637 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786375520124696-18706-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 15:29:40 dist-test-slave-2p8l krb5kdc[22735](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 15:29:40 dist-test-slave-2p8l krb5kdc[22735](info): set up 2 sockets
Aug 10 15:29:40 dist-test-slave-2p8l krb5kdc[22735](info): commencing operation
krb5kdc: starting...
W20260810 15:29:41.984833 18706 mini_kdc.cc:121] Time spent starting KDC: real 1.269s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786375520124696-18706-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786375520124696-18706-0/krb5kdc/test-user.keytab.
Aug 10 15:29:42 dist-test-slave-2p8l krb5kdc[22735](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375782, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T15:29:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T15:29:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786375520124696-18706-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786375520124696-18706-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 15:29:42.116583 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786375520124696-18706-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786375520124696-18706-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786375520124696-18706-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43083
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786375520124696-18706-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41083
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43083
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:29:42.200752 22758 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:29:42.201011 22758 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:29:42.201067 22758 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:29:42.202323 22758 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 15:29:42.202386 22758 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:29:42.202410 22758 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:29:42.202432 22758 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 15:29:42.202458 22758 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 15:29:42.203974 22758 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41083
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786375520124696-18706-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786375520124696-18706-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43083
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786375520124696-18706-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43083
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22758
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786375520124696-18706-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:29:42.204247 22758 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:29:42.204480 22758 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:29:42.209513 22771 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:29:42.209540 22780 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:29:42.209540 22768 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:29:42.209774 22758 server_base.cc:1034] running on GCE node
I20260810 15:29:42.210028 22758 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:29:42.210374 22758 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:29:42.211539 22758 hybrid_clock.cc:648] HybridClock initialized: now 1786375782211529 us; error 37 us; skew 500 ppm
Aug 10 15:29:42 dist-test-slave-2p8l krb5kdc[22735](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375782, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:29:42.219530 22758 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 15:29:42.220045 22758 webserver.cc:460] Webserver started at http://127.0.0.1:36527/ using document root <none> and password file <none>
I20260810 15:29:42.220271 22758 fs_manager.cc:359] Metadata directory not provided
I20260810 15:29:42.220337 22758 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:29:42.220484 22758 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:29:42.221557 22758 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786375520124696-18706-0/minicluster-data/master-0/data/instance:
uuid: "d3dac2cdb1f040dc81e80c80a59ba47b"
format_stamp: "Formatted at 2026-08-10 15:29:42 on dist-test-slave-2p8l"
server_key: "4800d8ac966a24a15b83ab2a6299b42c"
server_key_iv: "6a92d122696b7cc47c46ad9b44591e8c"
server_key_version: "encryptionkey@0"
I20260810 15:29:42.221935 22758 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786375520124696-18706-0/minicluster-data/master-0/wal/instance:
uuid: "d3dac2cdb1f040dc81e80c80a59ba47b"
format_stamp: "Formatted at 2026-08-10 15:29:42 on dist-test-slave-2p8l"
server_key: "4800d8ac966a24a15b83ab2a6299b42c"
server_key_iv: "6a92d122696b7cc47c46ad9b44591e8c"
server_key_version: "encryptionkey@0"
I20260810 15:29:42.223378 22758 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:29:42.224217 22796 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:29:42.224459 22758 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:29:42.224570 22758 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786375520124696-18706-0/minicluster-data/master-0/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786375520124696-18706-0/minicluster-data/master-0/wal
uuid: "d3dac2cdb1f040dc81e80c80a59ba47b"
format_stamp: "Formatted at 2026-08-10 15:29:42 on dist-test-slave-2p8l"
server_key: "4800d8ac966a24a15b83ab2a6299b42c"
server_key_iv: "6a92d122696b7cc47c46ad9b44591e8c"
server_key_version: "encryptionkey@0"
I20260810 15:29:42.224678 22758 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786375520124696-18706-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786375520124696-18706-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786375520124696-18706-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:29:42.240700 22758 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:29:42.243130 22758 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:29:42.243309 22758 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:29:42.247828 22758 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43083
I20260810 15:29:42.247865 22890 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43083 every 8 connection(s)
I20260810 15:29:42.248252 22758 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
I20260810 15:29:42.249168 22891 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:29:42.251567 22891 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d3dac2cdb1f040dc81e80c80a59ba47b: Bootstrap starting.
I20260810 15:29:42.252187 22891 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d3dac2cdb1f040dc81e80c80a59ba47b: Neither blocks nor log segments found. Creating new log.
I20260810 15:29:42.252447 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 22758
I20260810 15:29:42.252554 22891 log.cc:824] T 00000000000000000000000000000000 P d3dac2cdb1f040dc81e80c80a59ba47b: Log is configured to *not* fsync() on all Append() calls
I20260810 15:29:42.252583 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786375520124696-18706-0/minicluster-data/master-0/wal/instance
I20260810 15:29:42.252817 18706 external_mini_cluster.cc:1428] Setting key 622af286bc400e8b71a9810048b39e06
I20260810 15:29:42.253485 22891 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d3dac2cdb1f040dc81e80c80a59ba47b: No bootstrap required, opened a new log
I20260810 15:29:42.256783 22891 raft_consensus.cc:348] T 00000000000000000000000000000000 P d3dac2cdb1f040dc81e80c80a59ba47b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3dac2cdb1f040dc81e80c80a59ba47b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43083 } }
I20260810 15:29:42.256928 22891 raft_consensus.cc:374] T 00000000000000000000000000000000 P d3dac2cdb1f040dc81e80c80a59ba47b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:29:42.256954 22891 raft_consensus.cc:729] T 00000000000000000000000000000000 P d3dac2cdb1f040dc81e80c80a59ba47b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3dac2cdb1f040dc81e80c80a59ba47b, State: Initialized, Role: FOLLOWER
I20260810 15:29:42.257118 22891 consensus_queue.cc:260] T 00000000000000000000000000000000 P d3dac2cdb1f040dc81e80c80a59ba47b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3dac2cdb1f040dc81e80c80a59ba47b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43083 } }
I20260810 15:29:42.257210 22891 raft_consensus.cc:388] T 00000000000000000000000000000000 P d3dac2cdb1f040dc81e80c80a59ba47b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 15:29:42.257256 22891 raft_consensus.cc:482] T 00000000000000000000000000000000 P d3dac2cdb1f040dc81e80c80a59ba47b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 15:29:42.257310 22891 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d3dac2cdb1f040dc81e80c80a59ba47b [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:29:42.257944 22891 raft_consensus.cc:504] T 00000000000000000000000000000000 P d3dac2cdb1f040dc81e80c80a59ba47b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3dac2cdb1f040dc81e80c80a59ba47b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43083 } }
I20260810 15:29:42.258109 22891 leader_election.cc:302] T 00000000000000000000000000000000 P d3dac2cdb1f040dc81e80c80a59ba47b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d3dac2cdb1f040dc81e80c80a59ba47b; no voters:
I20260810 15:29:42.258303 22891 leader_election.cc:288] T 00000000000000000000000000000000 P d3dac2cdb1f040dc81e80c80a59ba47b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 15:29:42.258482 22906 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d3dac2cdb1f040dc81e80c80a59ba47b [term 1 FOLLOWER]: Leader election won for term 1
I20260810 15:29:42.258600 22891 sys_catalog.cc:564] T 00000000000000000000000000000000 P d3dac2cdb1f040dc81e80c80a59ba47b [sys.catalog]: configured and running, proceeding with master startup.
I20260810 15:29:42.258677 22906 raft_consensus.cc:686] T 00000000000000000000000000000000 P d3dac2cdb1f040dc81e80c80a59ba47b [term 1 LEADER]: Becoming Leader. State: Replica: d3dac2cdb1f040dc81e80c80a59ba47b, State: Running, Role: LEADER
I20260810 15:29:42.258811 22906 consensus_queue.cc:237] T 00000000000000000000000000000000 P d3dac2cdb1f040dc81e80c80a59ba47b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3dac2cdb1f040dc81e80c80a59ba47b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43083 } }
I20260810 15:29:42.259275 22905 sys_catalog.cc:455] T 00000000000000000000000000000000 P d3dac2cdb1f040dc81e80c80a59ba47b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d3dac2cdb1f040dc81e80c80a59ba47b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3dac2cdb1f040dc81e80c80a59ba47b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43083 } } }
I20260810 15:29:42.259377 22905 sys_catalog.cc:458] T 00000000000000000000000000000000 P d3dac2cdb1f040dc81e80c80a59ba47b [sys.catalog]: This master's current role is: LEADER
I20260810 15:29:42.259599 22904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:42.253403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43195 (local address 127.0.0.1:43083)
0810 15:29:42.253613 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0810 15:29:42.253623 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 15:29:42.253663 (+ 40us) server_negotiation.cc:407] Connection header received
0810 15:29:42.254297 (+ 634us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:29:42.254308 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:29:42.254384 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:29:42.254623 (+ 239us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:29:42.254797 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:42.256419 (+ 1622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:42.257430 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:42.257829 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:42.257949 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:42.258734 (+ 785us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:29:42.258738 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:29:42.258738 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 15:29:42.258922 (+ 184us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:29:42.258961 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 15:29:42.258975 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:29:42.259016 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0810 15:29:42.259157 (+ 141us) server_negotiation.cc:299] Negotiation successful
0810 15:29:42.259227 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":95,"threads_started":1}
I20260810 15:29:42.260058 22907 sys_catalog.cc:455] T 00000000000000000000000000000000 P d3dac2cdb1f040dc81e80c80a59ba47b [sys.catalog]: SysCatalogTable state changed. Reason: New leader d3dac2cdb1f040dc81e80c80a59ba47b. Latest consensus state: current_term: 1 leader_uuid: "d3dac2cdb1f040dc81e80c80a59ba47b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3dac2cdb1f040dc81e80c80a59ba47b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43083 } } }
I20260810 15:29:42.260154 22907 sys_catalog.cc:458] T 00000000000000000000000000000000 P d3dac2cdb1f040dc81e80c80a59ba47b [sys.catalog]: This master's current role is: LEADER
I20260810 15:29:42.260550 18706 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260810 15:29:42.260740 22938 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d3dac2cdb1f040dc81e80c80a59ba47b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 15:29:42.260795 22938 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 15:29:42.260895 22923 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 15:29:42.261067 22923 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 15:29:42.263382 22923 catalog_manager.cc:1347] Generated new cluster ID: 0b068d42100c43df86f3a5dcb894d252
I20260810 15:29:42.263437 22923 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 15:29:42.268596 22904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:42.262300 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58109 (local address 127.0.0.1:43083)
0810 15:29:42.262339 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0810 15:29:42.262342 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 15:29:42.262459 (+ 117us) server_negotiation.cc:407] Connection header received
0810 15:29:42.262523 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:29:42.262524 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:29:42.262534 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:29:42.262595 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:29:42.262759 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:42.263290 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:42.267142 (+ 3852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:42.267483 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:42.267568 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:42.268319 (+ 751us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:29:42.268321 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:29:42.268321 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 15:29:42.268326 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:29:42.268339 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 15:29:42.268342 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:29:42.268399 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0810 15:29:42.268476 (+ 77us) server_negotiation.cc:299] Negotiation successful
0810 15:29:42.268499 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260810 15:29:42.278743 22923 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 15:29:42.279323 22923 catalog_manager.cc:1504] Loading token signing keys...
I20260810 15:29:42.289350 22923 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d3dac2cdb1f040dc81e80c80a59ba47b: Generated new TSK 0
I20260810 15:29:42.289551 22923 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 15:29:42.297710 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 22758
2026-08-10T15:29:42Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1615 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786375520124696-18706-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 15:29:42 dist-test-slave-2p8l krb5kdc[22957](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 15:29:42 dist-test-slave-2p8l krb5kdc[22957](info): set up 2 sockets
Aug 10 15:29:42 dist-test-slave-2p8l krb5kdc[22957](info): commencing operation
krb5kdc: starting...
W20260810 15:29:43.634229 18706 mini_kdc.cc:121] Time spent starting KDC: real 1.303s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786375520124696-18706-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786375520124696-18706-0/krb5kdc/test-user.keytab.
Aug 10 15:29:43 dist-test-slave-2p8l krb5kdc[22957](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375783, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T15:29:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T15:29:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786375520124696-18706-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786375520124696-18706-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 15:29:43.756271 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786375520124696-18706-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786375520124696-18706-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786375520124696-18706-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39845
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786375520124696-18706-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42957
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39845
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:29:43.840615 22985 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:29:43.840852 22985 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:29:43.840888 22985 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:29:43.842012 22985 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 15:29:43.842101 22985 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:29:43.842137 22985 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:29:43.842162 22985 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 15:29:43.842247 22985 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 15:29:43.844126 22985 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42957
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786375520124696-18706-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786375520124696-18706-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39845
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786375520124696-18706-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39845
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22985
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786375520124696-18706-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:29:43.844395 22985 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:29:43.844646 22985 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:29:43.849499 22992 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:29:43.849506 22995 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:29:43.849524 22993 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:29:43.849867 22985 server_base.cc:1034] running on GCE node
I20260810 15:29:43.850174 22985 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:29:43.850469 22985 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:29:43.851670 22985 hybrid_clock.cc:648] HybridClock initialized: now 1786375783851661 us; error 37 us; skew 500 ppm
Aug 10 15:29:43 dist-test-slave-2p8l krb5kdc[22957](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375783, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:29:43.854442 22985 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 15:29:43.854959 22985 webserver.cc:460] Webserver started at http://127.0.0.1:41395/ using document root <none> and password file <none>
I20260810 15:29:43.855206 22985 fs_manager.cc:359] Metadata directory not provided
I20260810 15:29:43.855273 22985 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:29:43.855420 22985 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:29:43.856436 22985 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786375520124696-18706-0/minicluster-data/master-0/data/instance:
uuid: "9d28a743c87345d082b8bea64bf36856"
format_stamp: "Formatted at 2026-08-10 15:29:43 on dist-test-slave-2p8l"
server_key: "ad251e862c2110af2bd503cb7b9bdbb2"
server_key_iv: "8a9287fee115bd9b5fe853c3b5efb8ca"
server_key_version: "encryptionkey@0"
I20260810 15:29:43.856796 22985 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786375520124696-18706-0/minicluster-data/master-0/wal/instance:
uuid: "9d28a743c87345d082b8bea64bf36856"
format_stamp: "Formatted at 2026-08-10 15:29:43 on dist-test-slave-2p8l"
server_key: "ad251e862c2110af2bd503cb7b9bdbb2"
server_key_iv: "8a9287fee115bd9b5fe853c3b5efb8ca"
server_key_version: "encryptionkey@0"
I20260810 15:29:43.858170 22985 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260810 15:29:43.858959 23005 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:29:43.859133 22985 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:29:43.859232 22985 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786375520124696-18706-0/minicluster-data/master-0/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786375520124696-18706-0/minicluster-data/master-0/wal
uuid: "9d28a743c87345d082b8bea64bf36856"
format_stamp: "Formatted at 2026-08-10 15:29:43 on dist-test-slave-2p8l"
server_key: "ad251e862c2110af2bd503cb7b9bdbb2"
server_key_iv: "8a9287fee115bd9b5fe853c3b5efb8ca"
server_key_version: "encryptionkey@0"
I20260810 15:29:43.859313 22985 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786375520124696-18706-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786375520124696-18706-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786375520124696-18706-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:29:43.862619 22985 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:29:43.864377 22985 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:29:43.864552 22985 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:29:43.868546 22985 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39845
I20260810 15:29:43.868577 23105 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39845 every 8 connection(s)
I20260810 15:29:43.868914 22985 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
I20260810 15:29:43.869861 23106 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:29:43.871312 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 22985
I20260810 15:29:43.871439 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786375520124696-18706-0/minicluster-data/master-0/wal/instance
I20260810 15:29:43.871637 18706 external_mini_cluster.cc:1428] Setting key 870f34ac060b3a8501ff29e151b1f198
I20260810 15:29:43.872558 23106 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9d28a743c87345d082b8bea64bf36856: Bootstrap starting.
I20260810 15:29:43.873255 23106 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9d28a743c87345d082b8bea64bf36856: Neither blocks nor log segments found. Creating new log.
I20260810 15:29:43.873539 23106 log.cc:824] T 00000000000000000000000000000000 P 9d28a743c87345d082b8bea64bf36856: Log is configured to *not* fsync() on all Append() calls
I20260810 15:29:43.874168 23110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:43.872132 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33091 (local address 127.0.0.1:39845)
0810 15:29:43.872300 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0810 15:29:43.872307 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 15:29:43.872331 (+ 24us) server_negotiation.cc:407] Connection header received
0810 15:29:43.872784 (+ 453us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:29:43.872791 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:29:43.872823 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:29:43.872942 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:29:43.873634 (+ 692us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:29:43.873637 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:29:43.873638 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 15:29:43.873642 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:29:43.873683 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 15:29:43.873698 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:29:43.873814 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0810 15:29:43.873885 (+ 71us) server_negotiation.cc:299] Negotiation successful
0810 15:29:43.873933 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":113,"thread_start_us":82,"threads_started":1}
I20260810 15:29:43.874383 23106 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9d28a743c87345d082b8bea64bf36856: No bootstrap required, opened a new log
I20260810 15:29:43.875223 18706 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 15:29:43.876554 23106 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9d28a743c87345d082b8bea64bf36856 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d28a743c87345d082b8bea64bf36856" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39845 } }
I20260810 15:29:43.876744 23106 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9d28a743c87345d082b8bea64bf36856 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:29:43.876802 23106 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9d28a743c87345d082b8bea64bf36856 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d28a743c87345d082b8bea64bf36856, State: Initialized, Role: FOLLOWER
I20260810 15:29:43.876932 23106 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9d28a743c87345d082b8bea64bf36856 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d28a743c87345d082b8bea64bf36856" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39845 } }
I20260810 15:29:43.877035 23106 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9d28a743c87345d082b8bea64bf36856 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 15:29:43.877112 23106 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9d28a743c87345d082b8bea64bf36856 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 15:29:43.877168 23106 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9d28a743c87345d082b8bea64bf36856 [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:29:43.877671 23110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:43.876609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53859 (local address 127.0.0.1:39845)
0810 15:29:43.876647 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0810 15:29:43.876649 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:29:43.876718 (+ 69us) server_negotiation.cc:407] Connection header received
0810 15:29:43.876782 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:29:43.876783 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:29:43.876787 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:29:43.876848 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:29:43.877462 (+ 614us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:29:43.877463 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:29:43.877464 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 15:29:43.877467 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:29:43.877479 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 15:29:43.877482 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:29:43.877523 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0810 15:29:43.877577 (+ 54us) server_negotiation.cc:299] Negotiation successful
0810 15:29:43.877587 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260810 15:29:43.877933 23106 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9d28a743c87345d082b8bea64bf36856 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d28a743c87345d082b8bea64bf36856" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39845 } }
I20260810 15:29:43.878043 23106 leader_election.cc:302] T 00000000000000000000000000000000 P 9d28a743c87345d082b8bea64bf36856 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9d28a743c87345d082b8bea64bf36856; no voters:
I20260810 15:29:43.878227 23106 leader_election.cc:288] T 00000000000000000000000000000000 P 9d28a743c87345d082b8bea64bf36856 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 15:29:43.878253 23121 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9d28a743c87345d082b8bea64bf36856 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 15:29:43.878445 23121 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9d28a743c87345d082b8bea64bf36856 [term 1 LEADER]: Becoming Leader. State: Replica: 9d28a743c87345d082b8bea64bf36856, State: Running, Role: LEADER
I20260810 15:29:43.878455 23106 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9d28a743c87345d082b8bea64bf36856 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 15:29:43.878549 23121 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9d28a743c87345d082b8bea64bf36856 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d28a743c87345d082b8bea64bf36856" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39845 } }
I20260810 15:29:43.878895 23124 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d28a743c87345d082b8bea64bf36856 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9d28a743c87345d082b8bea64bf36856" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d28a743c87345d082b8bea64bf36856" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39845 } } }
I20260810 15:29:43.878899 23125 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d28a743c87345d082b8bea64bf36856 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9d28a743c87345d082b8bea64bf36856. Latest consensus state: current_term: 1 leader_uuid: "9d28a743c87345d082b8bea64bf36856" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d28a743c87345d082b8bea64bf36856" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39845 } } }
I20260810 15:29:43.879009 23124 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d28a743c87345d082b8bea64bf36856 [sys.catalog]: This master's current role is: LEADER
I20260810 15:29:43.879014 23125 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d28a743c87345d082b8bea64bf36856 [sys.catalog]: This master's current role is: LEADER
I20260810 15:29:43.879825 23139 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 15:29:43.880465 23139 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 15:29:43.881855 23139 catalog_manager.cc:1347] Generated new cluster ID: 18f557395f87461b90006e9357287328
I20260810 15:29:43.881906 23139 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 15:29:43.893220 23139 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 15:29:43.893393 23139 catalog_manager.cc:1504] Loading token signing keys...
I20260810 15:29:43.907519 23139 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9d28a743c87345d082b8bea64bf36856: Generated new TSK 0
I20260810 15:29:43.907783 23139 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 15:29:43.911123 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 22985
2026-08-10T15:29:43Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1607 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786375520124696-18706-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 15:29:43 dist-test-slave-2p8l krb5kdc[23158](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 15:29:43 dist-test-slave-2p8l krb5kdc[23158](info): set up 2 sockets
Aug 10 15:29:43 dist-test-slave-2p8l krb5kdc[23158](info): commencing operation
krb5kdc: starting...
W20260810 15:29:45.203056 18706 mini_kdc.cc:121] Time spent starting KDC: real 1.264s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786375520124696-18706-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786375520124696-18706-0/krb5kdc/test-user.keytab.
Aug 10 15:29:45 dist-test-slave-2p8l krb5kdc[23158](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375785, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T15:29:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T15:29:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786375520124696-18706-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786375520124696-18706-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 15:29:45.328920 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786375520124696-18706-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786375520124696-18706-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786375520124696-18706-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35207
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786375520124696-18706-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43941
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35207
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:29:45.412041 23178 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:29:45.412295 23178 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:29:45.412335 23178 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:29:45.413483 23178 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 15:29:45.413563 23178 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:29:45.413589 23178 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:29:45.413610 23178 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 15:29:45.413638 23178 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 15:29:45.415144 23178 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43941
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786375520124696-18706-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786375520124696-18706-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35207
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786375520124696-18706-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35207
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23178
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786375520124696-18706-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:29:45.415428 23178 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:29:45.415658 23178 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:29:45.420871 23184 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:29:45.420871 23190 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:29:45.420871 23185 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:29:45.420984 23178 server_base.cc:1034] running on GCE node
I20260810 15:29:45.421402 23178 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:29:45.421746 23178 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:29:45.422938 23178 hybrid_clock.cc:648] HybridClock initialized: now 1786375785422929 us; error 36 us; skew 500 ppm
Aug 10 15:29:45 dist-test-slave-2p8l krb5kdc[23158](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375785, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:29:45.425697 23178 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 15:29:45.426226 23178 webserver.cc:460] Webserver started at http://127.0.0.1:45919/ using document root <none> and password file <none>
I20260810 15:29:45.426455 23178 fs_manager.cc:359] Metadata directory not provided
I20260810 15:29:45.426522 23178 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:29:45.426659 23178 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:29:45.427772 23178 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786375520124696-18706-0/minicluster-data/master-0/data/instance:
uuid: "2a4218c9fd68469da6ae1a1c12cf2056"
format_stamp: "Formatted at 2026-08-10 15:29:45 on dist-test-slave-2p8l"
server_key: "c964a5eae9af548bdc668750543e8d0b"
server_key_iv: "8278b784adccbadb45a637a059cd3a5f"
server_key_version: "encryptionkey@0"
I20260810 15:29:45.428153 23178 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786375520124696-18706-0/minicluster-data/master-0/wal/instance:
uuid: "2a4218c9fd68469da6ae1a1c12cf2056"
format_stamp: "Formatted at 2026-08-10 15:29:45 on dist-test-slave-2p8l"
server_key: "c964a5eae9af548bdc668750543e8d0b"
server_key_iv: "8278b784adccbadb45a637a059cd3a5f"
server_key_version: "encryptionkey@0"
I20260810 15:29:45.429535 23178 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 15:29:45.430446 23201 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:29:45.430691 23178 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:29:45.430780 23178 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786375520124696-18706-0/minicluster-data/master-0/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786375520124696-18706-0/minicluster-data/master-0/wal
uuid: "2a4218c9fd68469da6ae1a1c12cf2056"
format_stamp: "Formatted at 2026-08-10 15:29:45 on dist-test-slave-2p8l"
server_key: "c964a5eae9af548bdc668750543e8d0b"
server_key_iv: "8278b784adccbadb45a637a059cd3a5f"
server_key_version: "encryptionkey@0"
I20260810 15:29:45.430835 23178 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786375520124696-18706-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786375520124696-18706-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786375520124696-18706-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:29:45.441962 23178 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:29:45.444136 23178 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:29:45.444257 23178 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:29:45.448098 23178 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35207
I20260810 15:29:45.448156 23289 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35207 every 8 connection(s)
I20260810 15:29:45.448498 23178 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
I20260810 15:29:45.449447 23290 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:29:45.452008 23290 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a4218c9fd68469da6ae1a1c12cf2056: Bootstrap starting.
I20260810 15:29:45.452662 23290 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2a4218c9fd68469da6ae1a1c12cf2056: Neither blocks nor log segments found. Creating new log.
I20260810 15:29:45.452982 23290 log.cc:824] T 00000000000000000000000000000000 P 2a4218c9fd68469da6ae1a1c12cf2056: Log is configured to *not* fsync() on all Append() calls
I20260810 15:29:45.453822 23290 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a4218c9fd68469da6ae1a1c12cf2056: No bootstrap required, opened a new log
I20260810 15:29:45.454663 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 23178
I20260810 15:29:45.454789 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786375520124696-18706-0/minicluster-data/master-0/wal/instance
I20260810 15:29:45.454984 18706 external_mini_cluster.cc:1428] Setting key e34e8fc0c3857ea1f64cad7a7e14a721
I20260810 15:29:45.456080 23290 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2a4218c9fd68469da6ae1a1c12cf2056 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a4218c9fd68469da6ae1a1c12cf2056" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35207 } }
I20260810 15:29:45.456243 23290 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2a4218c9fd68469da6ae1a1c12cf2056 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:29:45.456307 23290 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2a4218c9fd68469da6ae1a1c12cf2056 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a4218c9fd68469da6ae1a1c12cf2056, State: Initialized, Role: FOLLOWER
I20260810 15:29:45.456478 23290 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2a4218c9fd68469da6ae1a1c12cf2056 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a4218c9fd68469da6ae1a1c12cf2056" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35207 } }
I20260810 15:29:45.456578 23290 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2a4218c9fd68469da6ae1a1c12cf2056 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 15:29:45.456624 23290 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2a4218c9fd68469da6ae1a1c12cf2056 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 15:29:45.456673 23290 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2a4218c9fd68469da6ae1a1c12cf2056 [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:29:45.457556 23290 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2a4218c9fd68469da6ae1a1c12cf2056 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a4218c9fd68469da6ae1a1c12cf2056" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35207 } }
I20260810 15:29:45.457674 23290 leader_election.cc:302] T 00000000000000000000000000000000 P 2a4218c9fd68469da6ae1a1c12cf2056 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2a4218c9fd68469da6ae1a1c12cf2056; no voters:
I20260810 15:29:45.457867 23290 leader_election.cc:288] T 00000000000000000000000000000000 P 2a4218c9fd68469da6ae1a1c12cf2056 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 15:29:45.457890 23298 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2a4218c9fd68469da6ae1a1c12cf2056 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 15:29:45.458005 23298 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2a4218c9fd68469da6ae1a1c12cf2056 [term 1 LEADER]: Becoming Leader. State: Replica: 2a4218c9fd68469da6ae1a1c12cf2056, State: Running, Role: LEADER
I20260810 15:29:45.458166 23290 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2a4218c9fd68469da6ae1a1c12cf2056 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 15:29:45.458196 23298 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2a4218c9fd68469da6ae1a1c12cf2056 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a4218c9fd68469da6ae1a1c12cf2056" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35207 } }
I20260810 15:29:45.458659 23303 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a4218c9fd68469da6ae1a1c12cf2056 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2a4218c9fd68469da6ae1a1c12cf2056. Latest consensus state: current_term: 1 leader_uuid: "2a4218c9fd68469da6ae1a1c12cf2056" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a4218c9fd68469da6ae1a1c12cf2056" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35207 } } }
I20260810 15:29:45.458753 23303 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a4218c9fd68469da6ae1a1c12cf2056 [sys.catalog]: This master's current role is: LEADER
I20260810 15:29:45.458961 23300 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a4218c9fd68469da6ae1a1c12cf2056 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2a4218c9fd68469da6ae1a1c12cf2056" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a4218c9fd68469da6ae1a1c12cf2056" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35207 } } }
I20260810 15:29:45.459329 23314 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 15:29:45.459355 23300 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a4218c9fd68469da6ae1a1c12cf2056 [sys.catalog]: This master's current role is: LEADER
I20260810 15:29:45.459908 23314 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 10 15:29:45 dist-test-slave-2p8l krb5kdc[23158](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375785, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260810 15:29:45.462904 23314 catalog_manager.cc:1347] Generated new cluster ID: 2ae10e801bb54908b3989ff397be2d48
I20260810 15:29:45.462960 23314 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 15:29:45.466440 23297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:45.455593 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.168:58483 (local address 127.0.0.1:35207)
0810 15:29:45.455800 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0810 15:29:45.455811 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 15:29:45.455862 (+ 51us) server_negotiation.cc:407] Connection header received
0810 15:29:45.456057 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:29:45.456063 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:29:45.456113 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:29:45.456262 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:29:45.457005 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:45.458106 (+ 1101us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:45.459201 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:45.459810 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:45.459960 (+ 150us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:45.463112 (+ 3152us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:29:45.463116 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:29:45.463116 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:29:45.463126 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:29:45.464829 (+ 1703us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:29:45.465242 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:29:45.465245 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:29:45.465245 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:29:45.465355 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:29:45.465592 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:29:45.465593 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:29:45.465593 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:29:45.465823 (+ 230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:29:45.466014 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0810 15:29:45.466123 (+ 109us) server_negotiation.cc:299] Negotiation successful
0810 15:29:45.466229 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":81,"threads_started":1}
I20260810 15:29:45.467376 18706 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 15:29:45.474822 23297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:45.468731 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.168:33693 (local address 127.0.0.1:35207)
0810 15:29:45.468769 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0810 15:29:45.468771 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:29:45.468898 (+ 127us) server_negotiation.cc:407] Connection header received
0810 15:29:45.468971 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:29:45.468972 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:29:45.468982 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:29:45.469025 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:29:45.469526 (+ 501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:45.470002 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:45.470762 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:45.470996 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:45.471086 (+ 90us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:45.472210 (+ 1124us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:29:45.472212 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:29:45.472212 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:29:45.472219 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:29:45.473600 (+ 1381us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:29:45.473953 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:29:45.473954 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:29:45.473954 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:29:45.474014 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:29:45.474281 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:29:45.474282 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:29:45.474282 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:29:45.474390 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:29:45.474518 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0810 15:29:45.474648 (+ 130us) server_negotiation.cc:299] Negotiation successful
0810 15:29:45.474710 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260810 15:29:45.489472 23314 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 15:29:45.490229 23314 catalog_manager.cc:1504] Loading token signing keys...
I20260810 15:29:45.494282 23314 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2a4218c9fd68469da6ae1a1c12cf2056: Generated new TSK 0
I20260810 15:29:45.494463 23314 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 15:29:45.500263 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 23178
W20260810 15:29:45.517632 23154 connection.cc:535] client connection to 127.0.0.1:35207 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:35207): Connection reset by peer (error 104)
2026-08-10T15:29:45Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1593 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786375520124696-18706-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 15:29:45 dist-test-slave-2p8l krb5kdc[23351](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 15:29:45 dist-test-slave-2p8l krb5kdc[23351](info): set up 2 sockets
Aug 10 15:29:45 dist-test-slave-2p8l krb5kdc[23351](info): commencing operation
krb5kdc: starting...
W20260810 15:29:46.792237 18706 mini_kdc.cc:121] Time spent starting KDC: real 1.260s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786375520124696-18706-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786375520124696-18706-0/krb5kdc/test-user.keytab.
Aug 10 15:29:46 dist-test-slave-2p8l krb5kdc[23351](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375786, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T15:29:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T15:29:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786375520124696-18706-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786375520124696-18706-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 15:29:46.923370 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786375520124696-18706-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786375520124696-18706-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786375520124696-18706-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44023
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786375520124696-18706-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39189
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44023
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:29:47.012847 23371 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:29:47.013060 23371 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:29:47.013084 23371 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:29:47.014375 23371 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 15:29:47.014416 23371 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:29:47.014432 23371 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:29:47.014446 23371 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 15:29:47.014487 23371 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 15:29:47.015983 23371 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39189
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786375520124696-18706-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786375520124696-18706-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44023
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786375520124696-18706-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44023
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23371
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786375520124696-18706-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:29:47.016237 23371 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:29:47.016464 23371 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:29:47.021415 23381 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:29:47.021435 23380 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:29:47.021462 23384 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:29:47.021654 23371 server_base.cc:1034] running on GCE node
I20260810 15:29:47.021875 23371 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:29:47.022282 23371 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:29:47.023453 23371 hybrid_clock.cc:648] HybridClock initialized: now 1786375787023437 us; error 35 us; skew 500 ppm
Aug 10 15:29:47 dist-test-slave-2p8l krb5kdc[23351](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375787, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:29:47.026350 23371 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 15:29:47.026829 23371 webserver.cc:460] Webserver started at http://127.0.0.1:36901/ using document root <none> and password file <none>
I20260810 15:29:47.027058 23371 fs_manager.cc:359] Metadata directory not provided
I20260810 15:29:47.027122 23371 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:29:47.027269 23371 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:29:47.028384 23371 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786375520124696-18706-0/minicluster-data/master-0/data/instance:
uuid: "f6671193542942beb6f1597317d67bd9"
format_stamp: "Formatted at 2026-08-10 15:29:47 on dist-test-slave-2p8l"
server_key: "0c0770cddc536dea452a85ba903dceca"
server_key_iv: "f28c147871f2e741b8c89135064eb48c"
server_key_version: "encryptionkey@0"
I20260810 15:29:47.028764 23371 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786375520124696-18706-0/minicluster-data/master-0/wal/instance:
uuid: "f6671193542942beb6f1597317d67bd9"
format_stamp: "Formatted at 2026-08-10 15:29:47 on dist-test-slave-2p8l"
server_key: "0c0770cddc536dea452a85ba903dceca"
server_key_iv: "f28c147871f2e741b8c89135064eb48c"
server_key_version: "encryptionkey@0"
I20260810 15:29:47.030150 23371 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 15:29:47.030936 23396 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:29:47.031176 23371 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:29:47.031296 23371 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786375520124696-18706-0/minicluster-data/master-0/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786375520124696-18706-0/minicluster-data/master-0/wal
uuid: "f6671193542942beb6f1597317d67bd9"
format_stamp: "Formatted at 2026-08-10 15:29:47 on dist-test-slave-2p8l"
server_key: "0c0770cddc536dea452a85ba903dceca"
server_key_iv: "f28c147871f2e741b8c89135064eb48c"
server_key_version: "encryptionkey@0"
I20260810 15:29:47.031384 23371 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786375520124696-18706-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786375520124696-18706-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786375520124696-18706-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:29:47.058086 23371 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:29:47.063467 23371 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:29:47.063668 23371 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:29:47.069744 23371 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44023
I20260810 15:29:47.069802 23490 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44023 every 8 connection(s)
I20260810 15:29:47.070330 23371 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
I20260810 15:29:47.071388 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 23371
I20260810 15:29:47.071516 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786375520124696-18706-0/minicluster-data/master-0/wal/instance
I20260810 15:29:47.071537 23491 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:29:47.071734 18706 external_mini_cluster.cc:1428] Setting key 262d5ae7f67947c06f00af90ba17e4e0
I20260810 15:29:47.075115 23491 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f6671193542942beb6f1597317d67bd9: Bootstrap starting.
I20260810 15:29:47.075807 23491 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f6671193542942beb6f1597317d67bd9: Neither blocks nor log segments found. Creating new log.
I20260810 15:29:47.076152 23491 log.cc:824] T 00000000000000000000000000000000 P f6671193542942beb6f1597317d67bd9: Log is configured to *not* fsync() on all Append() calls
I20260810 15:29:47.076972 23491 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f6671193542942beb6f1597317d67bd9: No bootstrap required, opened a new log
I20260810 15:29:47.079120 23497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:47.072498 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.168:56385 (local address 127.0.0.1:44023)
0810 15:29:47.072718 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0810 15:29:47.072728 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 15:29:47.072760 (+ 32us) server_negotiation.cc:407] Connection header received
0810 15:29:47.073361 (+ 601us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:29:47.073371 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:29:47.073441 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:29:47.073597 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:29:47.073969 (+ 372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:47.075621 (+ 1652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:47.076695 (+ 1074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:47.077330 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:47.077451 (+ 121us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:47.078320 (+ 869us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:29:47.078325 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:29:47.078325 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 15:29:47.078541 (+ 216us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:29:47.078594 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 15:29:47.078610 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:29:47.078706 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0810 15:29:47.078857 (+ 151us) server_negotiation.cc:299] Negotiation successful
0810 15:29:47.078890 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":158,"thread_start_us":116,"threads_started":1}
I20260810 15:29:47.079552 23491 raft_consensus.cc:348] T 00000000000000000000000000000000 P f6671193542942beb6f1597317d67bd9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f6671193542942beb6f1597317d67bd9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44023 } }
I20260810 15:29:47.079738 23491 raft_consensus.cc:374] T 00000000000000000000000000000000 P f6671193542942beb6f1597317d67bd9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:29:47.079780 23491 raft_consensus.cc:729] T 00000000000000000000000000000000 P f6671193542942beb6f1597317d67bd9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6671193542942beb6f1597317d67bd9, State: Initialized, Role: FOLLOWER
I20260810 15:29:47.079898 23491 consensus_queue.cc:260] T 00000000000000000000000000000000 P f6671193542942beb6f1597317d67bd9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f6671193542942beb6f1597317d67bd9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44023 } }
I20260810 15:29:47.079991 23491 raft_consensus.cc:388] T 00000000000000000000000000000000 P f6671193542942beb6f1597317d67bd9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 15:29:47.080024 23491 raft_consensus.cc:482] T 00000000000000000000000000000000 P f6671193542942beb6f1597317d67bd9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 15:29:47.080063 23491 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f6671193542942beb6f1597317d67bd9 [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:29:47.080283 18706 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 15:29:47.080832 23491 raft_consensus.cc:504] T 00000000000000000000000000000000 P f6671193542942beb6f1597317d67bd9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f6671193542942beb6f1597317d67bd9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44023 } }
I20260810 15:29:47.080940 23491 leader_election.cc:302] T 00000000000000000000000000000000 P f6671193542942beb6f1597317d67bd9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f6671193542942beb6f1597317d67bd9; no voters:
I20260810 15:29:47.081137 23491 leader_election.cc:288] T 00000000000000000000000000000000 P f6671193542942beb6f1597317d67bd9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 15:29:47.081205 23502 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f6671193542942beb6f1597317d67bd9 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 15:29:47.081367 23502 raft_consensus.cc:686] T 00000000000000000000000000000000 P f6671193542942beb6f1597317d67bd9 [term 1 LEADER]: Becoming Leader. State: Replica: f6671193542942beb6f1597317d67bd9, State: Running, Role: LEADER
I20260810 15:29:47.081398 23491 sys_catalog.cc:564] T 00000000000000000000000000000000 P f6671193542942beb6f1597317d67bd9 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 15:29:47.081458 23502 consensus_queue.cc:237] T 00000000000000000000000000000000 P f6671193542942beb6f1597317d67bd9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f6671193542942beb6f1597317d67bd9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44023 } }
I20260810 15:29:47.081790 23502 sys_catalog.cc:455] T 00000000000000000000000000000000 P f6671193542942beb6f1597317d67bd9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f6671193542942beb6f1597317d67bd9. Latest consensus state: current_term: 1 leader_uuid: "f6671193542942beb6f1597317d67bd9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f6671193542942beb6f1597317d67bd9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44023 } } }
I20260810 15:29:47.081801 23506 sys_catalog.cc:455] T 00000000000000000000000000000000 P f6671193542942beb6f1597317d67bd9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f6671193542942beb6f1597317d67bd9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f6671193542942beb6f1597317d67bd9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44023 } } }
I20260810 15:29:47.081897 23502 sys_catalog.cc:458] T 00000000000000000000000000000000 P f6671193542942beb6f1597317d67bd9 [sys.catalog]: This master's current role is: LEADER
I20260810 15:29:47.081902 23506 sys_catalog.cc:458] T 00000000000000000000000000000000 P f6671193542942beb6f1597317d67bd9 [sys.catalog]: This master's current role is: LEADER
W20260810 15:29:47.083386 23540 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f6671193542942beb6f1597317d67bd9: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 15:29:47.083451 23540 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 15:29:47.083539 23521 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 15:29:47.083742 23521 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 15:29:47.086374 23497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:47.082217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.168:32905 (local address 127.0.0.1:44023)
0810 15:29:47.082524 (+ 307us) server_negotiation.cc:206] Beginning negotiation
0810 15:29:47.082527 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 15:29:47.082563 (+ 36us) server_negotiation.cc:407] Connection header received
0810 15:29:47.082634 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:29:47.082635 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:29:47.082646 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:29:47.082705 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:29:47.082943 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:47.083776 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:47.084944 (+ 1168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:47.085167 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:47.085300 (+ 133us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:47.086115 (+ 815us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:29:47.086116 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:29:47.086117 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 15:29:47.086122 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:29:47.086138 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 15:29:47.086142 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:29:47.086203 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0810 15:29:47.086280 (+ 77us) server_negotiation.cc:299] Negotiation successful
0810 15:29:47.086290 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":283}
I20260810 15:29:47.095433 23521 catalog_manager.cc:1347] Generated new cluster ID: bbded67e56fd48e5a527cc0c8cbc7029
I20260810 15:29:47.095510 23521 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 15:29:47.109493 23521 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 15:29:47.110225 23521 catalog_manager.cc:1504] Loading token signing keys...
I20260810 15:29:47.117372 23521 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f6671193542942beb6f1597317d67bd9: Generated new TSK 0
I20260810 15:29:47.117590 23521 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 15:29:47.120891 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 23371
W20260810 15:29:47.138171 23344 connection.cc:535] client connection to 127.0.0.1:44023 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:44023): Connection reset by peer (error 104)
2026-08-10T15:29:47Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1620 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786375520124696-18706-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 15:29:47 dist-test-slave-2p8l krb5kdc[23548](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 15:29:47 dist-test-slave-2p8l krb5kdc[23548](info): set up 2 sockets
Aug 10 15:29:47 dist-test-slave-2p8l krb5kdc[23548](info): commencing operation
krb5kdc: starting...
W20260810 15:29:48.425323 18706 mini_kdc.cc:121] Time spent starting KDC: real 1.273s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786375520124696-18706-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786375520124696-18706-0/krb5kdc/test-user.keytab.
Aug 10 15:29:48 dist-test-slave-2p8l krb5kdc[23548](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375788, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T15:29:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T15:29:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786375520124696-18706-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786375520124696-18706-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 15:29:48.548228 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786375520124696-18706-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786375520124696-18706-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786375520124696-18706-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43143
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786375520124696-18706-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37455
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43143
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:29:48.629731 23571 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:29:48.629961 23571 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:29:48.629997 23571 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:29:48.631161 23571 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 15:29:48.631224 23571 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:29:48.631248 23571 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:29:48.631270 23571 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 15:29:48.631306 23571 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 15:29:48.632762 23571 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37455
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786375520124696-18706-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786375520124696-18706-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43143
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786375520124696-18706-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43143
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23571
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786375520124696-18706-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:29:48.633023 23571 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:29:48.633240 23571 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:29:48.638204 23578 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:29:48.638226 23580 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:29:48.638199 23577 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:29:48.638401 23571 server_base.cc:1034] running on GCE node
I20260810 15:29:48.638743 23571 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:29:48.639045 23571 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:29:48.640209 23571 hybrid_clock.cc:648] HybridClock initialized: now 1786375788640194 us; error 25 us; skew 500 ppm
Aug 10 15:29:48 dist-test-slave-2p8l krb5kdc[23548](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375788, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:29:48.647642 23571 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 15:29:48.648072 23571 webserver.cc:460] Webserver started at http://127.0.0.1:46741/ using document root <none> and password file <none>
I20260810 15:29:48.648289 23571 fs_manager.cc:359] Metadata directory not provided
I20260810 15:29:48.648334 23571 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:29:48.648491 23571 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:29:48.649569 23571 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786375520124696-18706-0/minicluster-data/master-0/data/instance:
uuid: "7d2f8371a31c4fbd9fada22a3a4f7715"
format_stamp: "Formatted at 2026-08-10 15:29:48 on dist-test-slave-2p8l"
server_key: "a99151d7121398c3c3f07b59b4500fab"
server_key_iv: "74fe0e7c7f354515ba489b7fe00e9837"
server_key_version: "encryptionkey@0"
I20260810 15:29:48.649931 23571 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786375520124696-18706-0/minicluster-data/master-0/wal/instance:
uuid: "7d2f8371a31c4fbd9fada22a3a4f7715"
format_stamp: "Formatted at 2026-08-10 15:29:48 on dist-test-slave-2p8l"
server_key: "a99151d7121398c3c3f07b59b4500fab"
server_key_iv: "74fe0e7c7f354515ba489b7fe00e9837"
server_key_version: "encryptionkey@0"
I20260810 15:29:48.651309 23571 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260810 15:29:48.652112 23592 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:29:48.652304 23571 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260810 15:29:48.652395 23571 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786375520124696-18706-0/minicluster-data/master-0/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786375520124696-18706-0/minicluster-data/master-0/wal
uuid: "7d2f8371a31c4fbd9fada22a3a4f7715"
format_stamp: "Formatted at 2026-08-10 15:29:48 on dist-test-slave-2p8l"
server_key: "a99151d7121398c3c3f07b59b4500fab"
server_key_iv: "74fe0e7c7f354515ba489b7fe00e9837"
server_key_version: "encryptionkey@0"
I20260810 15:29:48.652493 23571 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786375520124696-18706-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786375520124696-18706-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786375520124696-18706-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:29:48.655830 23571 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:29:48.658036 23571 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:29:48.658234 23571 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:29:48.662483 23571 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43143
I20260810 15:29:48.662518 23682 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43143 every 8 connection(s)
I20260810 15:29:48.662868 23571 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
I20260810 15:29:48.663904 23683 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:29:48.666254 23683 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7d2f8371a31c4fbd9fada22a3a4f7715: Bootstrap starting.
I20260810 15:29:48.666832 23683 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7d2f8371a31c4fbd9fada22a3a4f7715: Neither blocks nor log segments found. Creating new log.
I20260810 15:29:48.667069 23683 log.cc:824] T 00000000000000000000000000000000 P 7d2f8371a31c4fbd9fada22a3a4f7715: Log is configured to *not* fsync() on all Append() calls
I20260810 15:29:48.667757 23683 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7d2f8371a31c4fbd9fada22a3a4f7715: No bootstrap required, opened a new log
I20260810 15:29:48.669265 23683 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7d2f8371a31c4fbd9fada22a3a4f7715 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d2f8371a31c4fbd9fada22a3a4f7715" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43143 } }
I20260810 15:29:48.669399 23683 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7d2f8371a31c4fbd9fada22a3a4f7715 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:29:48.669421 23683 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7d2f8371a31c4fbd9fada22a3a4f7715 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2f8371a31c4fbd9fada22a3a4f7715, State: Initialized, Role: FOLLOWER
I20260810 15:29:48.669569 23683 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7d2f8371a31c4fbd9fada22a3a4f7715 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d2f8371a31c4fbd9fada22a3a4f7715" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43143 } }
I20260810 15:29:48.669651 23683 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7d2f8371a31c4fbd9fada22a3a4f7715 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 15:29:48.669674 23683 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7d2f8371a31c4fbd9fada22a3a4f7715 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 15:29:48.669703 23683 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7d2f8371a31c4fbd9fada22a3a4f7715 [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:29:48.670250 23683 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7d2f8371a31c4fbd9fada22a3a4f7715 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d2f8371a31c4fbd9fada22a3a4f7715" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43143 } }
I20260810 15:29:48.670337 23683 leader_election.cc:302] T 00000000000000000000000000000000 P 7d2f8371a31c4fbd9fada22a3a4f7715 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7d2f8371a31c4fbd9fada22a3a4f7715; no voters:
I20260810 15:29:48.670459 23683 leader_election.cc:288] T 00000000000000000000000000000000 P 7d2f8371a31c4fbd9fada22a3a4f7715 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 15:29:48.670496 23687 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7d2f8371a31c4fbd9fada22a3a4f7715 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 15:29:48.670691 23687 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7d2f8371a31c4fbd9fada22a3a4f7715 [term 1 LEADER]: Becoming Leader. State: Replica: 7d2f8371a31c4fbd9fada22a3a4f7715, State: Running, Role: LEADER
I20260810 15:29:48.670749 23683 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7d2f8371a31c4fbd9fada22a3a4f7715 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 15:29:48.670828 23687 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7d2f8371a31c4fbd9fada22a3a4f7715 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d2f8371a31c4fbd9fada22a3a4f7715" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43143 } }
I20260810 15:29:48.671204 23689 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7d2f8371a31c4fbd9fada22a3a4f7715 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7d2f8371a31c4fbd9fada22a3a4f7715" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d2f8371a31c4fbd9fada22a3a4f7715" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43143 } } }
I20260810 15:29:48.671208 23692 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7d2f8371a31c4fbd9fada22a3a4f7715 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7d2f8371a31c4fbd9fada22a3a4f7715. Latest consensus state: current_term: 1 leader_uuid: "7d2f8371a31c4fbd9fada22a3a4f7715" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d2f8371a31c4fbd9fada22a3a4f7715" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43143 } } }
I20260810 15:29:48.671305 23689 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7d2f8371a31c4fbd9fada22a3a4f7715 [sys.catalog]: This master's current role is: LEADER
I20260810 15:29:48.671334 23692 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7d2f8371a31c4fbd9fada22a3a4f7715 [sys.catalog]: This master's current role is: LEADER
I20260810 15:29:48.671844 23695 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 15:29:48.672386 23695 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 15:29:48.672910 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 23571
I20260810 15:29:48.673039 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786375520124696-18706-0/minicluster-data/master-0/wal/instance
I20260810 15:29:48.673209 18706 external_mini_cluster.cc:1428] Setting key 83bb7bfd3839b2e9e9da51739e7a2581
I20260810 15:29:48.674036 23695 catalog_manager.cc:1347] Generated new cluster ID: df0eca336876402b8d45e7163576bfed
I20260810 15:29:48.674115 23695 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 15:29:48.675475 23722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:48.673683 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.168:46617 (local address 127.0.0.1:43143)
0810 15:29:48.673880 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0810 15:29:48.673890 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 15:29:48.674017 (+ 127us) server_negotiation.cc:407] Connection header received
0810 15:29:48.674207 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:29:48.674214 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:29:48.674244 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:29:48.674386 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:29:48.675041 (+ 655us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:29:48.675045 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:29:48.675045 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 15:29:48.675050 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:29:48.675088 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 15:29:48.675104 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:29:48.675178 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0810 15:29:48.675248 (+ 70us) server_negotiation.cc:299] Negotiation successful
0810 15:29:48.675294 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":102,"threads_started":1}
I20260810 15:29:48.676440 18706 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 15:29:48.679243 23722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:48.677780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.168:56755 (local address 127.0.0.1:43143)
0810 15:29:48.677816 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0810 15:29:48.677818 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:29:48.678282 (+ 464us) server_negotiation.cc:407] Connection header received
0810 15:29:48.678354 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:29:48.678355 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:29:48.678373 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:29:48.678431 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:29:48.679012 (+ 581us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:29:48.679013 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:29:48.679013 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 15:29:48.679018 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:29:48.679032 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 15:29:48.679035 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:29:48.679092 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0810 15:29:48.679149 (+ 57us) server_negotiation.cc:299] Negotiation successful
0810 15:29:48.679164 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260810 15:29:48.690912 23695 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 15:29:48.691118 23695 catalog_manager.cc:1504] Loading token signing keys...
I20260810 15:29:48.706120 23695 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7d2f8371a31c4fbd9fada22a3a4f7715: Generated new TSK 0
I20260810 15:29:48.706453 23695 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 15:29:48.715139 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 23571
2026-08-10T15:29:48Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1596 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786375520124696-18706-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 15:29:48 dist-test-slave-2p8l krb5kdc[23738](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 15:29:48 dist-test-slave-2p8l krb5kdc[23738](info): set up 2 sockets
Aug 10 15:29:48 dist-test-slave-2p8l krb5kdc[23738](info): commencing operation
krb5kdc: starting...
W20260810 15:29:50.125268 18706 mini_kdc.cc:121] Time spent starting KDC: real 1.377s user 0.007s sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786375520124696-18706-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786375520124696-18706-0/krb5kdc/test-user.keytab.
Aug 10 15:29:50 dist-test-slave-2p8l krb5kdc[23738](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375790, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T15:29:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T15:29:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786375520124696-18706-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786375520124696-18706-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 15:29:50.253072 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786375520124696-18706-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786375520124696-18706-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786375520124696-18706-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39327
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786375520124696-18706-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33659
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39327
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:29:50.340754 23769 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:29:50.341007 23769 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:29:50.341048 23769 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:29:50.342252 23769 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 15:29:50.342324 23769 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:29:50.342350 23769 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:29:50.342382 23769 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 15:29:50.342407 23769 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 15:29:50.344285 23769 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33659
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786375520124696-18706-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786375520124696-18706-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39327
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786375520124696-18706-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39327
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23769
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786375520124696-18706-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:29:50.344586 23769 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:29:50.344846 23769 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:29:50.349792 23782 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:29:50.349813 23780 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:29:50.349949 23778 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:29:50.350423 23769 server_base.cc:1034] running on GCE node
I20260810 15:29:50.350697 23769 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:29:50.351020 23769 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:29:50.352193 23769 hybrid_clock.cc:648] HybridClock initialized: now 1786375790352170 us; error 40 us; skew 500 ppm
Aug 10 15:29:50 dist-test-slave-2p8l krb5kdc[23738](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375790, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:29:50.354777 23769 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 15:29:50.355228 23769 webserver.cc:460] Webserver started at http://127.0.0.1:46191/ using document root <none> and password file <none>
I20260810 15:29:50.355480 23769 fs_manager.cc:359] Metadata directory not provided
I20260810 15:29:50.355556 23769 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:29:50.355705 23769 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:29:50.356845 23769 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786375520124696-18706-0/minicluster-data/master-0/data/instance:
uuid: "5fe2eef5b88a49c0942be5a61f3207d6"
format_stamp: "Formatted at 2026-08-10 15:29:50 on dist-test-slave-2p8l"
server_key: "bcbedf25ff5f60065509df0910fd35ba"
server_key_iv: "ecf4fe0014be2800d564ad9498df5d7b"
server_key_version: "encryptionkey@0"
I20260810 15:29:50.357227 23769 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786375520124696-18706-0/minicluster-data/master-0/wal/instance:
uuid: "5fe2eef5b88a49c0942be5a61f3207d6"
format_stamp: "Formatted at 2026-08-10 15:29:50 on dist-test-slave-2p8l"
server_key: "bcbedf25ff5f60065509df0910fd35ba"
server_key_iv: "ecf4fe0014be2800d564ad9498df5d7b"
server_key_version: "encryptionkey@0"
I20260810 15:29:50.358790 23769 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 15:29:50.359702 23796 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:29:50.359926 23769 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 15:29:50.360040 23769 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786375520124696-18706-0/minicluster-data/master-0/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786375520124696-18706-0/minicluster-data/master-0/wal
uuid: "5fe2eef5b88a49c0942be5a61f3207d6"
format_stamp: "Formatted at 2026-08-10 15:29:50 on dist-test-slave-2p8l"
server_key: "bcbedf25ff5f60065509df0910fd35ba"
server_key_iv: "ecf4fe0014be2800d564ad9498df5d7b"
server_key_version: "encryptionkey@0"
I20260810 15:29:50.360129 23769 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786375520124696-18706-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786375520124696-18706-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786375520124696-18706-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:29:50.398507 23769 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:29:50.400767 23769 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:29:50.400954 23769 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:29:50.405386 23769 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39327
I20260810 15:29:50.405426 23895 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39327 every 8 connection(s)
I20260810 15:29:50.405793 23769 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
I20260810 15:29:50.406788 23897 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:29:50.409165 23897 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5fe2eef5b88a49c0942be5a61f3207d6: Bootstrap starting.
I20260810 15:29:50.409530 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 23769
I20260810 15:29:50.409669 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786375520124696-18706-0/minicluster-data/master-0/wal/instance
I20260810 15:29:50.409862 18706 external_mini_cluster.cc:1428] Setting key 9694f50fd5754a2c7f23f5233ad71f90
I20260810 15:29:50.409869 23897 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5fe2eef5b88a49c0942be5a61f3207d6: Neither blocks nor log segments found. Creating new log.
I20260810 15:29:50.410287 23897 log.cc:824] T 00000000000000000000000000000000 P 5fe2eef5b88a49c0942be5a61f3207d6: Log is configured to *not* fsync() on all Append() calls
I20260810 15:29:50.411209 23897 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5fe2eef5b88a49c0942be5a61f3207d6: No bootstrap required, opened a new log
I20260810 15:29:50.413513 23897 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5fe2eef5b88a49c0942be5a61f3207d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5fe2eef5b88a49c0942be5a61f3207d6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39327 } }
I20260810 15:29:50.413686 23897 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5fe2eef5b88a49c0942be5a61f3207d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:29:50.413733 23897 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5fe2eef5b88a49c0942be5a61f3207d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5fe2eef5b88a49c0942be5a61f3207d6, State: Initialized, Role: FOLLOWER
I20260810 15:29:50.413861 23897 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5fe2eef5b88a49c0942be5a61f3207d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5fe2eef5b88a49c0942be5a61f3207d6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39327 } }
I20260810 15:29:50.413959 23897 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5fe2eef5b88a49c0942be5a61f3207d6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 15:29:50.414011 23897 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5fe2eef5b88a49c0942be5a61f3207d6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 15:29:50.414083 23897 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5fe2eef5b88a49c0942be5a61f3207d6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:29:50.414678 23897 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5fe2eef5b88a49c0942be5a61f3207d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5fe2eef5b88a49c0942be5a61f3207d6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39327 } }
I20260810 15:29:50.414789 23897 leader_election.cc:302] T 00000000000000000000000000000000 P 5fe2eef5b88a49c0942be5a61f3207d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5fe2eef5b88a49c0942be5a61f3207d6; no voters:
I20260810 15:29:50.414949 23897 leader_election.cc:288] T 00000000000000000000000000000000 P 5fe2eef5b88a49c0942be5a61f3207d6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 15:29:50.415011 23913 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5fe2eef5b88a49c0942be5a61f3207d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 15:29:50.415220 23897 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5fe2eef5b88a49c0942be5a61f3207d6 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 15:29:50.415225 23913 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5fe2eef5b88a49c0942be5a61f3207d6 [term 1 LEADER]: Becoming Leader. State: Replica: 5fe2eef5b88a49c0942be5a61f3207d6, State: Running, Role: LEADER
I20260810 15:29:50.415709 23913 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5fe2eef5b88a49c0942be5a61f3207d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5fe2eef5b88a49c0942be5a61f3207d6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39327 } }
I20260810 15:29:50.416138 23915 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5fe2eef5b88a49c0942be5a61f3207d6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5fe2eef5b88a49c0942be5a61f3207d6. Latest consensus state: current_term: 1 leader_uuid: "5fe2eef5b88a49c0942be5a61f3207d6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5fe2eef5b88a49c0942be5a61f3207d6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39327 } } }
I20260810 15:29:50.416224 23915 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5fe2eef5b88a49c0942be5a61f3207d6 [sys.catalog]: This master's current role is: LEADER
I20260810 15:29:50.416553 23914 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5fe2eef5b88a49c0942be5a61f3207d6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5fe2eef5b88a49c0942be5a61f3207d6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5fe2eef5b88a49c0942be5a61f3207d6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39327 } } }
I20260810 15:29:50.416620 23914 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5fe2eef5b88a49c0942be5a61f3207d6 [sys.catalog]: This master's current role is: LEADER
W20260810 15:29:50.417349 23946 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 5fe2eef5b88a49c0942be5a61f3207d6: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 15:29:50.417395 23946 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 15:29:50.417459 23934 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 15:29:50.417654 23934 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 10 15:29:50 dist-test-slave-2p8l krb5kdc[23738](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375790, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260810 15:29:50.419205 23934 catalog_manager.cc:1347] Generated new cluster ID: 34563c9359b24ba0a7fac1c47dfb9507
I20260810 15:29:50.419256 23934 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 15:29:50.421969 23907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:50.410424 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.168:37509 (local address 127.0.0.1:39327)
0810 15:29:50.410671 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0810 15:29:50.410680 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 15:29:50.410706 (+ 26us) server_negotiation.cc:407] Connection header received
0810 15:29:50.411288 (+ 582us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:29:50.411298 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:29:50.411371 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:29:50.411537 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:29:50.412163 (+ 626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:50.413631 (+ 1468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:50.414558 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:50.415189 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:50.415335 (+ 146us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:50.418445 (+ 3110us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:29:50.418450 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:29:50.418450 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:29:50.418461 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:29:50.420309 (+ 1848us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:29:50.420790 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:29:50.420793 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:29:50.420793 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:29:50.420890 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:29:50.421132 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:29:50.421133 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:29:50.421133 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:29:50.421366 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:29:50.421559 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0810 15:29:50.421644 (+ 85us) server_negotiation.cc:299] Negotiation successful
0810 15:29:50.421744 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":194,"thread_start_us":149,"threads_started":1}
I20260810 15:29:50.422890 18706 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 15:29:50.432632 23907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:50.424262 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.168:47677 (local address 127.0.0.1:39327)
0810 15:29:50.424431 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0810 15:29:50.424433 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:29:50.426392 (+ 1959us) server_negotiation.cc:407] Connection header received
0810 15:29:50.426463 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:29:50.426464 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:29:50.426476 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:29:50.426569 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:29:50.427127 (+ 558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:50.427636 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:50.428354 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:50.428593 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:50.428685 (+ 92us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:50.429904 (+ 1219us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:29:50.429906 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:29:50.429906 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:29:50.429914 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:29:50.431383 (+ 1469us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:29:50.431772 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:29:50.431773 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:29:50.431773 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:29:50.431834 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:29:50.432064 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:29:50.432065 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:29:50.432066 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:29:50.432179 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:29:50.432315 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0810 15:29:50.432432 (+ 117us) server_negotiation.cc:299] Negotiation successful
0810 15:29:50.432497 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":11,"server-negotiator.queue_time_us":147}
I20260810 15:29:50.455032 23934 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 15:29:50.455600 23934 catalog_manager.cc:1504] Loading token signing keys...
I20260810 15:29:50.461818 23934 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5fe2eef5b88a49c0942be5a61f3207d6: Generated new TSK 0
I20260810 15:29:50.462087 23934 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 15:29:50.471553 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 23769
W20260810 15:29:50.487699 23735 connection.cc:535] client connection to 127.0.0.1:39327 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:39327): Connection reset by peer (error 104)
2026-08-10T15:29:50Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1753 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786375520124696-18706-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 15:29:50 dist-test-slave-2p8l krb5kdc[23962](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 15:29:50 dist-test-slave-2p8l krb5kdc[23962](info): set up 2 sockets
Aug 10 15:29:50 dist-test-slave-2p8l krb5kdc[23962](info): commencing operation
krb5kdc: starting...
W20260810 15:29:51.766490 18706 mini_kdc.cc:121] Time spent starting KDC: real 1.265s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786375520124696-18706-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786375520124696-18706-0/krb5kdc/test-user.keytab.
Aug 10 15:29:51 dist-test-slave-2p8l krb5kdc[23962](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375791, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T15:29:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T15:29:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786375520124696-18706-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786375520124696-18706-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 15:29:51.894919 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786375520124696-18706-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786375520124696-18706-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786375520124696-18706-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45261
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786375520124696-18706-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41905
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45261
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:29:51.978948 23986 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:29:51.979204 23986 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:29:51.979243 23986 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:29:51.980404 23986 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 15:29:51.980477 23986 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:29:51.980500 23986 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:29:51.980532 23986 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 15:29:51.980580 23986 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 15:29:51.982138 23986 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41905
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786375520124696-18706-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786375520124696-18706-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45261
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786375520124696-18706-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45261
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23986
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786375520124696-18706-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:29:51.982424 23986 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:29:51.982667 23986 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:29:51.987984 23999 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:29:51.987993 24000 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:29:51.987993 24003 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:29:51.988057 23986 server_base.cc:1034] running on GCE node
I20260810 15:29:51.988547 23986 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:29:51.988890 23986 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:29:51.990139 23986 hybrid_clock.cc:648] HybridClock initialized: now 1786375791990108 us; error 49 us; skew 500 ppm
Aug 10 15:29:51 dist-test-slave-2p8l krb5kdc[23962](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375791, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:29:51.992771 23986 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 15:29:51.993286 23986 webserver.cc:460] Webserver started at http://127.0.0.1:41853/ using document root <none> and password file <none>
I20260810 15:29:51.993568 23986 fs_manager.cc:359] Metadata directory not provided
I20260810 15:29:51.993649 23986 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:29:51.993800 23986 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:29:51.994941 23986 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786375520124696-18706-0/minicluster-data/master-0/data/instance:
uuid: "d07da054072240d38b701c0b20bbd121"
format_stamp: "Formatted at 2026-08-10 15:29:51 on dist-test-slave-2p8l"
server_key: "189f80f3561c519aafad876478323453"
server_key_iv: "4014021fd29c02582683ceffeaeb355d"
server_key_version: "encryptionkey@0"
I20260810 15:29:51.995307 23986 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786375520124696-18706-0/minicluster-data/master-0/wal/instance:
uuid: "d07da054072240d38b701c0b20bbd121"
format_stamp: "Formatted at 2026-08-10 15:29:51 on dist-test-slave-2p8l"
server_key: "189f80f3561c519aafad876478323453"
server_key_iv: "4014021fd29c02582683ceffeaeb355d"
server_key_version: "encryptionkey@0"
I20260810 15:29:51.996687 23986 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260810 15:29:51.997445 24014 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:29:51.997639 23986 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260810 15:29:51.997751 23986 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786375520124696-18706-0/minicluster-data/master-0/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786375520124696-18706-0/minicluster-data/master-0/wal
uuid: "d07da054072240d38b701c0b20bbd121"
format_stamp: "Formatted at 2026-08-10 15:29:51 on dist-test-slave-2p8l"
server_key: "189f80f3561c519aafad876478323453"
server_key_iv: "4014021fd29c02582683ceffeaeb355d"
server_key_version: "encryptionkey@0"
I20260810 15:29:51.997828 23986 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786375520124696-18706-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786375520124696-18706-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786375520124696-18706-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:29:52.010763 23986 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:29:52.013001 23986 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:29:52.013180 23986 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:29:52.018581 23986 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45261
I20260810 15:29:52.018673 24114 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45261 every 8 connection(s)
I20260810 15:29:52.019415 23986 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
I20260810 15:29:52.020339 24115 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:29:52.020800 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 23986
I20260810 15:29:52.020908 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786375520124696-18706-0/minicluster-data/master-0/wal/instance
I20260810 15:29:52.021126 18706 external_mini_cluster.cc:1428] Setting key 32b5aad97c367bb08587ad4e52181e79
I20260810 15:29:52.024477 24115 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d07da054072240d38b701c0b20bbd121: Bootstrap starting.
I20260810 15:29:52.025161 24115 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d07da054072240d38b701c0b20bbd121: Neither blocks nor log segments found. Creating new log.
I20260810 15:29:52.025424 24115 log.cc:824] T 00000000000000000000000000000000 P d07da054072240d38b701c0b20bbd121: Log is configured to *not* fsync() on all Append() calls
I20260810 15:29:52.026587 24115 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d07da054072240d38b701c0b20bbd121: No bootstrap required, opened a new log
I20260810 15:29:52.029341 24115 raft_consensus.cc:348] T 00000000000000000000000000000000 P d07da054072240d38b701c0b20bbd121 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d07da054072240d38b701c0b20bbd121" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45261 } }
I20260810 15:29:52.029526 24115 raft_consensus.cc:374] T 00000000000000000000000000000000 P d07da054072240d38b701c0b20bbd121 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:29:52.029568 24115 raft_consensus.cc:729] T 00000000000000000000000000000000 P d07da054072240d38b701c0b20bbd121 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d07da054072240d38b701c0b20bbd121, State: Initialized, Role: FOLLOWER
I20260810 15:29:52.029712 24115 consensus_queue.cc:260] T 00000000000000000000000000000000 P d07da054072240d38b701c0b20bbd121 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d07da054072240d38b701c0b20bbd121" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45261 } }
I20260810 15:29:52.029819 24115 raft_consensus.cc:388] T 00000000000000000000000000000000 P d07da054072240d38b701c0b20bbd121 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 15:29:52.029858 24115 raft_consensus.cc:482] T 00000000000000000000000000000000 P d07da054072240d38b701c0b20bbd121 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 15:29:52.029913 24115 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d07da054072240d38b701c0b20bbd121 [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:29:52.030702 24115 raft_consensus.cc:504] T 00000000000000000000000000000000 P d07da054072240d38b701c0b20bbd121 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d07da054072240d38b701c0b20bbd121" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45261 } }
I20260810 15:29:52.030819 24115 leader_election.cc:302] T 00000000000000000000000000000000 P d07da054072240d38b701c0b20bbd121 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d07da054072240d38b701c0b20bbd121; no voters:
I20260810 15:29:52.030987 24115 leader_election.cc:288] T 00000000000000000000000000000000 P d07da054072240d38b701c0b20bbd121 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 15:29:52.031126 24124 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d07da054072240d38b701c0b20bbd121 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 15:29:52.031247 24115 sys_catalog.cc:564] T 00000000000000000000000000000000 P d07da054072240d38b701c0b20bbd121 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 15:29:52.031359 24124 raft_consensus.cc:686] T 00000000000000000000000000000000 P d07da054072240d38b701c0b20bbd121 [term 1 LEADER]: Becoming Leader. State: Replica: d07da054072240d38b701c0b20bbd121, State: Running, Role: LEADER
I20260810 15:29:52.031472 24124 consensus_queue.cc:237] T 00000000000000000000000000000000 P d07da054072240d38b701c0b20bbd121 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d07da054072240d38b701c0b20bbd121" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45261 } }
I20260810 15:29:52.031781 24124 sys_catalog.cc:455] T 00000000000000000000000000000000 P d07da054072240d38b701c0b20bbd121 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d07da054072240d38b701c0b20bbd121. Latest consensus state: current_term: 1 leader_uuid: "d07da054072240d38b701c0b20bbd121" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d07da054072240d38b701c0b20bbd121" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45261 } } }
I20260810 15:29:52.031808 24127 sys_catalog.cc:455] T 00000000000000000000000000000000 P d07da054072240d38b701c0b20bbd121 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d07da054072240d38b701c0b20bbd121" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d07da054072240d38b701c0b20bbd121" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45261 } } }
I20260810 15:29:52.031873 24124 sys_catalog.cc:458] T 00000000000000000000000000000000 P d07da054072240d38b701c0b20bbd121 [sys.catalog]: This master's current role is: LEADER
I20260810 15:29:52.031877 24127 sys_catalog.cc:458] T 00000000000000000000000000000000 P d07da054072240d38b701c0b20bbd121 [sys.catalog]: This master's current role is: LEADER
I20260810 15:29:52.032840 24135 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 15:29:52.033172 24120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:52.025984 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.168:39037 (local address 127.0.0.1:45261)
0810 15:29:52.026169 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0810 15:29:52.026179 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 15:29:52.026216 (+ 37us) server_negotiation.cc:407] Connection header received
0810 15:29:52.026936 (+ 720us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:29:52.026948 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:29:52.027051 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:29:52.027238 (+ 187us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:29:52.027628 (+ 390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:52.029144 (+ 1516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:52.030277 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:52.030921 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:52.031051 (+ 130us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:52.032267 (+ 1216us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:29:52.032272 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:29:52.032272 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 15:29:52.032497 (+ 225us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:29:52.032542 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 15:29:52.032562 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:29:52.032658 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0810 15:29:52.032935 (+ 277us) server_negotiation.cc:299] Negotiation successful
0810 15:29:52.032966 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":94,"threads_started":1}
I20260810 15:29:52.033339 24135 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 15:29:52.034236 18706 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 15:29:52.036320 24135 catalog_manager.cc:1347] Generated new cluster ID: 01ce6ee01bfd4382984a01b08e98054c
I20260810 15:29:52.036374 24135 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 15:29:52.045399 24120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:52.035826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.168:40903 (local address 127.0.0.1:45261)
0810 15:29:52.035867 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0810 15:29:52.035869 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:29:52.035993 (+ 124us) server_negotiation.cc:407] Connection header received
0810 15:29:52.036058 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:29:52.036059 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:29:52.036069 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:29:52.036132 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:29:52.036288 (+ 156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:52.037028 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:52.043964 (+ 6936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:52.044309 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:52.044390 (+ 81us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:52.045132 (+ 742us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:29:52.045133 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:29:52.045134 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 15:29:52.045140 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:29:52.045157 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 15:29:52.045162 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:29:52.045227 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0810 15:29:52.045300 (+ 73us) server_negotiation.cc:299] Negotiation successful
0810 15:29:52.045312 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260810 15:29:52.056667 24135 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 15:29:52.057217 24135 catalog_manager.cc:1504] Loading token signing keys...
I20260810 15:29:52.065634 24135 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d07da054072240d38b701c0b20bbd121: Generated new TSK 0
I20260810 15:29:52.065864 24135 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 15:29:52.069075 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 23986
W20260810 15:29:52.083953 23960 connection.cc:535] client connection to 127.0.0.1:45261 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:45261): Connection reset by peer (error 104)
2026-08-10T15:29:52Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1596 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786375520124696-18706-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 15:29:52 dist-test-slave-2p8l krb5kdc[24169](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 15:29:52 dist-test-slave-2p8l krb5kdc[24169](info): set up 2 sockets
Aug 10 15:29:52 dist-test-slave-2p8l krb5kdc[24169](info): commencing operation
krb5kdc: starting...
W20260810 15:29:53.347635 18706 mini_kdc.cc:121] Time spent starting KDC: real 1.249s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786375520124696-18706-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786375520124696-18706-0/krb5kdc/test-user.keytab.
Aug 10 15:29:53 dist-test-slave-2p8l krb5kdc[24169](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375793, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T15:29:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T15:29:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786375520124696-18706-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786375520124696-18706-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 15:29:53.470008 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786375520124696-18706-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786375520124696-18706-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786375520124696-18706-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35997
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786375520124696-18706-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37451
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35997
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:29:53.554020 24194 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:29:53.554268 24194 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:29:53.554292 24194 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:29:53.555369 24194 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 15:29:53.555408 24194 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:29:53.555421 24194 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:29:53.555434 24194 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 15:29:53.555446 24194 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 15:29:53.556850 24194 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37451
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786375520124696-18706-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786375520124696-18706-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35997
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786375520124696-18706-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35997
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24194
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786375520124696-18706-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:29:53.557039 24194 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:29:53.557209 24194 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:29:53.562266 24207 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:29:53.562379 24194 server_base.cc:1034] running on GCE node
W20260810 15:29:53.562266 24203 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:29:53.562306 24205 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:29:53.562788 24194 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:29:53.563125 24194 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:29:53.564291 24194 hybrid_clock.cc:648] HybridClock initialized: now 1786375793564277 us; error 29 us; skew 500 ppm
Aug 10 15:29:53 dist-test-slave-2p8l krb5kdc[24169](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375793, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:29:53.567013 24194 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 15:29:53.567582 24194 webserver.cc:460] Webserver started at http://127.0.0.1:34449/ using document root <none> and password file <none>
I20260810 15:29:53.567831 24194 fs_manager.cc:359] Metadata directory not provided
I20260810 15:29:53.567902 24194 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:29:53.568061 24194 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:29:53.569171 24194 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786375520124696-18706-0/minicluster-data/master-0/data/instance:
uuid: "6e071d2c1a804a028e3697abd290d60b"
format_stamp: "Formatted at 2026-08-10 15:29:53 on dist-test-slave-2p8l"
server_key: "081dbe12c97bb83a4234c96d6c9c64a3"
server_key_iv: "4ef27dbc2ddb5800e0d9f0eb831f93f1"
server_key_version: "encryptionkey@0"
I20260810 15:29:53.569576 24194 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786375520124696-18706-0/minicluster-data/master-0/wal/instance:
uuid: "6e071d2c1a804a028e3697abd290d60b"
format_stamp: "Formatted at 2026-08-10 15:29:53 on dist-test-slave-2p8l"
server_key: "081dbe12c97bb83a4234c96d6c9c64a3"
server_key_iv: "4ef27dbc2ddb5800e0d9f0eb831f93f1"
server_key_version: "encryptionkey@0"
I20260810 15:29:53.571071 24194 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 15:29:53.571866 24218 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:29:53.572078 24194 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:29:53.572198 24194 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786375520124696-18706-0/minicluster-data/master-0/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786375520124696-18706-0/minicluster-data/master-0/wal
uuid: "6e071d2c1a804a028e3697abd290d60b"
format_stamp: "Formatted at 2026-08-10 15:29:53 on dist-test-slave-2p8l"
server_key: "081dbe12c97bb83a4234c96d6c9c64a3"
server_key_iv: "4ef27dbc2ddb5800e0d9f0eb831f93f1"
server_key_version: "encryptionkey@0"
I20260810 15:29:53.572286 24194 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786375520124696-18706-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786375520124696-18706-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786375520124696-18706-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:29:53.575819 24194 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:29:53.577693 24194 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:29:53.577857 24194 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:29:53.581969 24194 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35997
I20260810 15:29:53.582012 24306 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35997 every 8 connection(s)
I20260810 15:29:53.582396 24194 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
I20260810 15:29:53.583395 24308 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:29:53.584789 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 24194
I20260810 15:29:53.584906 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786375520124696-18706-0/minicluster-data/master-0/wal/instance
I20260810 15:29:53.585100 18706 external_mini_cluster.cc:1428] Setting key 22379438e3519210681ee34746b64e89
I20260810 15:29:53.586277 24308 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6e071d2c1a804a028e3697abd290d60b: Bootstrap starting.
I20260810 15:29:53.587060 24308 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6e071d2c1a804a028e3697abd290d60b: Neither blocks nor log segments found. Creating new log.
I20260810 15:29:53.587399 24308 log.cc:824] T 00000000000000000000000000000000 P 6e071d2c1a804a028e3697abd290d60b: Log is configured to *not* fsync() on all Append() calls
I20260810 15:29:53.587679 24316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:53.585612 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.168:51077 (local address 127.0.0.1:35997)
0810 15:29:53.585808 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0810 15:29:53.585821 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0810 15:29:53.585845 (+ 24us) server_negotiation.cc:407] Connection header received
0810 15:29:53.586318 (+ 473us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:29:53.586325 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:29:53.586350 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:29:53.586501 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:29:53.587236 (+ 735us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:29:53.587239 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:29:53.587239 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 15:29:53.587243 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:29:53.587280 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 15:29:53.587289 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:29:53.587363 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0810 15:29:53.587440 (+ 77us) server_negotiation.cc:299] Negotiation successful
0810 15:29:53.587495 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":96,"threads_started":1}
I20260810 15:29:53.588151 24308 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6e071d2c1a804a028e3697abd290d60b: No bootstrap required, opened a new log
I20260810 15:29:53.588686 18706 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 15:29:53.590363 24308 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6e071d2c1a804a028e3697abd290d60b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e071d2c1a804a028e3697abd290d60b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35997 } }
I20260810 15:29:53.590552 24308 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6e071d2c1a804a028e3697abd290d60b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:29:53.590598 24308 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6e071d2c1a804a028e3697abd290d60b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e071d2c1a804a028e3697abd290d60b, State: Initialized, Role: FOLLOWER
I20260810 15:29:53.591110 24308 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6e071d2c1a804a028e3697abd290d60b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e071d2c1a804a028e3697abd290d60b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35997 } }
I20260810 15:29:53.591228 24308 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6e071d2c1a804a028e3697abd290d60b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 15:29:53.591310 24308 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6e071d2c1a804a028e3697abd290d60b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 15:29:53.591327 24316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:53.590133 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.168:39813 (local address 127.0.0.1:35997)
0810 15:29:53.590175 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0810 15:29:53.590177 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:29:53.590307 (+ 130us) server_negotiation.cc:407] Connection header received
0810 15:29:53.590378 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:29:53.590379 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:29:53.590383 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:29:53.590429 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:29:53.591075 (+ 646us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:29:53.591076 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:29:53.591077 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 15:29:53.591082 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:29:53.591098 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 15:29:53.591102 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:29:53.591173 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0810 15:29:53.591246 (+ 73us) server_negotiation.cc:299] Negotiation successful
0810 15:29:53.591260 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260810 15:29:53.591387 24308 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6e071d2c1a804a028e3697abd290d60b [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:29:53.592080 24308 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6e071d2c1a804a028e3697abd290d60b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e071d2c1a804a028e3697abd290d60b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35997 } }
I20260810 15:29:53.592173 24308 leader_election.cc:302] T 00000000000000000000000000000000 P 6e071d2c1a804a028e3697abd290d60b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6e071d2c1a804a028e3697abd290d60b; no voters:
I20260810 15:29:53.592358 24308 leader_election.cc:288] T 00000000000000000000000000000000 P 6e071d2c1a804a028e3697abd290d60b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 15:29:53.592438 24327 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6e071d2c1a804a028e3697abd290d60b [term 1 FOLLOWER]: Leader election won for term 1
I20260810 15:29:53.592605 24308 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6e071d2c1a804a028e3697abd290d60b [sys.catalog]: configured and running, proceeding with master startup.
I20260810 15:29:53.592592 24327 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6e071d2c1a804a028e3697abd290d60b [term 1 LEADER]: Becoming Leader. State: Replica: 6e071d2c1a804a028e3697abd290d60b, State: Running, Role: LEADER
I20260810 15:29:53.592734 24327 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6e071d2c1a804a028e3697abd290d60b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e071d2c1a804a028e3697abd290d60b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35997 } }
I20260810 15:29:53.593132 24329 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6e071d2c1a804a028e3697abd290d60b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6e071d2c1a804a028e3697abd290d60b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e071d2c1a804a028e3697abd290d60b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35997 } } }
I20260810 15:29:53.593160 24331 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6e071d2c1a804a028e3697abd290d60b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6e071d2c1a804a028e3697abd290d60b. Latest consensus state: current_term: 1 leader_uuid: "6e071d2c1a804a028e3697abd290d60b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e071d2c1a804a028e3697abd290d60b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35997 } } }
I20260810 15:29:53.593323 24331 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6e071d2c1a804a028e3697abd290d60b [sys.catalog]: This master's current role is: LEADER
I20260810 15:29:53.593537 24341 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 15:29:53.593699 24329 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6e071d2c1a804a028e3697abd290d60b [sys.catalog]: This master's current role is: LEADER
I20260810 15:29:53.594081 24341 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 15:29:53.595585 24341 catalog_manager.cc:1347] Generated new cluster ID: 1d1d06a900c04bcd92c77dd71cf174b9
I20260810 15:29:53.595654 24341 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 15:29:53.605782 24341 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 15:29:53.605960 24341 catalog_manager.cc:1504] Loading token signing keys...
I20260810 15:29:53.612479 24341 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6e071d2c1a804a028e3697abd290d60b: Generated new TSK 0
I20260810 15:29:53.612704 24341 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 15:29:53.617915 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 24194
2026-08-10T15:29:53Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1546 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786375520124696-18706-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 15:29:53 dist-test-slave-2p8l krb5kdc[24361](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 15:29:53 dist-test-slave-2p8l krb5kdc[24361](info): set up 2 sockets
Aug 10 15:29:53 dist-test-slave-2p8l krb5kdc[24361](info): commencing operation
krb5kdc: starting...
W20260810 15:29:54.933039 18706 mini_kdc.cc:121] Time spent starting KDC: real 1.289s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786375520124696-18706-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786375520124696-18706-0/krb5kdc/test-user.keytab.
Aug 10 15:29:55 dist-test-slave-2p8l krb5kdc[24361](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375795, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T15:29:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T15:29:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.68.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.68.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.68.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab.
Entry for principal kudu/127.18.68.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab.
I20260810 15:29:55.064730 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786375520124696-18706-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786375520124696-18706-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786375520124696-18706-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.190:33369
--webserver_interface=127.18.68.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab
--principal=kudu/127.18.68.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:39111
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.68.190:33369
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:29:55.148319 24383 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:29:55.148526 24383 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:29:55.148550 24383 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:29:55.149694 24383 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 15:29:55.149737 24383 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:29:55.149751 24383 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:29:55.149765 24383 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 15:29:55.149820 24383 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 15:29:55.151364 24383 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:39111
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786375520124696-18706-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786375520124696-18706-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.68.190:33369
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab
--principal=kudu/127.18.68.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.190:33369
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.68.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24383
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786375520124696-18706-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:29:55.151623 24383 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:29:55.151856 24383 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 15:29:55.156955 24383 server_base.cc:1034] running on GCE node
W20260810 15:29:55.156955 24388 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:29:55.157080 24393 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:29:55.156991 24390 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:29:55.157485 24383 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:29:55.157790 24383 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:29:55.158978 24383 hybrid_clock.cc:648] HybridClock initialized: now 1786375795158939 us; error 74 us; skew 500 ppm
Aug 10 15:29:55 dist-test-slave-2p8l krb5kdc[24361](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375795, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:29:55.161900 24383 init.cc:377] Logged in from keytab as kudu/127.18.68.190@KRBTEST.COM (short username kudu)
I20260810 15:29:55.162454 24383 webserver.cc:460] Webserver started at http://127.18.68.190:45813/ using document root <none> and password file <none>
I20260810 15:29:55.162698 24383 fs_manager.cc:359] Metadata directory not provided
I20260810 15:29:55.162771 24383 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:29:55.162931 24383 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:29:55.164000 24383 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786375520124696-18706-0/minicluster-data/master-0/data/instance:
uuid: "fb51251784ab4d95873f2cbb575f1e04"
format_stamp: "Formatted at 2026-08-10 15:29:55 on dist-test-slave-2p8l"
server_key: "d05d645bda757ae4973107d6f10e6c23"
server_key_iv: "dedf264c7bf02fb5e61f4cdc4d391aa8"
server_key_version: "encryptionkey@0"
I20260810 15:29:55.164395 24383 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786375520124696-18706-0/minicluster-data/master-0/wal/instance:
uuid: "fb51251784ab4d95873f2cbb575f1e04"
format_stamp: "Formatted at 2026-08-10 15:29:55 on dist-test-slave-2p8l"
server_key: "d05d645bda757ae4973107d6f10e6c23"
server_key_iv: "dedf264c7bf02fb5e61f4cdc4d391aa8"
server_key_version: "encryptionkey@0"
I20260810 15:29:55.165815 24383 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 15:29:55.166689 24403 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:29:55.166882 24383 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260810 15:29:55.166996 24383 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786375520124696-18706-0/minicluster-data/master-0/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786375520124696-18706-0/minicluster-data/master-0/wal
uuid: "fb51251784ab4d95873f2cbb575f1e04"
format_stamp: "Formatted at 2026-08-10 15:29:55 on dist-test-slave-2p8l"
server_key: "d05d645bda757ae4973107d6f10e6c23"
server_key_iv: "dedf264c7bf02fb5e61f4cdc4d391aa8"
server_key_version: "encryptionkey@0"
I20260810 15:29:55.167081 24383 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786375520124696-18706-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786375520124696-18706-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786375520124696-18706-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:29:55.187884 24383 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:29:55.190335 24383 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:29:55.190538 24383 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:29:55.195211 24383 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.190:33369
I20260810 15:29:55.195258 24492 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.190:33369 every 8 connection(s)
I20260810 15:29:55.195655 24383 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
I20260810 15:29:55.196563 24494 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:29:55.198861 24494 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fb51251784ab4d95873f2cbb575f1e04: Bootstrap starting.
I20260810 15:29:55.199410 24494 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fb51251784ab4d95873f2cbb575f1e04: Neither blocks nor log segments found. Creating new log.
I20260810 15:29:55.199647 24494 log.cc:824] T 00000000000000000000000000000000 P fb51251784ab4d95873f2cbb575f1e04: Log is configured to *not* fsync() on all Append() calls
I20260810 15:29:55.200361 24494 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fb51251784ab4d95873f2cbb575f1e04: No bootstrap required, opened a new log
I20260810 15:29:55.200794 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 24383
I20260810 15:29:55.200896 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786375520124696-18706-0/minicluster-data/master-0/wal/instance
I20260810 15:29:55.201071 18706 external_mini_cluster.cc:1428] Setting key fa774e71f05f50cebd1b2dfcdb244609
I20260810 15:29:55.202672 24494 raft_consensus.cc:348] T 00000000000000000000000000000000 P fb51251784ab4d95873f2cbb575f1e04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb51251784ab4d95873f2cbb575f1e04" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 33369 } }
I20260810 15:29:55.202853 24494 raft_consensus.cc:374] T 00000000000000000000000000000000 P fb51251784ab4d95873f2cbb575f1e04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:29:55.202950 24494 raft_consensus.cc:729] T 00000000000000000000000000000000 P fb51251784ab4d95873f2cbb575f1e04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb51251784ab4d95873f2cbb575f1e04, State: Initialized, Role: FOLLOWER
I20260810 15:29:55.203122 24494 consensus_queue.cc:260] T 00000000000000000000000000000000 P fb51251784ab4d95873f2cbb575f1e04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb51251784ab4d95873f2cbb575f1e04" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 33369 } }
I20260810 15:29:55.203204 24494 raft_consensus.cc:388] T 00000000000000000000000000000000 P fb51251784ab4d95873f2cbb575f1e04 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 15:29:55.203227 24494 raft_consensus.cc:482] T 00000000000000000000000000000000 P fb51251784ab4d95873f2cbb575f1e04 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 15:29:55.203294 24494 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fb51251784ab4d95873f2cbb575f1e04 [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:29:55.204408 24494 raft_consensus.cc:504] T 00000000000000000000000000000000 P fb51251784ab4d95873f2cbb575f1e04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb51251784ab4d95873f2cbb575f1e04" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 33369 } }
I20260810 15:29:55.204535 24494 leader_election.cc:302] T 00000000000000000000000000000000 P fb51251784ab4d95873f2cbb575f1e04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fb51251784ab4d95873f2cbb575f1e04; no voters:
I20260810 15:29:55.204697 24494 leader_election.cc:288] T 00000000000000000000000000000000 P fb51251784ab4d95873f2cbb575f1e04 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 15:29:55.204756 24501 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fb51251784ab4d95873f2cbb575f1e04 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 15:29:55.204931 24494 sys_catalog.cc:564] T 00000000000000000000000000000000 P fb51251784ab4d95873f2cbb575f1e04 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 15:29:55.204933 24501 raft_consensus.cc:686] T 00000000000000000000000000000000 P fb51251784ab4d95873f2cbb575f1e04 [term 1 LEADER]: Becoming Leader. State: Replica: fb51251784ab4d95873f2cbb575f1e04, State: Running, Role: LEADER
I20260810 15:29:55.205127 24501 consensus_queue.cc:237] T 00000000000000000000000000000000 P fb51251784ab4d95873f2cbb575f1e04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb51251784ab4d95873f2cbb575f1e04" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 33369 } }
I20260810 15:29:55.206758 24502 sys_catalog.cc:455] T 00000000000000000000000000000000 P fb51251784ab4d95873f2cbb575f1e04 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fb51251784ab4d95873f2cbb575f1e04" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb51251784ab4d95873f2cbb575f1e04" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 33369 } } }
I20260810 15:29:55.206923 24502 sys_catalog.cc:458] T 00000000000000000000000000000000 P fb51251784ab4d95873f2cbb575f1e04 [sys.catalog]: This master's current role is: LEADER
W20260810 15:29:55.206974 24529 catalog_manager.cc:1558] T 00000000000000000000000000000000 P fb51251784ab4d95873f2cbb575f1e04: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 15:29:55.207093 24529 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 15:29:55.207245 24532 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 15:29:55.207441 24503 sys_catalog.cc:455] T 00000000000000000000000000000000 P fb51251784ab4d95873f2cbb575f1e04 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fb51251784ab4d95873f2cbb575f1e04. Latest consensus state: current_term: 1 leader_uuid: "fb51251784ab4d95873f2cbb575f1e04" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb51251784ab4d95873f2cbb575f1e04" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 33369 } } }
I20260810 15:29:55.207515 24503 sys_catalog.cc:458] T 00000000000000000000000000000000 P fb51251784ab4d95873f2cbb575f1e04 [sys.catalog]: This master's current role is: LEADER
I20260810 15:29:55.207790 24532 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 15:29:55.209231 24532 catalog_manager.cc:1347] Generated new cluster ID: 12dcd995fda442918e7a45cb9d6edc4a
I20260810 15:29:55.209287 24532 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 10 15:29:55 dist-test-slave-2p8l krb5kdc[24361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375795, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
I20260810 15:29:55.213698 24500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:55.201586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36559 (local address 127.18.68.190:33369)
0810 15:29:55.201762 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0810 15:29:55.201773 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 15:29:55.201810 (+ 37us) server_negotiation.cc:407] Connection header received
0810 15:29:55.202633 (+ 823us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:29:55.202642 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:29:55.202708 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:29:55.202856 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:29:55.203681 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:55.205161 (+ 1480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:55.206250 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:55.206851 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:55.206953 (+ 102us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:55.209954 (+ 3001us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:29:55.209957 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:29:55.209958 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:29:55.209969 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:29:55.211898 (+ 1929us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:29:55.212359 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:29:55.212362 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:29:55.212363 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:29:55.212487 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:29:55.212746 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:29:55.212747 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:29:55.212747 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:29:55.213036 (+ 289us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:29:55.213204 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0810 15:29:55.213407 (+ 203us) server_negotiation.cc:299] Negotiation successful
0810 15:29:55.213507 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":93,"threads_started":1}
I20260810 15:29:55.214713 18706 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 15:29:55.223335 24500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:55.216182 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43381 (local address 127.18.68.190:33369)
0810 15:29:55.216218 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0810 15:29:55.216220 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:29:55.216268 (+ 48us) server_negotiation.cc:407] Connection header received
0810 15:29:55.216326 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:29:55.216327 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:29:55.216345 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:29:55.216407 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:29:55.216963 (+ 556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:55.217746 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:55.218743 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:55.219079 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:55.219155 (+ 76us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:55.220432 (+ 1277us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:29:55.220433 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:29:55.220434 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:29:55.220440 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:29:55.222034 (+ 1594us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:29:55.222491 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:29:55.222492 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:29:55.222492 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:29:55.222556 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:29:55.222798 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:29:55.222799 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:29:55.222799 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:29:55.222926 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:29:55.223027 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0810 15:29:55.223188 (+ 161us) server_negotiation.cc:299] Negotiation successful
0810 15:29:55.223252 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260810 15:29:55.224270 24532 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 15:29:55.224961 24532 catalog_manager.cc:1504] Loading token signing keys...
I20260810 15:29:55.233206 24532 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fb51251784ab4d95873f2cbb575f1e04: Generated new TSK 0
I20260810 15:29:55.233404 24532 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 15:29:55.237130 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 24383
W20260810 15:29:55.255244 24359 connection.cc:535] client connection to 127.18.68.190:33369 recv error: Network error: failed to read from TLS socket (remote: 127.18.68.190:33369): Connection reset by peer (error 104)
2026-08-10T15:29:55Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1624 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786375520124696-18706-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 15:29:55 dist-test-slave-2p8l krb5kdc[24548](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 15:29:55 dist-test-slave-2p8l krb5kdc[24548](info): set up 2 sockets
Aug 10 15:29:55 dist-test-slave-2p8l krb5kdc[24548](info): commencing operation
krb5kdc: starting...
W20260810 15:29:56.538707 18706 mini_kdc.cc:121] Time spent starting KDC: real 1.270s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786375520124696-18706-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786375520124696-18706-0/krb5kdc/test-user.keytab.
Aug 10 15:29:56 dist-test-slave-2p8l krb5kdc[24548](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375796, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T15:29:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T15:29:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.68.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.68.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.68.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab.
Entry for principal kudu/127.18.68.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab.
I20260810 15:29:56.673857 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786375520124696-18706-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786375520124696-18706-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786375520124696-18706-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.190:34005
--webserver_interface=127.18.68.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab
--principal=kudu/127.18.68.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:43957
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.68.190:34005
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:29:56.757813 24568 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:29:56.758069 24568 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:29:56.758136 24568 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:29:56.759727 24568 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 15:29:56.759795 24568 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:29:56.759819 24568 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:29:56.759869 24568 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 15:29:56.759899 24568 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 15:29:56.761993 24568 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:43957
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786375520124696-18706-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786375520124696-18706-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.68.190:34005
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab
--principal=kudu/127.18.68.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.190:34005
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.68.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24568
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786375520124696-18706-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:29:56.762312 24568 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:29:56.762563 24568 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:29:56.768092 24576 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:29:56.768070 24573 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:29:56.768070 24574 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:29:56.768450 24568 server_base.cc:1034] running on GCE node
I20260810 15:29:56.768713 24568 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:29:56.769022 24568 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:29:56.770167 24568 hybrid_clock.cc:648] HybridClock initialized: now 1786375796770152 us; error 34 us; skew 500 ppm
Aug 10 15:29:56 dist-test-slave-2p8l krb5kdc[24548](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375796, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:29:56.772821 24568 init.cc:377] Logged in from keytab as kudu/127.18.68.190@KRBTEST.COM (short username kudu)
I20260810 15:29:56.773317 24568 webserver.cc:460] Webserver started at http://127.18.68.190:39455/ using document root <none> and password file <none>
I20260810 15:29:56.773579 24568 fs_manager.cc:359] Metadata directory not provided
I20260810 15:29:56.773624 24568 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:29:56.773779 24568 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:29:56.774940 24568 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786375520124696-18706-0/minicluster-data/master-0/data/instance:
uuid: "974adfb1bd4f4ab1a7e39edb4a334728"
format_stamp: "Formatted at 2026-08-10 15:29:56 on dist-test-slave-2p8l"
server_key: "77b12ba25c0ed78198415c57d06c1fb2"
server_key_iv: "5b385eac9268ffd3bbe34d480c1424fb"
server_key_version: "encryptionkey@0"
I20260810 15:29:56.775312 24568 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786375520124696-18706-0/minicluster-data/master-0/wal/instance:
uuid: "974adfb1bd4f4ab1a7e39edb4a334728"
format_stamp: "Formatted at 2026-08-10 15:29:56 on dist-test-slave-2p8l"
server_key: "77b12ba25c0ed78198415c57d06c1fb2"
server_key_iv: "5b385eac9268ffd3bbe34d480c1424fb"
server_key_version: "encryptionkey@0"
I20260810 15:29:56.776741 24568 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260810 15:29:56.777593 24585 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:29:56.777849 24568 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 15:29:56.777953 24568 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786375520124696-18706-0/minicluster-data/master-0/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786375520124696-18706-0/minicluster-data/master-0/wal
uuid: "974adfb1bd4f4ab1a7e39edb4a334728"
format_stamp: "Formatted at 2026-08-10 15:29:56 on dist-test-slave-2p8l"
server_key: "77b12ba25c0ed78198415c57d06c1fb2"
server_key_iv: "5b385eac9268ffd3bbe34d480c1424fb"
server_key_version: "encryptionkey@0"
I20260810 15:29:56.778034 24568 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786375520124696-18706-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786375520124696-18706-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786375520124696-18706-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:29:56.793288 24568 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:29:56.795692 24568 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:29:56.795859 24568 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:29:56.800607 24568 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.190:34005
I20260810 15:29:56.800724 24677 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.190:34005 every 8 connection(s)
I20260810 15:29:56.801100 24568 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
I20260810 15:29:56.802098 24678 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:29:56.804495 24678 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 974adfb1bd4f4ab1a7e39edb4a334728: Bootstrap starting.
I20260810 15:29:56.805141 24678 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 974adfb1bd4f4ab1a7e39edb4a334728: Neither blocks nor log segments found. Creating new log.
I20260810 15:29:56.805444 24678 log.cc:824] T 00000000000000000000000000000000 P 974adfb1bd4f4ab1a7e39edb4a334728: Log is configured to *not* fsync() on all Append() calls
I20260810 15:29:56.806365 24678 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 974adfb1bd4f4ab1a7e39edb4a334728: No bootstrap required, opened a new log
I20260810 15:29:56.808032 24678 raft_consensus.cc:348] T 00000000000000000000000000000000 P 974adfb1bd4f4ab1a7e39edb4a334728 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "974adfb1bd4f4ab1a7e39edb4a334728" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 34005 } }
I20260810 15:29:56.808210 24678 raft_consensus.cc:374] T 00000000000000000000000000000000 P 974adfb1bd4f4ab1a7e39edb4a334728 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:29:56.808260 24678 raft_consensus.cc:729] T 00000000000000000000000000000000 P 974adfb1bd4f4ab1a7e39edb4a334728 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974adfb1bd4f4ab1a7e39edb4a334728, State: Initialized, Role: FOLLOWER
I20260810 15:29:56.808437 24678 consensus_queue.cc:260] T 00000000000000000000000000000000 P 974adfb1bd4f4ab1a7e39edb4a334728 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "974adfb1bd4f4ab1a7e39edb4a334728" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 34005 } }
I20260810 15:29:56.808529 24678 raft_consensus.cc:388] T 00000000000000000000000000000000 P 974adfb1bd4f4ab1a7e39edb4a334728 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 15:29:56.808570 24678 raft_consensus.cc:482] T 00000000000000000000000000000000 P 974adfb1bd4f4ab1a7e39edb4a334728 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 15:29:56.808631 24678 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 974adfb1bd4f4ab1a7e39edb4a334728 [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:29:56.809532 24678 raft_consensus.cc:504] T 00000000000000000000000000000000 P 974adfb1bd4f4ab1a7e39edb4a334728 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "974adfb1bd4f4ab1a7e39edb4a334728" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 34005 } }
I20260810 15:29:56.809670 24678 leader_election.cc:302] T 00000000000000000000000000000000 P 974adfb1bd4f4ab1a7e39edb4a334728 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 974adfb1bd4f4ab1a7e39edb4a334728; no voters:
I20260810 15:29:56.809885 24678 leader_election.cc:288] T 00000000000000000000000000000000 P 974adfb1bd4f4ab1a7e39edb4a334728 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 15:29:56.809940 24682 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 974adfb1bd4f4ab1a7e39edb4a334728 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 15:29:56.810189 24678 sys_catalog.cc:564] T 00000000000000000000000000000000 P 974adfb1bd4f4ab1a7e39edb4a334728 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 15:29:56.810206 24682 raft_consensus.cc:686] T 00000000000000000000000000000000 P 974adfb1bd4f4ab1a7e39edb4a334728 [term 1 LEADER]: Becoming Leader. State: Replica: 974adfb1bd4f4ab1a7e39edb4a334728, State: Running, Role: LEADER
I20260810 15:29:56.810423 24682 consensus_queue.cc:237] T 00000000000000000000000000000000 P 974adfb1bd4f4ab1a7e39edb4a334728 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "974adfb1bd4f4ab1a7e39edb4a334728" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 34005 } }
I20260810 15:29:56.810636 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 24568
I20260810 15:29:56.810801 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786375520124696-18706-0/minicluster-data/master-0/wal/instance
I20260810 15:29:56.811007 18706 external_mini_cluster.cc:1428] Setting key 5d9b01887624fdabb26b767dfa463598
I20260810 15:29:56.811496 24683 sys_catalog.cc:455] T 00000000000000000000000000000000 P 974adfb1bd4f4ab1a7e39edb4a334728 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "974adfb1bd4f4ab1a7e39edb4a334728" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "974adfb1bd4f4ab1a7e39edb4a334728" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 34005 } } }
I20260810 15:29:56.811604 24683 sys_catalog.cc:458] T 00000000000000000000000000000000 P 974adfb1bd4f4ab1a7e39edb4a334728 [sys.catalog]: This master's current role is: LEADER
I20260810 15:29:56.811805 24709 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 15:29:56.811939 24684 sys_catalog.cc:455] T 00000000000000000000000000000000 P 974adfb1bd4f4ab1a7e39edb4a334728 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 974adfb1bd4f4ab1a7e39edb4a334728. Latest consensus state: current_term: 1 leader_uuid: "974adfb1bd4f4ab1a7e39edb4a334728" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "974adfb1bd4f4ab1a7e39edb4a334728" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 34005 } } }
I20260810 15:29:56.812103 24684 sys_catalog.cc:458] T 00000000000000000000000000000000 P 974adfb1bd4f4ab1a7e39edb4a334728 [sys.catalog]: This master's current role is: LEADER
I20260810 15:29:56.812575 24709 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 15:29:56.814160 24709 catalog_manager.cc:1347] Generated new cluster ID: f60db3281f2347928a9eaf5e3611d3a7
I20260810 15:29:56.814208 24709 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 15:29:56.816553 24704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:56.811533 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48969 (local address 127.18.68.190:34005)
0810 15:29:56.811940 (+ 407us) server_negotiation.cc:206] Beginning negotiation
0810 15:29:56.811950 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 15:29:56.811986 (+ 36us) server_negotiation.cc:407] Connection header received
0810 15:29:56.812111 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:29:56.812118 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:29:56.812200 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:29:56.812356 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:29:56.812608 (+ 252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:56.813583 (+ 975us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:56.814517 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:56.814945 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:56.815085 (+ 140us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:56.815871 (+ 786us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:29:56.815874 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:29:56.815875 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 15:29:56.816067 (+ 192us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:29:56.816099 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 15:29:56.816110 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:29:56.816223 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0810 15:29:56.816303 (+ 80us) server_negotiation.cc:299] Negotiation successful
0810 15:29:56.816333 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":347,"thread_start_us":66,"threads_started":1}
I20260810 15:29:56.817540 18706 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 15:29:56.822225 24704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:56.819107 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39673 (local address 127.18.68.190:34005)
0810 15:29:56.819145 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0810 15:29:56.819147 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:29:56.819170 (+ 23us) server_negotiation.cc:407] Connection header received
0810 15:29:56.819244 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:29:56.819245 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:29:56.819255 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:29:56.819303 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:29:56.819414 (+ 111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:56.820170 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:56.820892 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:29:56.821126 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:29:56.821219 (+ 93us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:29:56.821933 (+ 714us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:29:56.821934 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:29:56.821934 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 15:29:56.821939 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:29:56.821953 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 15:29:56.821958 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:29:56.822012 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0810 15:29:56.822116 (+ 104us) server_negotiation.cc:299] Negotiation successful
0810 15:29:56.822129 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260810 15:29:56.833997 24709 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 15:29:56.834556 24709 catalog_manager.cc:1504] Loading token signing keys...
I20260810 15:29:56.841006 24709 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 974adfb1bd4f4ab1a7e39edb4a334728: Generated new TSK 0
I20260810 15:29:56.841229 24709 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 15:29:56.846923 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 24568
W20260810 15:29:56.866506 24543 connection.cc:535] client connection to 127.18.68.190:34005 recv error: Network error: failed to read from TLS socket (remote: 127.18.68.190:34005): Connection reset by peer (error 104)
2026-08-10T15:29:56Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1611 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786375520124696-18706-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 15:29:56 dist-test-slave-2p8l krb5kdc[24737](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 15:29:56 dist-test-slave-2p8l krb5kdc[24737](info): set up 2 sockets
Aug 10 15:29:56 dist-test-slave-2p8l krb5kdc[24737](info): commencing operation
krb5kdc: starting...
W20260810 15:29:58.151109 18706 mini_kdc.cc:121] Time spent starting KDC: real 1.270s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786375520124696-18706-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786375520124696-18706-0/krb5kdc/test-user.keytab.
Aug 10 15:29:58 dist-test-slave-2p8l krb5kdc[24737](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375798, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T15:29:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T15:29:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.68.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.68.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.68.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab.
Entry for principal kudu/127.18.68.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab.
I20260810 15:29:58.281517 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786375520124696-18706-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786375520124696-18706-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786375520124696-18706-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.190:39435
--webserver_interface=127.18.68.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab
--principal=kudu/127.18.68.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:40509
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.68.190:39435
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:29:58.365463 24771 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:29:58.365679 24771 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:29:58.365701 24771 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:29:58.366797 24771 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 15:29:58.366832 24771 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:29:58.366845 24771 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:29:58.366858 24771 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 15:29:58.366870 24771 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 15:29:58.368304 24771 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:40509
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786375520124696-18706-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786375520124696-18706-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.68.190:39435
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab
--principal=kudu/127.18.68.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.190:39435
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.68.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24771
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786375520124696-18706-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:29:58.368500 24771 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:29:58.368671 24771 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:29:58.373813 24777 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:29:58.373874 24785 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:29:58.373838 24779 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:29:58.374161 24771 server_base.cc:1034] running on GCE node
I20260810 15:29:58.374408 24771 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:29:58.374682 24771 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:29:58.375851 24771 hybrid_clock.cc:648] HybridClock initialized: now 1786375798375836 us; error 28 us; skew 500 ppm
Aug 10 15:29:58 dist-test-slave-2p8l krb5kdc[24737](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375798, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:29:58.378847 24771 init.cc:377] Logged in from keytab as kudu/127.18.68.190@KRBTEST.COM (short username kudu)
I20260810 15:29:58.379320 24771 webserver.cc:460] Webserver started at http://127.18.68.190:37607/ using document root <none> and password file <none>
I20260810 15:29:58.379592 24771 fs_manager.cc:359] Metadata directory not provided
I20260810 15:29:58.379642 24771 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:29:58.379737 24771 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:29:58.380807 24771 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786375520124696-18706-0/minicluster-data/master-0/data/instance:
uuid: "f8d78b311bb84abaa4a9de58fff5699c"
format_stamp: "Formatted at 2026-08-10 15:29:58 on dist-test-slave-2p8l"
server_key: "7115aed644ddc7c59f52c8e5bd94905d"
server_key_iv: "df2e8fcd2137406371bb441d03fb433c"
server_key_version: "encryptionkey@0"
I20260810 15:29:58.381193 24771 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786375520124696-18706-0/minicluster-data/master-0/wal/instance:
uuid: "f8d78b311bb84abaa4a9de58fff5699c"
format_stamp: "Formatted at 2026-08-10 15:29:58 on dist-test-slave-2p8l"
server_key: "7115aed644ddc7c59f52c8e5bd94905d"
server_key_iv: "df2e8fcd2137406371bb441d03fb433c"
server_key_version: "encryptionkey@0"
I20260810 15:29:58.382699 24771 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 15:29:58.383571 24795 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:29:58.383903 24771 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 15:29:58.384109 24771 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786375520124696-18706-0/minicluster-data/master-0/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786375520124696-18706-0/minicluster-data/master-0/wal
uuid: "f8d78b311bb84abaa4a9de58fff5699c"
format_stamp: "Formatted at 2026-08-10 15:29:58 on dist-test-slave-2p8l"
server_key: "7115aed644ddc7c59f52c8e5bd94905d"
server_key_iv: "df2e8fcd2137406371bb441d03fb433c"
server_key_version: "encryptionkey@0"
I20260810 15:29:58.384265 24771 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786375520124696-18706-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786375520124696-18706-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786375520124696-18706-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:29:58.387661 24771 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:29:58.389952 24771 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:29:58.390168 24771 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:29:58.394328 24771 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.190:39435
I20260810 15:29:58.394381 24892 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.190:39435 every 8 connection(s)
I20260810 15:29:58.394747 24771 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
I20260810 15:29:58.395802 24893 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:29:58.397176 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 24771
I20260810 15:29:58.397305 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786375520124696-18706-0/minicluster-data/master-0/wal/instance
I20260810 15:29:58.397481 18706 external_mini_cluster.cc:1428] Setting key 5b3f84fc6ef7edefb578e2cf97beba77
I20260810 15:29:58.398510 24893 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f8d78b311bb84abaa4a9de58fff5699c: Bootstrap starting.
I20260810 15:29:58.399173 24893 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f8d78b311bb84abaa4a9de58fff5699c: Neither blocks nor log segments found. Creating new log.
I20260810 15:29:58.399559 24893 log.cc:824] T 00000000000000000000000000000000 P f8d78b311bb84abaa4a9de58fff5699c: Log is configured to *not* fsync() on all Append() calls
I20260810 15:29:58.400154 24900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:58.398025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42195 (local address 127.18.68.190:39435)
0810 15:29:58.398264 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0810 15:29:58.398271 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 15:29:58.398295 (+ 24us) server_negotiation.cc:407] Connection header received
0810 15:29:58.398805 (+ 510us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:29:58.398812 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:29:58.398840 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:29:58.398958 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:29:58.399683 (+ 725us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:29:58.399687 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:29:58.399688 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 15:29:58.399693 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:29:58.399737 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 15:29:58.399747 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:29:58.399853 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0810 15:29:58.399910 (+ 57us) server_negotiation.cc:299] Negotiation successful
0810 15:29:58.399951 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":166,"thread_start_us":93,"threads_started":1}
I20260810 15:29:58.400427 24893 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f8d78b311bb84abaa4a9de58fff5699c: No bootstrap required, opened a new log
I20260810 15:29:58.401372 18706 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 15:29:58.403187 24893 raft_consensus.cc:348] T 00000000000000000000000000000000 P f8d78b311bb84abaa4a9de58fff5699c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8d78b311bb84abaa4a9de58fff5699c" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 39435 } }
I20260810 15:29:58.403378 24893 raft_consensus.cc:374] T 00000000000000000000000000000000 P f8d78b311bb84abaa4a9de58fff5699c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:29:58.403417 24893 raft_consensus.cc:729] T 00000000000000000000000000000000 P f8d78b311bb84abaa4a9de58fff5699c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8d78b311bb84abaa4a9de58fff5699c, State: Initialized, Role: FOLLOWER
I20260810 15:29:58.403537 24893 consensus_queue.cc:260] T 00000000000000000000000000000000 P f8d78b311bb84abaa4a9de58fff5699c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8d78b311bb84abaa4a9de58fff5699c" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 39435 } }
I20260810 15:29:58.403625 24893 raft_consensus.cc:388] T 00000000000000000000000000000000 P f8d78b311bb84abaa4a9de58fff5699c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 15:29:58.403654 24893 raft_consensus.cc:482] T 00000000000000000000000000000000 P f8d78b311bb84abaa4a9de58fff5699c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 15:29:58.403776 24893 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f8d78b311bb84abaa4a9de58fff5699c [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:29:58.404372 24900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:29:58.403168 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39935 (local address 127.18.68.190:39435)
0810 15:29:58.403208 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0810 15:29:58.403210 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:29:58.403312 (+ 102us) server_negotiation.cc:407] Connection header received
0810 15:29:58.403394 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:29:58.403395 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:29:58.403400 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:29:58.403460 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:29:58.404158 (+ 698us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:29:58.404160 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:29:58.404160 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 15:29:58.404165 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:29:58.404179 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 15:29:58.404184 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:29:58.404253 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0810 15:29:58.404289 (+ 36us) server_negotiation.cc:299] Negotiation successful
0810 15:29:58.404302 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260810 15:29:58.404501 24893 raft_consensus.cc:504] T 00000000000000000000000000000000 P f8d78b311bb84abaa4a9de58fff5699c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8d78b311bb84abaa4a9de58fff5699c" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 39435 } }
I20260810 15:29:58.404655 24893 leader_election.cc:302] T 00000000000000000000000000000000 P f8d78b311bb84abaa4a9de58fff5699c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f8d78b311bb84abaa4a9de58fff5699c; no voters:
I20260810 15:29:58.404824 24893 leader_election.cc:288] T 00000000000000000000000000000000 P f8d78b311bb84abaa4a9de58fff5699c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 15:29:58.404858 24913 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f8d78b311bb84abaa4a9de58fff5699c [term 1 FOLLOWER]: Leader election won for term 1
I20260810 15:29:58.405032 24913 raft_consensus.cc:686] T 00000000000000000000000000000000 P f8d78b311bb84abaa4a9de58fff5699c [term 1 LEADER]: Becoming Leader. State: Replica: f8d78b311bb84abaa4a9de58fff5699c, State: Running, Role: LEADER
I20260810 15:29:58.405088 24893 sys_catalog.cc:564] T 00000000000000000000000000000000 P f8d78b311bb84abaa4a9de58fff5699c [sys.catalog]: configured and running, proceeding with master startup.
I20260810 15:29:58.405210 24913 consensus_queue.cc:237] T 00000000000000000000000000000000 P f8d78b311bb84abaa4a9de58fff5699c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8d78b311bb84abaa4a9de58fff5699c" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 39435 } }
I20260810 15:29:58.405612 24914 sys_catalog.cc:455] T 00000000000000000000000000000000 P f8d78b311bb84abaa4a9de58fff5699c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f8d78b311bb84abaa4a9de58fff5699c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8d78b311bb84abaa4a9de58fff5699c" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 39435 } } }
I20260810 15:29:58.405740 24914 sys_catalog.cc:458] T 00000000000000000000000000000000 P f8d78b311bb84abaa4a9de58fff5699c [sys.catalog]: This master's current role is: LEADER
I20260810 15:29:58.405615 24916 sys_catalog.cc:455] T 00000000000000000000000000000000 P f8d78b311bb84abaa4a9de58fff5699c [sys.catalog]: SysCatalogTable state changed. Reason: New leader f8d78b311bb84abaa4a9de58fff5699c. Latest consensus state: current_term: 1 leader_uuid: "f8d78b311bb84abaa4a9de58fff5699c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8d78b311bb84abaa4a9de58fff5699c" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 39435 } } }
I20260810 15:29:58.405870 24916 sys_catalog.cc:458] T 00000000000000000000000000000000 P f8d78b311bb84abaa4a9de58fff5699c [sys.catalog]: This master's current role is: LEADER
I20260810 15:29:58.406021 24924 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 15:29:58.406574 24924 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 15:29:58.408138 24924 catalog_manager.cc:1347] Generated new cluster ID: 8e72a197e5d84b269a9de0f84a6fd0a6
I20260810 15:29:58.408195 24924 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 15:29:58.430187 24924 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 15:29:58.430447 24924 catalog_manager.cc:1504] Loading token signing keys...
I20260810 15:29:58.442464 24924 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f8d78b311bb84abaa4a9de58fff5699c: Generated new TSK 0
I20260810 15:29:58.442693 24924 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 15:29:58.450222 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 24771
2026-08-10T15:29:58Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1596 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786375520124696-18706-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 15:29:58 dist-test-slave-2p8l krb5kdc[24954](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 15:29:58 dist-test-slave-2p8l krb5kdc[24954](info): set up 2 sockets
Aug 10 15:29:58 dist-test-slave-2p8l krb5kdc[24954](info): commencing operation
krb5kdc: starting...
W20260810 15:29:59.801214 18706 mini_kdc.cc:121] Time spent starting KDC: real 1.324s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786375520124696-18706-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786375520124696-18706-0/krb5kdc/test-user.keytab.
Aug 10 15:29:59 dist-test-slave-2p8l krb5kdc[24954](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375799, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T15:29:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T15:29:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.68.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.68.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.68.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab.
Entry for principal kudu/127.18.68.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab.
I20260810 15:29:59.938194 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786375520124696-18706-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786375520124696-18706-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786375520124696-18706-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.190:34731
--webserver_interface=127.18.68.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab
--principal=kudu/127.18.68.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:38693
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.68.190:34731
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:30:00.024356 24972 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:30:00.024690 24972 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:30:00.024742 24972 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:30:00.025964 24972 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 15:30:00.026062 24972 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:30:00.026093 24972 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:30:00.026154 24972 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 15:30:00.026172 24972 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 15:30:00.027763 24972 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:38693
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786375520124696-18706-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786375520124696-18706-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.68.190:34731
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab
--principal=kudu/127.18.68.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.190:34731
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.68.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24972
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786375520124696-18706-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:30:00.028075 24972 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:30:00.028326 24972 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:30:00.033651 24984 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:30:00.033841 24982 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:30:00.033665 24981 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:30:00.034050 24972 server_base.cc:1034] running on GCE node
I20260810 15:30:00.034426 24972 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:30:00.034785 24972 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:30:00.035976 24972 hybrid_clock.cc:648] HybridClock initialized: now 1786375800035950 us; error 45 us; skew 500 ppm
Aug 10 15:30:00 dist-test-slave-2p8l krb5kdc[24954](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375800, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:30:00.038806 24972 init.cc:377] Logged in from keytab as kudu/127.18.68.190@KRBTEST.COM (short username kudu)
I20260810 15:30:00.039363 24972 webserver.cc:460] Webserver started at http://127.18.68.190:46383/ using document root <none> and password file <none>
I20260810 15:30:00.039608 24972 fs_manager.cc:359] Metadata directory not provided
I20260810 15:30:00.039682 24972 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:30:00.039855 24972 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:30:00.040989 24972 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786375520124696-18706-0/minicluster-data/master-0/data/instance:
uuid: "e3c2f0621fbb4dcebaa9079da4498883"
format_stamp: "Formatted at 2026-08-10 15:30:00 on dist-test-slave-2p8l"
server_key: "9796cb39e2fe234cd54079f31b2b34a4"
server_key_iv: "6de63d71f12818fbb0aa230baab75112"
server_key_version: "encryptionkey@0"
I20260810 15:30:00.041400 24972 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786375520124696-18706-0/minicluster-data/master-0/wal/instance:
uuid: "e3c2f0621fbb4dcebaa9079da4498883"
format_stamp: "Formatted at 2026-08-10 15:30:00 on dist-test-slave-2p8l"
server_key: "9796cb39e2fe234cd54079f31b2b34a4"
server_key_iv: "6de63d71f12818fbb0aa230baab75112"
server_key_version: "encryptionkey@0"
I20260810 15:30:00.043078 24972 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 15:30:00.044034 24999 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:30:00.044361 24972 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 15:30:00.044492 24972 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786375520124696-18706-0/minicluster-data/master-0/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786375520124696-18706-0/minicluster-data/master-0/wal
uuid: "e3c2f0621fbb4dcebaa9079da4498883"
format_stamp: "Formatted at 2026-08-10 15:30:00 on dist-test-slave-2p8l"
server_key: "9796cb39e2fe234cd54079f31b2b34a4"
server_key_iv: "6de63d71f12818fbb0aa230baab75112"
server_key_version: "encryptionkey@0"
I20260810 15:30:00.044654 24972 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786375520124696-18706-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786375520124696-18706-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786375520124696-18706-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:30:00.069895 24972 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:30:00.072458 24972 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:30:00.072667 24972 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:30:00.077469 24972 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.190:34731
I20260810 15:30:00.077596 25077 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.190:34731 every 8 connection(s)
I20260810 15:30:00.077952 24972 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
I20260810 15:30:00.079025 25078 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:30:00.081581 25078 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e3c2f0621fbb4dcebaa9079da4498883: Bootstrap starting.
I20260810 15:30:00.082329 25078 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e3c2f0621fbb4dcebaa9079da4498883: Neither blocks nor log segments found. Creating new log.
I20260810 15:30:00.082597 25078 log.cc:824] T 00000000000000000000000000000000 P e3c2f0621fbb4dcebaa9079da4498883: Log is configured to *not* fsync() on all Append() calls
I20260810 15:30:00.083449 25078 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e3c2f0621fbb4dcebaa9079da4498883: No bootstrap required, opened a new log
I20260810 15:30:00.084883 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 24972
I20260810 15:30:00.085027 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786375520124696-18706-0/minicluster-data/master-0/wal/instance
I20260810 15:30:00.085219 18706 external_mini_cluster.cc:1428] Setting key bdbce113c8d40966ff6a53d931011e8e
I20260810 15:30:00.085367 25078 raft_consensus.cc:348] T 00000000000000000000000000000000 P e3c2f0621fbb4dcebaa9079da4498883 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3c2f0621fbb4dcebaa9079da4498883" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 34731 } }
I20260810 15:30:00.085529 25078 raft_consensus.cc:374] T 00000000000000000000000000000000 P e3c2f0621fbb4dcebaa9079da4498883 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:30:00.085553 25078 raft_consensus.cc:729] T 00000000000000000000000000000000 P e3c2f0621fbb4dcebaa9079da4498883 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3c2f0621fbb4dcebaa9079da4498883, State: Initialized, Role: FOLLOWER
I20260810 15:30:00.085759 25078 consensus_queue.cc:260] T 00000000000000000000000000000000 P e3c2f0621fbb4dcebaa9079da4498883 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3c2f0621fbb4dcebaa9079da4498883" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 34731 } }
I20260810 15:30:00.085875 25078 raft_consensus.cc:388] T 00000000000000000000000000000000 P e3c2f0621fbb4dcebaa9079da4498883 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 15:30:00.085942 25078 raft_consensus.cc:482] T 00000000000000000000000000000000 P e3c2f0621fbb4dcebaa9079da4498883 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 15:30:00.086002 25078 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e3c2f0621fbb4dcebaa9079da4498883 [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:30:00.087247 25078 raft_consensus.cc:504] T 00000000000000000000000000000000 P e3c2f0621fbb4dcebaa9079da4498883 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3c2f0621fbb4dcebaa9079da4498883" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 34731 } }
I20260810 15:30:00.087364 25078 leader_election.cc:302] T 00000000000000000000000000000000 P e3c2f0621fbb4dcebaa9079da4498883 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e3c2f0621fbb4dcebaa9079da4498883; no voters:
I20260810 15:30:00.087520 25078 leader_election.cc:288] T 00000000000000000000000000000000 P e3c2f0621fbb4dcebaa9079da4498883 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 15:30:00.087621 25089 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e3c2f0621fbb4dcebaa9079da4498883 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 15:30:00.087828 25078 sys_catalog.cc:564] T 00000000000000000000000000000000 P e3c2f0621fbb4dcebaa9079da4498883 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 15:30:00.087836 25089 raft_consensus.cc:686] T 00000000000000000000000000000000 P e3c2f0621fbb4dcebaa9079da4498883 [term 1 LEADER]: Becoming Leader. State: Replica: e3c2f0621fbb4dcebaa9079da4498883, State: Running, Role: LEADER
I20260810 15:30:00.088060 25089 consensus_queue.cc:237] T 00000000000000000000000000000000 P e3c2f0621fbb4dcebaa9079da4498883 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3c2f0621fbb4dcebaa9079da4498883" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 34731 } }
I20260810 15:30:00.088429 25089 sys_catalog.cc:455] T 00000000000000000000000000000000 P e3c2f0621fbb4dcebaa9079da4498883 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e3c2f0621fbb4dcebaa9079da4498883. Latest consensus state: current_term: 1 leader_uuid: "e3c2f0621fbb4dcebaa9079da4498883" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3c2f0621fbb4dcebaa9079da4498883" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 34731 } } }
I20260810 15:30:00.088454 25091 sys_catalog.cc:455] T 00000000000000000000000000000000 P e3c2f0621fbb4dcebaa9079da4498883 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e3c2f0621fbb4dcebaa9079da4498883" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3c2f0621fbb4dcebaa9079da4498883" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 34731 } } }
I20260810 15:30:00.088586 25091 sys_catalog.cc:458] T 00000000000000000000000000000000 P e3c2f0621fbb4dcebaa9079da4498883 [sys.catalog]: This master's current role is: LEADER
I20260810 15:30:00.088806 25089 sys_catalog.cc:458] T 00000000000000000000000000000000 P e3c2f0621fbb4dcebaa9079da4498883 [sys.catalog]: This master's current role is: LEADER
I20260810 15:30:00.088989 25104 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 15:30:00.089785 25104 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 15:30:00.091652 25104 catalog_manager.cc:1347] Generated new cluster ID: b525cb4bfeda4b17bcdbcc2b9cafbf77
I20260810 15:30:00.091713 25104 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 10 15:30:00 dist-test-slave-2p8l krb5kdc[24954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375799, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
I20260810 15:30:00.096875 25087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:30:00.085829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47537 (local address 127.18.68.190:34731)
0810 15:30:00.086149 (+ 320us) server_negotiation.cc:206] Beginning negotiation
0810 15:30:00.086159 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 15:30:00.086197 (+ 38us) server_negotiation.cc:407] Connection header received
0810 15:30:00.086329 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:30:00.086336 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:30:00.086393 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:30:00.086580 (+ 187us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:30:00.087270 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:30:00.088697 (+ 1427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:30:00.089856 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:30:00.090473 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:30:00.090632 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:30:00.093375 (+ 2743us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:30:00.093379 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:30:00.093379 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:30:00.093392 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:30:00.095259 (+ 1867us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:30:00.095666 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:30:00.095669 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:30:00.095670 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:30:00.095779 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:30:00.096008 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:30:00.096009 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:30:00.096009 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:30:00.096267 (+ 258us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:30:00.096463 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0810 15:30:00.096533 (+ 70us) server_negotiation.cc:299] Negotiation successful
0810 15:30:00.096707 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":256,"thread_start_us":133,"threads_started":1}
I20260810 15:30:00.097995 18706 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 15:30:00.104921 25104 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 15:30:00.105710 25104 catalog_manager.cc:1504] Loading token signing keys...
I20260810 15:30:00.106282 25087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:30:00.099600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44285 (local address 127.18.68.190:34731)
0810 15:30:00.099648 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0810 15:30:00.099650 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:30:00.099659 (+ 9us) server_negotiation.cc:407] Connection header received
0810 15:30:00.099715 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:30:00.099715 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:30:00.099743 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:30:00.099791 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:30:00.100315 (+ 524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:30:00.100818 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:30:00.101554 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:30:00.101782 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:30:00.101876 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:30:00.103147 (+ 1271us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:30:00.103148 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:30:00.103149 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:30:00.103156 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:30:00.104792 (+ 1636us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:30:00.105251 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:30:00.105252 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:30:00.105252 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:30:00.105326 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:30:00.105581 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:30:00.105582 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:30:00.105582 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:30:00.105720 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:30:00.105825 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0810 15:30:00.106081 (+ 256us) server_negotiation.cc:299] Negotiation successful
0810 15:30:00.106188 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260810 15:30:00.113400 25104 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e3c2f0621fbb4dcebaa9079da4498883: Generated new TSK 0
I20260810 15:30:00.113711 25104 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 15:30:00.116745 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 24972
2026-08-10T15:30:00Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1675 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786375520124696-18706-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 15:30:00 dist-test-slave-2p8l krb5kdc[25142](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 15:30:00 dist-test-slave-2p8l krb5kdc[25142](info): set up 2 sockets
Aug 10 15:30:00 dist-test-slave-2p8l krb5kdc[25142](info): commencing operation
krb5kdc: starting...
W20260810 15:30:01.465399 18706 mini_kdc.cc:121] Time spent starting KDC: real 1.313s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786375520124696-18706-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786375520124696-18706-0/krb5kdc/test-user.keytab.
Aug 10 15:30:01 dist-test-slave-2p8l krb5kdc[25142](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375801, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T15:30:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T15:30:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.68.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.68.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.68.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab.
Entry for principal kudu/127.18.68.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab.
I20260810 15:30:01.605568 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786375520124696-18706-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786375520124696-18706-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786375520124696-18706-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.190:43807
--webserver_interface=127.18.68.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab
--principal=kudu/127.18.68.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:34781
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.68.190:43807
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:30:01.693075 25161 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:30:01.693378 25161 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:30:01.693424 25161 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:30:01.694734 25161 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 15:30:01.694823 25161 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:30:01.694849 25161 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:30:01.694870 25161 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 15:30:01.694897 25161 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 15:30:01.696543 25161 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:34781
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786375520124696-18706-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786375520124696-18706-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.68.190:43807
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab
--principal=kudu/127.18.68.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.190:43807
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.68.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25161
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786375520124696-18706-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:30:01.696877 25161 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:30:01.697134 25161 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:30:01.702824 25167 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:30:01.702828 25173 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:30:01.702823 25169 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:30:01.703171 25161 server_base.cc:1034] running on GCE node
I20260810 15:30:01.703389 25161 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:30:01.703676 25161 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:30:01.704859 25161 hybrid_clock.cc:648] HybridClock initialized: now 1786375801704842 us; error 33 us; skew 500 ppm
Aug 10 15:30:01 dist-test-slave-2p8l krb5kdc[25142](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375801, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:30:01.707995 25161 init.cc:377] Logged in from keytab as kudu/127.18.68.190@KRBTEST.COM (short username kudu)
I20260810 15:30:01.708580 25161 webserver.cc:460] Webserver started at http://127.18.68.190:44041/ using document root <none> and password file <none>
I20260810 15:30:01.708853 25161 fs_manager.cc:359] Metadata directory not provided
I20260810 15:30:01.708932 25161 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:30:01.709098 25161 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:30:01.710336 25161 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786375520124696-18706-0/minicluster-data/master-0/data/instance:
uuid: "8a5e72bbf0fa4fa1ba57fdbb192b70f0"
format_stamp: "Formatted at 2026-08-10 15:30:01 on dist-test-slave-2p8l"
server_key: "dcdbd3118940714834075cd40a023505"
server_key_iv: "c22141680007ccb9530cc116fdc5c321"
server_key_version: "encryptionkey@0"
I20260810 15:30:01.710775 25161 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786375520124696-18706-0/minicluster-data/master-0/wal/instance:
uuid: "8a5e72bbf0fa4fa1ba57fdbb192b70f0"
format_stamp: "Formatted at 2026-08-10 15:30:01 on dist-test-slave-2p8l"
server_key: "dcdbd3118940714834075cd40a023505"
server_key_iv: "c22141680007ccb9530cc116fdc5c321"
server_key_version: "encryptionkey@0"
I20260810 15:30:01.712322 25161 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 15:30:01.713315 25187 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:30:01.713539 25161 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:30:01.713707 25161 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786375520124696-18706-0/minicluster-data/master-0/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786375520124696-18706-0/minicluster-data/master-0/wal
uuid: "8a5e72bbf0fa4fa1ba57fdbb192b70f0"
format_stamp: "Formatted at 2026-08-10 15:30:01 on dist-test-slave-2p8l"
server_key: "dcdbd3118940714834075cd40a023505"
server_key_iv: "c22141680007ccb9530cc116fdc5c321"
server_key_version: "encryptionkey@0"
I20260810 15:30:01.713793 25161 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786375520124696-18706-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786375520124696-18706-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786375520124696-18706-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:30:01.734735 25161 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:30:01.737453 25161 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:30:01.737735 25161 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:30:01.742292 25161 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.190:43807
I20260810 15:30:01.742374 25280 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.190:43807 every 8 connection(s)
I20260810 15:30:01.742776 25161 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
I20260810 15:30:01.743790 25281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:30:01.746250 25281 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8a5e72bbf0fa4fa1ba57fdbb192b70f0: Bootstrap starting.
I20260810 15:30:01.746853 25281 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8a5e72bbf0fa4fa1ba57fdbb192b70f0: Neither blocks nor log segments found. Creating new log.
I20260810 15:30:01.747098 25281 log.cc:824] T 00000000000000000000000000000000 P 8a5e72bbf0fa4fa1ba57fdbb192b70f0: Log is configured to *not* fsync() on all Append() calls
I20260810 15:30:01.747917 25281 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8a5e72bbf0fa4fa1ba57fdbb192b70f0: No bootstrap required, opened a new log
I20260810 15:30:01.749584 25281 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8a5e72bbf0fa4fa1ba57fdbb192b70f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a5e72bbf0fa4fa1ba57fdbb192b70f0" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 43807 } }
I20260810 15:30:01.749742 25281 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8a5e72bbf0fa4fa1ba57fdbb192b70f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:30:01.749764 25281 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8a5e72bbf0fa4fa1ba57fdbb192b70f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a5e72bbf0fa4fa1ba57fdbb192b70f0, State: Initialized, Role: FOLLOWER
I20260810 15:30:01.749929 25281 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8a5e72bbf0fa4fa1ba57fdbb192b70f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a5e72bbf0fa4fa1ba57fdbb192b70f0" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 43807 } }
I20260810 15:30:01.750018 25281 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8a5e72bbf0fa4fa1ba57fdbb192b70f0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 15:30:01.750043 25281 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8a5e72bbf0fa4fa1ba57fdbb192b70f0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 15:30:01.750145 25281 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8a5e72bbf0fa4fa1ba57fdbb192b70f0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:30:01.751163 25281 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8a5e72bbf0fa4fa1ba57fdbb192b70f0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a5e72bbf0fa4fa1ba57fdbb192b70f0" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 43807 } }
I20260810 15:30:01.751266 25281 leader_election.cc:302] T 00000000000000000000000000000000 P 8a5e72bbf0fa4fa1ba57fdbb192b70f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8a5e72bbf0fa4fa1ba57fdbb192b70f0; no voters:
I20260810 15:30:01.751449 25281 leader_election.cc:288] T 00000000000000000000000000000000 P 8a5e72bbf0fa4fa1ba57fdbb192b70f0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 15:30:01.751480 25285 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8a5e72bbf0fa4fa1ba57fdbb192b70f0 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 15:30:01.751609 25285 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8a5e72bbf0fa4fa1ba57fdbb192b70f0 [term 1 LEADER]: Becoming Leader. State: Replica: 8a5e72bbf0fa4fa1ba57fdbb192b70f0, State: Running, Role: LEADER
I20260810 15:30:01.751771 25281 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8a5e72bbf0fa4fa1ba57fdbb192b70f0 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 15:30:01.751771 25285 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8a5e72bbf0fa4fa1ba57fdbb192b70f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a5e72bbf0fa4fa1ba57fdbb192b70f0" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 43807 } }
I20260810 15:30:01.752243 25289 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a5e72bbf0fa4fa1ba57fdbb192b70f0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8a5e72bbf0fa4fa1ba57fdbb192b70f0. Latest consensus state: current_term: 1 leader_uuid: "8a5e72bbf0fa4fa1ba57fdbb192b70f0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a5e72bbf0fa4fa1ba57fdbb192b70f0" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 43807 } } }
I20260810 15:30:01.752254 25287 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a5e72bbf0fa4fa1ba57fdbb192b70f0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8a5e72bbf0fa4fa1ba57fdbb192b70f0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a5e72bbf0fa4fa1ba57fdbb192b70f0" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 43807 } } }
I20260810 15:30:01.752411 25289 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a5e72bbf0fa4fa1ba57fdbb192b70f0 [sys.catalog]: This master's current role is: LEADER
I20260810 15:30:01.752431 25287 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a5e72bbf0fa4fa1ba57fdbb192b70f0 [sys.catalog]: This master's current role is: LEADER
I20260810 15:30:01.752676 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 25161
I20260810 15:30:01.752820 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786375520124696-18706-0/minicluster-data/master-0/wal/instance
I20260810 15:30:01.753041 18706 external_mini_cluster.cc:1428] Setting key f6f1f93ba36a5b621e2d76fe20281f2f
I20260810 15:30:01.753065 25294 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 15:30:01.753734 25294 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 15:30:01.755692 25294 catalog_manager.cc:1347] Generated new cluster ID: 97cdb0aa80f54752bc13923ab8c00f0f
I20260810 15:30:01.755753 25294 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 15:30:01.760360 25307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:30:01.753629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55137 (local address 127.18.68.190:43807)
0810 15:30:01.754197 (+ 568us) server_negotiation.cc:206] Beginning negotiation
0810 15:30:01.754209 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 15:30:01.754245 (+ 36us) server_negotiation.cc:407] Connection header received
0810 15:30:01.754474 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:30:01.754485 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:30:01.754560 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:30:01.754983 (+ 423us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:30:01.755113 (+ 130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:30:01.756366 (+ 1253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:30:01.757481 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:30:01.758169 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:30:01.758800 (+ 631us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:30:01.759233 (+ 433us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:30:01.759236 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:30:01.759237 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 15:30:01.759445 (+ 208us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:30:01.759494 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 15:30:01.759509 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:30:01.759828 (+ 319us) server_negotiation.cc:1035] Waiting for connection context
0810 15:30:01.759862 (+ 34us) server_negotiation.cc:299] Negotiation successful
0810 15:30:01.759930 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":508,"thread_start_us":71,"threads_started":1}
I20260810 15:30:01.761731 18706 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 15:30:01.761864 25294 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 15:30:01.762512 25294 catalog_manager.cc:1504] Loading token signing keys...
I20260810 15:30:01.770103 25307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:30:01.763417 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34431 (local address 127.18.68.190:43807)
0810 15:30:01.763456 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0810 15:30:01.763458 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:30:01.766292 (+ 2834us) server_negotiation.cc:407] Connection header received
0810 15:30:01.766350 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:30:01.766352 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:30:01.766367 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:30:01.766427 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:30:01.766609 (+ 182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:30:01.767441 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:30:01.768519 (+ 1078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:30:01.768880 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:30:01.768958 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:30:01.769761 (+ 803us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:30:01.769763 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:30:01.769763 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 15:30:01.769769 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:30:01.769787 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 15:30:01.769792 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:30:01.769861 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0810 15:30:01.769918 (+ 57us) server_negotiation.cc:299] Negotiation successful
0810 15:30:01.769950 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260810 15:30:01.773408 25294 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8a5e72bbf0fa4fa1ba57fdbb192b70f0: Generated new TSK 0
I20260810 15:30:01.773663 25294 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 15:30:01.776216 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 25161
2026-08-10T15:30:01Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1665 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786375520124696-18706-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 15:30:01 dist-test-slave-2p8l krb5kdc[25328](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 15:30:01 dist-test-slave-2p8l krb5kdc[25328](info): set up 2 sockets
Aug 10 15:30:01 dist-test-slave-2p8l krb5kdc[25328](info): commencing operation
krb5kdc: starting...
W20260810 15:30:03.173343 18706 mini_kdc.cc:121] Time spent starting KDC: real 1.356s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786375520124696-18706-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786375520124696-18706-0/krb5kdc/test-user.keytab.
Aug 10 15:30:03 dist-test-slave-2p8l krb5kdc[25328](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375803, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T15:30:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T15:30:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.68.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.68.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.68.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab.
Entry for principal kudu/127.18.68.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab.
I20260810 15:30:03.310425 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786375520124696-18706-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786375520124696-18706-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786375520124696-18706-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.190:45155
--webserver_interface=127.18.68.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab
--principal=kudu/127.18.68.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:43581
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.68.190:45155
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:30:03.397806 25364 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:30:03.398136 25364 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:30:03.398223 25364 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:30:03.399435 25364 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 15:30:03.399523 25364 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:30:03.399551 25364 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:30:03.399582 25364 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 15:30:03.399610 25364 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 15:30:03.401204 25364 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:43581
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786375520124696-18706-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786375520124696-18706-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.68.190:45155
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab
--principal=kudu/127.18.68.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.190:45155
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.68.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25364
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786375520124696-18706-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:30:03.401518 25364 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:30:03.401775 25364 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:30:03.407140 25374 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:30:03.407152 25372 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:30:03.407160 25376 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:30:03.407440 25364 server_base.cc:1034] running on GCE node
I20260810 15:30:03.407747 25364 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:30:03.408106 25364 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:30:03.409314 25364 hybrid_clock.cc:648] HybridClock initialized: now 1786375803409287 us; error 51 us; skew 500 ppm
Aug 10 15:30:03 dist-test-slave-2p8l krb5kdc[25328](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375803, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:30:03.412532 25364 init.cc:377] Logged in from keytab as kudu/127.18.68.190@KRBTEST.COM (short username kudu)
I20260810 15:30:03.413131 25364 webserver.cc:460] Webserver started at http://127.18.68.190:37953/ using document root <none> and password file <none>
I20260810 15:30:03.413417 25364 fs_manager.cc:359] Metadata directory not provided
I20260810 15:30:03.413504 25364 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:30:03.413694 25364 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:30:03.415045 25364 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786375520124696-18706-0/minicluster-data/master-0/data/instance:
uuid: "68a609ce77c74921a0e930542294bec6"
format_stamp: "Formatted at 2026-08-10 15:30:03 on dist-test-slave-2p8l"
server_key: "856899228c608fdeb04e8dc3bf40b814"
server_key_iv: "6400b3c740b01326244d1bec73118a96"
server_key_version: "encryptionkey@0"
I20260810 15:30:03.415499 25364 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786375520124696-18706-0/minicluster-data/master-0/wal/instance:
uuid: "68a609ce77c74921a0e930542294bec6"
format_stamp: "Formatted at 2026-08-10 15:30:03 on dist-test-slave-2p8l"
server_key: "856899228c608fdeb04e8dc3bf40b814"
server_key_iv: "6400b3c740b01326244d1bec73118a96"
server_key_version: "encryptionkey@0"
I20260810 15:30:03.417320 25364 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.002s
I20260810 15:30:03.418396 25389 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:30:03.418735 25364 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:30:03.418829 25364 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786375520124696-18706-0/minicluster-data/master-0/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786375520124696-18706-0/minicluster-data/master-0/wal
uuid: "68a609ce77c74921a0e930542294bec6"
format_stamp: "Formatted at 2026-08-10 15:30:03 on dist-test-slave-2p8l"
server_key: "856899228c608fdeb04e8dc3bf40b814"
server_key_iv: "6400b3c740b01326244d1bec73118a96"
server_key_version: "encryptionkey@0"
I20260810 15:30:03.418946 25364 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786375520124696-18706-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786375520124696-18706-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786375520124696-18706-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:30:03.423103 25364 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:30:03.425758 25364 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:30:03.425889 25364 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:30:03.430302 25364 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.190:45155
I20260810 15:30:03.430338 25470 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.190:45155 every 8 connection(s)
I20260810 15:30:03.430765 25364 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
I20260810 15:30:03.431936 25472 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:30:03.434612 25472 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 68a609ce77c74921a0e930542294bec6: Bootstrap starting.
I20260810 15:30:03.435243 25472 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 68a609ce77c74921a0e930542294bec6: Neither blocks nor log segments found. Creating new log.
I20260810 15:30:03.435534 25472 log.cc:824] T 00000000000000000000000000000000 P 68a609ce77c74921a0e930542294bec6: Log is configured to *not* fsync() on all Append() calls
I20260810 15:30:03.436367 25472 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 68a609ce77c74921a0e930542294bec6: No bootstrap required, opened a new log
I20260810 15:30:03.437282 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 25364
I20260810 15:30:03.437413 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786375520124696-18706-0/minicluster-data/master-0/wal/instance
I20260810 15:30:03.437656 18706 external_mini_cluster.cc:1428] Setting key af42b308a64aa5f49a64a7e9956a923e
I20260810 15:30:03.438894 25472 raft_consensus.cc:348] T 00000000000000000000000000000000 P 68a609ce77c74921a0e930542294bec6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68a609ce77c74921a0e930542294bec6" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 45155 } }
I20260810 15:30:03.439102 25472 raft_consensus.cc:374] T 00000000000000000000000000000000 P 68a609ce77c74921a0e930542294bec6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 15:30:03.439152 25472 raft_consensus.cc:729] T 00000000000000000000000000000000 P 68a609ce77c74921a0e930542294bec6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68a609ce77c74921a0e930542294bec6, State: Initialized, Role: FOLLOWER
I20260810 15:30:03.439393 25472 consensus_queue.cc:260] T 00000000000000000000000000000000 P 68a609ce77c74921a0e930542294bec6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68a609ce77c74921a0e930542294bec6" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 45155 } }
I20260810 15:30:03.439891 25472 raft_consensus.cc:388] T 00000000000000000000000000000000 P 68a609ce77c74921a0e930542294bec6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 15:30:03.439985 25472 raft_consensus.cc:482] T 00000000000000000000000000000000 P 68a609ce77c74921a0e930542294bec6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 15:30:03.440052 25472 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 68a609ce77c74921a0e930542294bec6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:30:03.440359 25478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:30:03.438266 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50971 (local address 127.18.68.190:45155)
0810 15:30:03.438519 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0810 15:30:03.438528 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 15:30:03.438566 (+ 38us) server_negotiation.cc:407] Connection header received
0810 15:30:03.438874 (+ 308us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:30:03.438881 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:30:03.438907 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:30:03.439030 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:30:03.439800 (+ 770us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:30:03.439804 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:30:03.439804 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 15:30:03.439808 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:30:03.439847 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 15:30:03.439859 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:30:03.439951 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0810 15:30:03.440033 (+ 82us) server_negotiation.cc:299] Negotiation successful
0810 15:30:03.440178 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":183,"thread_start_us":134,"threads_started":1}
I20260810 15:30:03.440840 25472 raft_consensus.cc:504] T 00000000000000000000000000000000 P 68a609ce77c74921a0e930542294bec6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68a609ce77c74921a0e930542294bec6" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 45155 } }
I20260810 15:30:03.440982 25472 leader_election.cc:302] T 00000000000000000000000000000000 P 68a609ce77c74921a0e930542294bec6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 68a609ce77c74921a0e930542294bec6; no voters:
I20260810 15:30:03.441179 25472 leader_election.cc:288] T 00000000000000000000000000000000 P 68a609ce77c74921a0e930542294bec6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 15:30:03.441233 25479 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 68a609ce77c74921a0e930542294bec6 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 15:30:03.441339 18706 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 15:30:03.441478 25472 sys_catalog.cc:564] T 00000000000000000000000000000000 P 68a609ce77c74921a0e930542294bec6 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 15:30:03.442293 25479 raft_consensus.cc:686] T 00000000000000000000000000000000 P 68a609ce77c74921a0e930542294bec6 [term 1 LEADER]: Becoming Leader. State: Replica: 68a609ce77c74921a0e930542294bec6, State: Running, Role: LEADER
I20260810 15:30:03.442414 25479 consensus_queue.cc:237] T 00000000000000000000000000000000 P 68a609ce77c74921a0e930542294bec6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68a609ce77c74921a0e930542294bec6" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 45155 } }
I20260810 15:30:03.442994 25479 sys_catalog.cc:455] T 00000000000000000000000000000000 P 68a609ce77c74921a0e930542294bec6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 68a609ce77c74921a0e930542294bec6. Latest consensus state: current_term: 1 leader_uuid: "68a609ce77c74921a0e930542294bec6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68a609ce77c74921a0e930542294bec6" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 45155 } } }
I20260810 15:30:03.443401 25479 sys_catalog.cc:458] T 00000000000000000000000000000000 P 68a609ce77c74921a0e930542294bec6 [sys.catalog]: This master's current role is: LEADER
I20260810 15:30:03.443326 25481 sys_catalog.cc:455] T 00000000000000000000000000000000 P 68a609ce77c74921a0e930542294bec6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "68a609ce77c74921a0e930542294bec6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68a609ce77c74921a0e930542294bec6" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 45155 } } }
I20260810 15:30:03.443837 25481 sys_catalog.cc:458] T 00000000000000000000000000000000 P 68a609ce77c74921a0e930542294bec6 [sys.catalog]: This master's current role is: LEADER
I20260810 15:30:03.444064 25508 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 15:30:03.444659 25478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:30:03.442995 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55153 (local address 127.18.68.190:45155)
0810 15:30:03.443036 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0810 15:30:03.443039 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 15:30:03.443313 (+ 274us) server_negotiation.cc:407] Connection header received
0810 15:30:03.443435 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:30:03.443436 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:30:03.443443 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:30:03.443483 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:30:03.444329 (+ 846us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:30:03.444330 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:30:03.444330 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 15:30:03.444335 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:30:03.444353 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 15:30:03.444358 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:30:03.444391 (+ 33us) server_negotiation.cc:1035] Waiting for connection context
0810 15:30:03.444539 (+ 148us) server_negotiation.cc:299] Negotiation successful
0810 15:30:03.444557 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260810 15:30:03.444667 25508 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 15:30:03.446354 25508 catalog_manager.cc:1347] Generated new cluster ID: a013855c25634ca8a7dedd30a3eb6e8d
I20260810 15:30:03.446430 25508 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 15:30:03.457899 25508 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 15:30:03.458176 25508 catalog_manager.cc:1504] Loading token signing keys...
I20260810 15:30:03.462653 25508 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 68a609ce77c74921a0e930542294bec6: Generated new TSK 0
I20260810 15:30:03.462916 25508 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 15:30:03.469113 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 25364
2026-08-10T15:30:03Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1679 ms)
[----------] 18 tests from AuthTokenIssuingTest (29211 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786375520124696-18706-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 15:30:03 dist-test-slave-2p8l krb5kdc[25523](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 15:30:03 dist-test-slave-2p8l krb5kdc[25523](info): set up 2 sockets
Aug 10 15:30:03 dist-test-slave-2p8l krb5kdc[25523](info): commencing operation
krb5kdc: starting...
W20260810 15:30:04.805552 18706 mini_kdc.cc:121] Time spent starting KDC: real 1.309s user 0.001s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786375520124696-18706-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786375520124696-18706-0/krb5kdc/test-user.keytab.
Aug 10 15:30:04 dist-test-slave-2p8l krb5kdc[25523](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375804, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T15:30:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T15:30:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.68.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.68.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.68.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab.
Entry for principal kudu/127.18.68.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab.
I20260810 15:30:04.947571 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786375520124696-18706-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786375520124696-18706-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786375520124696-18706-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.190:46723
--webserver_interface=127.18.68.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab
--principal=kudu/127.18.68.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:43741
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.68.190:46723,127.18.68.189:46707,127.18.68.188:36757
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:30:05.034233 25547 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260810 15:30:05.034473 25547 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:30:05.034493 25547 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:30:05.034515 25547 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:30:05.035657 25547 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 15:30:05.035697 25547 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:30:05.035712 25547 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:30:05.035724 25547 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 15:30:05.035737 25547 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 15:30:05.037309 25547 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:43741
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786375520124696-18706-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786375520124696-18706-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.68.190:46723,127.18.68.189:46707,127.18.68.188:36757
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab
--principal=kudu/127.18.68.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.190:46723
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.68.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25547
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786375520124696-18706-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:30:05.037536 25547 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:30:05.037720 25547 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:30:05.043673 25556 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:30:05.043673 25562 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:30:05.043678 25560 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:30:05.044090 25547 server_base.cc:1034] running on GCE node
I20260810 15:30:05.044363 25547 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:30:05.044740 25547 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:30:05.045913 25547 hybrid_clock.cc:648] HybridClock initialized: now 1786375805045896 us; error 53 us; skew 500 ppm
Aug 10 15:30:05 dist-test-slave-2p8l krb5kdc[25523](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375805, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:30:05.055238 25547 init.cc:377] Logged in from keytab as kudu/127.18.68.190@KRBTEST.COM (short username kudu)
I20260810 15:30:05.055866 25547 webserver.cc:460] Webserver started at http://127.18.68.190:35623/ using document root <none> and password file <none>
I20260810 15:30:05.056128 25547 fs_manager.cc:359] Metadata directory not provided
I20260810 15:30:05.056203 25547 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:30:05.056356 25547 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:30:05.057505 25547 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786375520124696-18706-0/minicluster-data/master-0/data/instance:
uuid: "2d3e72ffb11942069d6d253383ae2a33"
format_stamp: "Formatted at 2026-08-10 15:30:05 on dist-test-slave-2p8l"
server_key: "743abcd1e570bc0caf395527ea63e8bd"
server_key_iv: "abf318210b0352e13dc96b9845d53d87"
server_key_version: "encryptionkey@0"
I20260810 15:30:05.057895 25547 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786375520124696-18706-0/minicluster-data/master-0/wal/instance:
uuid: "2d3e72ffb11942069d6d253383ae2a33"
format_stamp: "Formatted at 2026-08-10 15:30:05 on dist-test-slave-2p8l"
server_key: "743abcd1e570bc0caf395527ea63e8bd"
server_key_iv: "abf318210b0352e13dc96b9845d53d87"
server_key_version: "encryptionkey@0"
I20260810 15:30:05.059479 25547 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260810 15:30:05.060348 25577 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:30:05.060557 25547 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 15:30:05.060668 25547 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786375520124696-18706-0/minicluster-data/master-0/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786375520124696-18706-0/minicluster-data/master-0/wal
uuid: "2d3e72ffb11942069d6d253383ae2a33"
format_stamp: "Formatted at 2026-08-10 15:30:05 on dist-test-slave-2p8l"
server_key: "743abcd1e570bc0caf395527ea63e8bd"
server_key_iv: "abf318210b0352e13dc96b9845d53d87"
server_key_version: "encryptionkey@0"
I20260810 15:30:05.060762 25547 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786375520124696-18706-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786375520124696-18706-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786375520124696-18706-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:30:05.074036 25547 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:30:05.076543 25547 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:30:05.076745 25547 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:30:05.081535 25547 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.190:46723
I20260810 15:30:05.081611 25663 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.190:46723 every 8 connection(s)
I20260810 15:30:05.082033 25547 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
I20260810 15:30:05.083209 25664 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:30:05.083887 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 25547
I20260810 15:30:05.084046 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786375520124696-18706-0/minicluster-data/master-0/wal/instance
I20260810 15:30:05.084244 18706 external_mini_cluster.cc:1428] Setting key 5e1096fbcf5a962685137f0dc049c297
I20260810 15:30:05.085198 25664 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46723 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 15:30:05 dist-test-slave-2p8l krb5kdc[25523](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375805, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.190@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.18.68.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.68.189@KRBTEST.COM" created.
I20260810 15:30:05.097128 25667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:30:05.085998 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46723 (local address 127.0.0.1:45198)
0810 15:30:05.086346 (+ 348us) negotiation.cc:107] Waiting for socket to connect
0810 15:30:05.086394 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0810 15:30:05.087157 (+ 763us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:30:05.087599 (+ 442us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:30:05.087602 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:30:05.087864 (+ 262us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:30:05.088028 (+ 164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:30:05.088032 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:30:05.089699 (+ 1667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:30:05.089700 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:30:05.090500 (+ 800us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:30:05.090503 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:30:05.091058 (+ 555us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:30:05.091059 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:30:05.091127 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:30:05.091754 (+ 627us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:30:05.091763 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:30:05.093235 (+ 1472us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:30:05.095337 (+ 2102us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:30:05.095344 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:30:05.095347 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:30:05.095587 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:30:05.095916 (+ 329us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:30:05.095917 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:30:05.095917 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:30:05.096011 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:30:05.096463 (+ 452us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:30:05.096470 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:30:05.096537 (+ 67us) client_negotiation.cc:769] Sending connection context
0810 15:30:05.096661 (+ 124us) client_negotiation.cc:240] Negotiation successful
0810 15:30:05.096937 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":302,"mutex_wait_us":121,"thread_start_us":152,"threads_started":1}
I20260810 15:30:05.097131 25668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:30:05.086050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45198 (local address 127.18.68.190:46723)
0810 15:30:05.086312 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0810 15:30:05.086322 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 15:30:05.086516 (+ 194us) server_negotiation.cc:407] Connection header received
0810 15:30:05.087406 (+ 890us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:30:05.087409 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:30:05.087434 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:30:05.087549 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:30:05.088150 (+ 601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:30:05.089585 (+ 1435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:30:05.090608 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:30:05.090928 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:30:05.091072 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:30:05.093340 (+ 2268us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:30:05.093349 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:30:05.093349 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:30:05.093356 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:30:05.095223 (+ 1867us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:30:05.095736 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:30:05.095740 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:30:05.095741 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:30:05.095843 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:30:05.096103 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:30:05.096104 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:30:05.096105 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:30:05.096379 (+ 274us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:30:05.096486 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0810 15:30:05.096698 (+ 212us) server_negotiation.cc:299] Negotiation successful
0810 15:30:05.096853 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":214,"thread_start_us":154,"threads_started":1}
I20260810 15:30:05.098132 25664 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.68.189" port: 46707 } has no permanent_uuid. Determining permanent_uuid...
I20260810 15:30:05.098547 25667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:30:05.098433 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.189:46707 (local address 127.0.0.1:57760)
0810 15:30:05.098476 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0810 15:30:05.098525 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.189:46707: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":21}
W20260810 15:30:05.098730 25587 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.18.68.189:46707: connect: Connection refused (error 111)
I20260810 15:30:05.099181 25667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:30:05.099085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.189:46707 (local address 127.0.0.1:57774)
0810 15:30:05.099133 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0810 15:30:05.099160 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.189:46707: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260810 15:30:05.099326 25664 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.68.189:46707: Network error: Client connection negotiation failed: client connection to 127.18.68.189:46707: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.68.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.189.keytab.
Entry for principal kudu/127.18.68.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.189.keytab.
I20260810 15:30:05.114174 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786375520124696-18706-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786375520124696-18706-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786375520124696-18706-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786375520124696-18706-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.189:46707
--webserver_interface=127.18.68.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.189.keytab
--principal=kudu/127.18.68.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:43741
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.68.190:46723,127.18.68.189:46707,127.18.68.188:36757
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 15:30:05.148620 25664 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.68.189" port: 46707 } attempt: 1
I20260810 15:30:05.149238 25667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:30:05.149043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.189:46707 (local address 127.0.0.1:57780)
0810 15:30:05.149153 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0810 15:30:05.149203 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.189:46707: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
I20260810 15:30:05.149839 25667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:30:05.149695 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.189:46707 (local address 127.0.0.1:57784)
0810 15:30:05.149781 (+ 86us) negotiation.cc:107] Waiting for socket to connect
0810 15:30:05.149814 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.189:46707: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
W20260810 15:30:05.149996 25664 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.68.189:46707: Network error: Client connection negotiation failed: client connection to 127.18.68.189:46707: connect: Connection refused (error 111)
W20260810 15:30:05.200996 25675 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260810 15:30:05.201218 25675 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:30:05.201237 25675 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:30:05.201259 25675 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:30:05.202404 25675 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 15:30:05.202440 25675 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:30:05.202456 25675 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:30:05.202468 25675 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 15:30:05.202481 25675 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 15:30:05.203966 25675 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:43741
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786375520124696-18706-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786375520124696-18706-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.18.68.190:46723,127.18.68.189:46707,127.18.68.188:36757
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.189.keytab
--principal=kudu/127.18.68.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.189:46707
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786375520124696-18706-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.18.68.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25675
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786375520124696-18706-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:30:05.204177 25675 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:30:05.204355 25675 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:30:05.209458 25689 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:30:05.209467 25688 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:30:05.209455 25693 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:30:05.209734 25675 server_base.cc:1034] running on GCE node
I20260810 15:30:05.210006 25675 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:30:05.210368 25675 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:30:05.211571 25675 hybrid_clock.cc:648] HybridClock initialized: now 1786375805211555 us; error 48 us; skew 500 ppm
Aug 10 15:30:05 dist-test-slave-2p8l krb5kdc[25523](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375805, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:30:05.214285 25675 init.cc:377] Logged in from keytab as kudu/127.18.68.189@KRBTEST.COM (short username kudu)
I20260810 15:30:05.214740 25675 webserver.cc:460] Webserver started at http://127.18.68.189:40613/ using document root <none> and password file <none>
I20260810 15:30:05.214984 25675 fs_manager.cc:359] Metadata directory not provided
I20260810 15:30:05.215059 25675 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:30:05.215201 25675 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:30:05.216300 25675 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786375520124696-18706-0/minicluster-data/master-1/data/instance:
uuid: "6202f1895489472eab95b3ddfe7da4b1"
format_stamp: "Formatted at 2026-08-10 15:30:05 on dist-test-slave-2p8l"
server_key: "6c0cde0bc3b59c5daf0410bec6ba1b7b"
server_key_iv: "6d34455807ac450e86e544f434392717"
server_key_version: "encryptionkey@0"
I20260810 15:30:05.216688 25675 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786375520124696-18706-0/minicluster-data/master-1/wal/instance:
uuid: "6202f1895489472eab95b3ddfe7da4b1"
format_stamp: "Formatted at 2026-08-10 15:30:05 on dist-test-slave-2p8l"
server_key: "6c0cde0bc3b59c5daf0410bec6ba1b7b"
server_key_iv: "6d34455807ac450e86e544f434392717"
server_key_version: "encryptionkey@0"
I20260810 15:30:05.218176 25675 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 15:30:05.218143 25664 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.68.189" port: 46707 } attempt: 2
I20260810 15:30:05.218633 25667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:30:05.218473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.189:46707 (local address 127.0.0.1:57796)
0810 15:30:05.218564 (+ 91us) negotiation.cc:107] Waiting for socket to connect
0810 15:30:05.218603 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.189:46707: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260810 15:30:05.219038 25667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:30:05.218928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.189:46707 (local address 127.0.0.1:57812)
0810 15:30:05.218979 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0810 15:30:05.219011 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.189:46707: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260810 15:30:05.219161 25664 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.68.189:46707: Network error: Client connection negotiation failed: client connection to 127.18.68.189:46707: connect: Connection refused (error 111)
I20260810 15:30:05.219174 25702 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:30:05.219364 25675 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:30:05.219460 25675 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786375520124696-18706-0/minicluster-data/master-1/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786375520124696-18706-0/minicluster-data/master-1/wal
uuid: "6202f1895489472eab95b3ddfe7da4b1"
format_stamp: "Formatted at 2026-08-10 15:30:05 on dist-test-slave-2p8l"
server_key: "6c0cde0bc3b59c5daf0410bec6ba1b7b"
server_key_iv: "6d34455807ac450e86e544f434392717"
server_key_version: "encryptionkey@0"
I20260810 15:30:05.219529 25675 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786375520124696-18706-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786375520124696-18706-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786375520124696-18706-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:30:05.243260 25675 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:30:05.245368 25675 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:30:05.245527 25675 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:30:05.249573 25675 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.189:46707
I20260810 15:30:05.249621 25792 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.189:46707 every 8 connection(s)
I20260810 15:30:05.250025 25675 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786375520124696-18706-0/minicluster-data/master-1/data/info.pb
I20260810 15:30:05.250530 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 25675
I20260810 15:30:05.250622 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786375520124696-18706-0/minicluster-data/master-1/wal/instance
I20260810 15:30:05.250845 18706 external_mini_cluster.cc:1428] Setting key 4626f421e99fb677852e3a94ec903151
I20260810 15:30:05.251372 25793 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:30:05.253003 25793 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46723 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.18.68.188@KRBTEST.COM; defaulting to no policy
Aug 10 15:30:05 dist-test-slave-2p8l krb5kdc[25523](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375805, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.189@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.68.188@KRBTEST.COM" created.
I20260810 15:30:05.262899 25668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:30:05.253777 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45212 (local address 127.18.68.190:46723)
0810 15:30:05.253846 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0810 15:30:05.253848 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:30:05.254115 (+ 267us) server_negotiation.cc:407] Connection header received
0810 15:30:05.254662 (+ 547us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:30:05.254663 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:30:05.254680 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:30:05.254741 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:30:05.255451 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:30:05.255951 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:30:05.257006 (+ 1055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:30:05.257226 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:30:05.257330 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:30:05.259657 (+ 2327us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:30:05.259659 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:30:05.259659 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:30:05.259667 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:30:05.261197 (+ 1530us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:30:05.261751 (+ 554us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:30:05.261752 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:30:05.261752 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:30:05.261816 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:30:05.262156 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:30:05.262157 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:30:05.262158 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:30:05.262312 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:30:05.262382 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0810 15:30:05.262751 (+ 369us) server_negotiation.cc:299] Negotiation successful
0810 15:30:05.262831 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260810 15:30:05.263160 25798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:30:05.253760 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46723 (local address 127.0.0.1:45212)
0810 15:30:05.253963 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0810 15:30:05.254002 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0810 15:30:05.254513 (+ 511us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:30:05.254810 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:30:05.254813 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:30:05.255062 (+ 249us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:30:05.255352 (+ 290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:30:05.255357 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:30:05.256059 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:30:05.256061 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:30:05.256895 (+ 834us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:30:05.256897 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:30:05.257354 (+ 457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:30:05.257355 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:30:05.257484 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:30:05.258038 (+ 554us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:30:05.258047 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:30:05.259535 (+ 1488us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:30:05.261369 (+ 1834us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:30:05.261378 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:30:05.261380 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:30:05.261654 (+ 274us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:30:05.261895 (+ 241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:30:05.261896 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:30:05.261896 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:30:05.262039 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:30:05.262373 (+ 334us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:30:05.262381 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:30:05.262530 (+ 149us) client_negotiation.cc:769] Sending connection context
0810 15:30:05.262681 (+ 151us) client_negotiation.cc:240] Negotiation successful
0810 15:30:05.262876 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":107,"threads_started":1}
I20260810 15:30:05.263922 25793 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.68.189" port: 46707 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 15:30:05 dist-test-slave-2p8l krb5kdc[25523](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375805, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.189@KRBTEST.COM for kudu/127.18.68.189@KRBTEST.COM
I20260810 15:30:05.272475 25798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:30:05.264231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.189:46707 (local address 127.0.0.1:57828)
0810 15:30:05.264287 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0810 15:30:05.264298 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 15:30:05.264341 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:30:05.264664 (+ 323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:30:05.264665 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:30:05.264862 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:30:05.264919 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:30:05.264920 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:30:05.265804 (+ 884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:30:05.265805 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:30:05.266382 (+ 577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:30:05.266385 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:30:05.266946 (+ 561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:30:05.266948 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:30:05.267048 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:30:05.267557 (+ 509us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:30:05.267567 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:30:05.269124 (+ 1557us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:30:05.271366 (+ 2242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:30:05.271366 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:30:05.271367 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:30:05.271539 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:30:05.271787 (+ 248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:30:05.271788 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:30:05.271788 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:30:05.271843 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:30:05.272219 (+ 376us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:30:05.272220 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:30:05.272261 (+ 41us) client_negotiation.cc:769] Sending connection context
0810 15:30:05.272317 (+ 56us) client_negotiation.cc:240] Negotiation successful
0810 15:30:05.272402 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38}
I20260810 15:30:05.272617 25800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:30:05.264330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57828 (local address 127.18.68.189:46707)
0810 15:30:05.264521 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0810 15:30:05.264525 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 15:30:05.264542 (+ 17us) server_negotiation.cc:407] Connection header received
0810 15:30:05.264560 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:30:05.264562 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:30:05.264572 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:30:05.264663 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:30:05.265006 (+ 343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:30:05.265697 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:30:05.266480 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:30:05.266831 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:30:05.266914 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:30:05.269226 (+ 2312us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:30:05.269236 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:30:05.269236 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:30:05.269243 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:30:05.271265 (+ 2022us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:30:05.271643 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:30:05.271648 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:30:05.271648 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:30:05.271714 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:30:05.271923 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:30:05.271924 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:30:05.271924 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:30:05.272139 (+ 215us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:30:05.272240 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0810 15:30:05.272354 (+ 114us) server_negotiation.cc:299] Negotiation successful
0810 15:30:05.272454 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":21,"server-negotiator.queue_time_us":151,"thread_start_us":97,"threads_started":1}
I20260810 15:30:05.273345 25793 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.68.188" port: 36757 } has no permanent_uuid. Determining permanent_uuid...
I20260810 15:30:05.273751 25798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:30:05.273646 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.188:36757 (local address 127.0.0.1:51730)
0810 15:30:05.273680 (+ 34us) negotiation.cc:107] Waiting for socket to connect
0810 15:30:05.273730 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.188:36757: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":18}
W20260810 15:30:05.273902 25706 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.18.68.188:36757: connect: Connection refused (error 111)
I20260810 15:30:05.274451 25798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:30:05.274336 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.188:36757 (local address 127.0.0.1:51732)
0810 15:30:05.274389 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0810 15:30:05.274420 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.188:36757: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260810 15:30:05.274574 25793 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.68.188:36757: Network error: Client connection negotiation failed: client connection to 127.18.68.188:36757: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.68.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.188.keytab.
Entry for principal kudu/127.18.68.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.188.keytab.
I20260810 15:30:05.281744 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786375520124696-18706-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786375520124696-18706-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786375520124696-18706-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786375520124696-18706-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.188:36757
--webserver_interface=127.18.68.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.188.keytab
--principal=kudu/127.18.68.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:43741
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.68.190:46723,127.18.68.189:46707,127.18.68.188:36757
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 15:30:05.310341 25664 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.68.189" port: 46707 } attempt: 3
Aug 10 15:30:05 dist-test-slave-2p8l krb5kdc[25523](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375805, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.190@KRBTEST.COM for kudu/127.18.68.189@KRBTEST.COM
I20260810 15:30:05.318053 25667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:30:05.310837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.189:46707 (local address 127.0.0.1:57840)
0810 15:30:05.310907 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0810 15:30:05.310927 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0810 15:30:05.311010 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:30:05.311168 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:30:05.311170 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:30:05.311360 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:30:05.311432 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:30:05.311434 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:30:05.312157 (+ 723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:30:05.312159 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:30:05.312680 (+ 521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:30:05.312682 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:30:05.313105 (+ 423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:30:05.313106 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:30:05.313196 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:30:05.313702 (+ 506us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:30:05.313718 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:30:05.315103 (+ 1385us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:30:05.316923 (+ 1820us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:30:05.316925 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:30:05.316925 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:30:05.317160 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:30:05.317376 (+ 216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:30:05.317377 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:30:05.317377 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:30:05.317448 (+ 71us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:30:05.317704 (+ 256us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:30:05.317705 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:30:05.317759 (+ 54us) client_negotiation.cc:769] Sending connection context
0810 15:30:05.317830 (+ 71us) client_negotiation.cc:240] Negotiation successful
0810 15:30:05.317948 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43}
I20260810 15:30:05.318190 25800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:30:05.310921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57840 (local address 127.18.68.189:46707)
0810 15:30:05.311015 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0810 15:30:05.311017 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:30:05.311046 (+ 29us) server_negotiation.cc:407] Connection header received
0810 15:30:05.311076 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:30:05.311077 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:30:05.311095 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:30:05.311163 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:30:05.311539 (+ 376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:30:05.312049 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:30:05.312781 (+ 732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:30:05.313016 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:30:05.313106 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:30:05.315218 (+ 2112us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:30:05.315219 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:30:05.315219 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:30:05.315227 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:30:05.316829 (+ 1602us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:30:05.317243 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:30:05.317244 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:30:05.317245 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:30:05.317300 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:30:05.317513 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:30:05.317514 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:30:05.317514 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:30:05.317633 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:30:05.317688 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0810 15:30:05.317860 (+ 172us) server_negotiation.cc:299] Negotiation successful
0810 15:30:05.318036 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260810 15:30:05.318609 25664 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.68.188" port: 36757 } has no permanent_uuid. Determining permanent_uuid...
I20260810 15:30:05.318996 25667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:30:05.318878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.188:36757 (local address 127.0.0.1:51742)
0810 15:30:05.318936 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0810 15:30:05.318972 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.188:36757: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260810 15:30:05.319398 25667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:30:05.319310 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.188:36757 (local address 127.0.0.1:51758)
0810 15:30:05.319357 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0810 15:30:05.319381 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.188:36757: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260810 15:30:05.319518 25664 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.68.188:36757: Network error: Client connection negotiation failed: client connection to 127.18.68.188:36757: connect: Connection refused (error 111)
I20260810 15:30:05.323820 25793 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.68.188" port: 36757 } attempt: 1
I20260810 15:30:05.324218 25798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:30:05.324093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.188:36757 (local address 127.0.0.1:51766)
0810 15:30:05.324152 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0810 15:30:05.324184 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.188:36757: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260810 15:30:05.324565 25798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:30:05.324447 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.188:36757 (local address 127.0.0.1:51778)
0810 15:30:05.324493 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0810 15:30:05.324539 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.188:36757: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260810 15:30:05.324667 25793 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.68.188:36757: Network error: Client connection negotiation failed: client connection to 127.18.68.188:36757: connect: Connection refused (error 111)
I20260810 15:30:05.350669 25664 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.68.188" port: 36757 } attempt: 1
I20260810 15:30:05.351234 25667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:30:05.351075 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.188:36757 (local address 127.0.0.1:51782)
0810 15:30:05.351157 (+ 82us) negotiation.cc:107] Waiting for socket to connect
0810 15:30:05.351201 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.188:36757: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260810 15:30:05.351662 25667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:30:05.351529 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.188:36757 (local address 127.0.0.1:51792)
0810 15:30:05.351605 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0810 15:30:05.351634 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.188:36757: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260810 15:30:05.351770 25664 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.68.188:36757: Network error: Client connection negotiation failed: client connection to 127.18.68.188:36757: connect: Connection refused (error 111)
W20260810 15:30:05.369364 25806 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260810 15:30:05.369626 25806 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:30:05.369658 25806 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:30:05.369701 25806 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:30:05.370849 25806 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 15:30:05.370927 25806 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:30:05.370951 25806 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:30:05.370972 25806 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 15:30:05.371001 25806 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 15:30:05.372493 25806 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:43741
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786375520124696-18706-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786375520124696-18706-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.18.68.190:46723,127.18.68.189:46707,127.18.68.188:36757
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.188.keytab
--principal=kudu/127.18.68.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.188:36757
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786375520124696-18706-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.18.68.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25806
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786375520124696-18706-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:30:05.372788 25806 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:30:05.373029 25806 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:30:05.378461 25821 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:30:05.378450 25817 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:30:05.378697 25806 server_base.cc:1034] running on GCE node
W20260810 15:30:05.378450 25818 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:30:05.379108 25806 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:30:05.379436 25806 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:30:05.380585 25806 hybrid_clock.cc:648] HybridClock initialized: now 1786375805380587 us; error 46 us; skew 500 ppm
Aug 10 15:30:05 dist-test-slave-2p8l krb5kdc[25523](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375805, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:30:05.383315 25806 init.cc:377] Logged in from keytab as kudu/127.18.68.188@KRBTEST.COM (short username kudu)
I20260810 15:30:05.383733 25806 webserver.cc:460] Webserver started at http://127.18.68.188:36587/ using document root <none> and password file <none>
I20260810 15:30:05.383972 25806 fs_manager.cc:359] Metadata directory not provided
I20260810 15:30:05.384020 25806 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:30:05.384166 25806 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:30:05.385398 25806 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786375520124696-18706-0/minicluster-data/master-2/data/instance:
uuid: "302f3ddb90894e52b323ff996228ca93"
format_stamp: "Formatted at 2026-08-10 15:30:05 on dist-test-slave-2p8l"
server_key: "e0c8dc51d76ebbb19ec6b94e9a085609"
server_key_iv: "b5e4b6f2a6268f7472b343da3d659829"
server_key_version: "encryptionkey@0"
I20260810 15:30:05.385788 25806 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786375520124696-18706-0/minicluster-data/master-2/wal/instance:
uuid: "302f3ddb90894e52b323ff996228ca93"
format_stamp: "Formatted at 2026-08-10 15:30:05 on dist-test-slave-2p8l"
server_key: "e0c8dc51d76ebbb19ec6b94e9a085609"
server_key_iv: "b5e4b6f2a6268f7472b343da3d659829"
server_key_version: "encryptionkey@0"
I20260810 15:30:05.387275 25806 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 15:30:05.388195 25833 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:30:05.388461 25806 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:30:05.388576 25806 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786375520124696-18706-0/minicluster-data/master-2/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786375520124696-18706-0/minicluster-data/master-2/wal
uuid: "302f3ddb90894e52b323ff996228ca93"
format_stamp: "Formatted at 2026-08-10 15:30:05 on dist-test-slave-2p8l"
server_key: "e0c8dc51d76ebbb19ec6b94e9a085609"
server_key_iv: "b5e4b6f2a6268f7472b343da3d659829"
server_key_version: "encryptionkey@0"
I20260810 15:30:05.388662 25806 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786375520124696-18706-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786375520124696-18706-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786375520124696-18706-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:30:05.392812 25793 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.68.188" port: 36757 } attempt: 2
I20260810 15:30:05.393292 25798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:30:05.393161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.188:36757 (local address 127.0.0.1:51802)
0810 15:30:05.393225 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0810 15:30:05.393264 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.188:36757: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260810 15:30:05.393648 25798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:30:05.393567 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.188:36757 (local address 127.0.0.1:51808)
0810 15:30:05.393607 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0810 15:30:05.393631 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.188:36757: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260810 15:30:05.393775 25793 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.68.188:36757: Network error: Client connection negotiation failed: client connection to 127.18.68.188:36757: connect: Connection refused (error 111)
I20260810 15:30:05.416903 25806 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:30:05.419487 25806 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:30:05.419706 25806 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:30:05.424067 25806 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.188:36757
I20260810 15:30:05.424109 25921 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.188:36757 every 8 connection(s)
I20260810 15:30:05.424492 25806 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786375520124696-18706-0/minicluster-data/master-2/data/info.pb
I20260810 15:30:05.425557 25922 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:30:05.426918 25664 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.68.188" port: 36757 } attempt: 2
I20260810 15:30:05.427331 25922 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46723 } has no permanent_uuid. Determining permanent_uuid...
I20260810 15:30:05.428143 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 25806
I20260810 15:30:05.428267 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786375520124696-18706-0/minicluster-data/master-2/wal/instance
I20260810 15:30:05.428453 18706 external_mini_cluster.cc:1428] Setting key cae2f67bfd44919bb4ec9364b0227c23
Aug 10 15:30:05 dist-test-slave-2p8l krb5kdc[25523](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375805, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.190@KRBTEST.COM for kudu/127.18.68.188@KRBTEST.COM
Aug 10 15:30:05 dist-test-slave-2p8l krb5kdc[25523](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375805, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.188@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
Aug 10 15:30:05 dist-test-slave-2p8l krb5kdc[25523](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375804, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.68.188@KRBTEST.COM
I20260810 15:30:05.437801 25667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:30:05.427247 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.188:36757 (local address 127.0.0.1:51822)
0810 15:30:05.427311 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0810 15:30:05.427323 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 15:30:05.427369 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:30:05.428518 (+ 1149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:30:05.428520 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:30:05.428704 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:30:05.428748 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:30:05.428750 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:30:05.430458 (+ 1708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:30:05.430459 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:30:05.430998 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:30:05.431000 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:30:05.431541 (+ 541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:30:05.431542 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:30:05.431601 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:30:05.432049 (+ 448us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:30:05.432054 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:30:05.433491 (+ 1437us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:30:05.435991 (+ 2500us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:30:05.435992 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:30:05.435992 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:30:05.436303 (+ 311us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:30:05.436907 (+ 604us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:30:05.436908 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:30:05.436908 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:30:05.436969 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:30:05.437431 (+ 462us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:30:05.437432 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:30:05.437485 (+ 53us) client_negotiation.cc:769] Sending connection context
0810 15:30:05.437568 (+ 83us) client_negotiation.cc:240] Negotiation successful
0810 15:30:05.437671 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40}
I20260810 15:30:05.437992 25668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:30:05.428088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45216 (local address 127.18.68.190:46723)
0810 15:30:05.428133 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0810 15:30:05.428135 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:30:05.428358 (+ 223us) server_negotiation.cc:407] Connection header received
0810 15:30:05.428434 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:30:05.428435 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:30:05.428445 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:30:05.428500 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:30:05.429352 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:30:05.429825 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:30:05.431168 (+ 1343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:30:05.431444 (+ 276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:30:05.431509 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:30:05.434749 (+ 3240us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:30:05.434750 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:30:05.434751 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:30:05.434759 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:30:05.436449 (+ 1690us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:30:05.436833 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:30:05.436834 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:30:05.436834 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:30:05.436893 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:30:05.437192 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:30:05.437193 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:30:05.437193 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:30:05.437380 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:30:05.437444 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0810 15:30:05.437719 (+ 275us) server_negotiation.cc:299] Negotiation successful
0810 15:30:05.437799 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260810 15:30:05.438089 25924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:30:05.427414 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51822 (local address 127.18.68.188:36757)
0810 15:30:05.427615 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0810 15:30:05.427625 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 15:30:05.427651 (+ 26us) server_negotiation.cc:407] Connection header received
0810 15:30:05.428282 (+ 631us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:30:05.428292 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:30:05.428359 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:30:05.428868 (+ 509us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:30:05.429000 (+ 132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:30:05.430360 (+ 1360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:30:05.431087 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:30:05.431449 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:30:05.431575 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:30:05.433597 (+ 2022us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:30:05.433605 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:30:05.433605 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:30:05.433613 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:30:05.435918 (+ 2305us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:30:05.436716 (+ 798us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:30:05.436719 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:30:05.436720 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:30:05.436831 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:30:05.437019 (+ 188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:30:05.437020 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:30:05.437021 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:30:05.437337 (+ 316us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:30:05.437432 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0810 15:30:05.437625 (+ 193us) server_negotiation.cc:299] Negotiation successful
0810 15:30:05.437827 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":148,"thread_start_us":94,"threads_started":1}
I20260810 15:30:05.438138 25926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:30:05.428051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:46723 (local address 127.0.0.1:45216)
0810 15:30:05.428228 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0810 15:30:05.428265 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0810 15:30:05.428376 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:30:05.428572 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:30:05.428576 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:30:05.428996 (+ 420us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:30:05.429239 (+ 243us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:30:05.429245 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:30:05.429927 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:30:05.429928 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:30:05.431088 (+ 1160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:30:05.431089 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:30:05.431799 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:30:05.431800 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:30:05.431898 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:30:05.432927 (+ 1029us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:30:05.432935 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:30:05.434674 (+ 1739us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:30:05.436521 (+ 1847us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:30:05.436528 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:30:05.436531 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:30:05.436748 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:30:05.436985 (+ 237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:30:05.436985 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:30:05.436986 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:30:05.437102 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:30:05.437472 (+ 370us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:30:05.437477 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:30:05.437539 (+ 62us) client_negotiation.cc:769] Sending connection context
0810 15:30:05.437821 (+ 282us) client_negotiation.cc:240] Negotiation successful
0810 15:30:05.437920 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"mutex_wait_us":28,"thread_start_us":66,"threads_started":1}
I20260810 15:30:05.438771 25922 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.68.189" port: 46707 } has no permanent_uuid. Determining permanent_uuid...
I20260810 15:30:05.439873 25664 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2d3e72ffb11942069d6d253383ae2a33: Bootstrap starting.
I20260810 15:30:05.439946 25928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:30:05.429030 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51828 (local address 127.18.68.188:36757)
0810 15:30:05.429180 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0810 15:30:05.429182 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:30:05.429191 (+ 9us) server_negotiation.cc:407] Connection header received
0810 15:30:05.429209 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:30:05.429210 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:30:05.429218 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:30:05.429294 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:30:05.430052 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:30:05.430851 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:30:05.431858 (+ 1007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:30:05.432142 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:30:05.432219 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:30:05.435664 (+ 3445us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:30:05.435665 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:30:05.435665 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:30:05.435672 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:30:05.438674 (+ 3002us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:30:05.439033 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:30:05.439034 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:30:05.439034 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:30:05.439098 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:30:05.439394 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:30:05.439395 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:30:05.439396 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:30:05.439509 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:30:05.439655 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0810 15:30:05.439745 (+ 90us) server_negotiation.cc:299] Negotiation successful
0810 15:30:05.439828 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":43,"server-negotiator.queue_time_us":133,"thread_start_us":92,"threads_started":1}
I20260810 15:30:05.441020 25664 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2d3e72ffb11942069d6d253383ae2a33: Neither blocks nor log segments found. Creating new log.
I20260810 15:30:05.441380 25664 log.cc:824] T 00000000000000000000000000000000 P 2d3e72ffb11942069d6d253383ae2a33: Log is configured to *not* fsync() on all Append() calls
I20260810 15:30:05.442287 25664 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2d3e72ffb11942069d6d253383ae2a33: No bootstrap required, opened a new log
I20260810 15:30:05.444020 25664 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2d3e72ffb11942069d6d253383ae2a33 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e72ffb11942069d6d253383ae2a33" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46723 } } peers { permanent_uuid: "6202f1895489472eab95b3ddfe7da4b1" member_type: VOTER last_known_addr { host: "127.18.68.189" port: 46707 } } peers { permanent_uuid: "302f3ddb90894e52b323ff996228ca93" member_type: VOTER last_known_addr { host: "127.18.68.188" port: 36757 } }
I20260810 15:30:05.444134 25664 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2d3e72ffb11942069d6d253383ae2a33 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d3e72ffb11942069d6d253383ae2a33, State: Initialized, Role: FOLLOWER
I20260810 15:30:05.444224 25664 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2d3e72ffb11942069d6d253383ae2a33 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e72ffb11942069d6d253383ae2a33" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46723 } } peers { permanent_uuid: "6202f1895489472eab95b3ddfe7da4b1" member_type: VOTER last_known_addr { host: "127.18.68.189" port: 46707 } } peers { permanent_uuid: "302f3ddb90894e52b323ff996228ca93" member_type: VOTER last_known_addr { host: "127.18.68.188" port: 36757 } }
I20260810 15:30:05.444579 25664 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2d3e72ffb11942069d6d253383ae2a33 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 15:30:05.444563 25930 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2d3e72ffb11942069d6d253383ae2a33 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e72ffb11942069d6d253383ae2a33" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46723 } } peers { permanent_uuid: "6202f1895489472eab95b3ddfe7da4b1" member_type: VOTER last_known_addr { host: "127.18.68.189" port: 46707 } } peers { permanent_uuid: "302f3ddb90894e52b323ff996228ca93" member_type: VOTER last_known_addr { host: "127.18.68.188" port: 36757 } } }
I20260810 15:30:05.444867 25930 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2d3e72ffb11942069d6d253383ae2a33 [sys.catalog]: This master's current role is: FOLLOWER
Aug 10 15:30:05 dist-test-slave-2p8l krb5kdc[25523](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375804, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
W20260810 15:30:05.447188 25955 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2d3e72ffb11942069d6d253383ae2a33: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 15:30:05.447755 25955 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 15:30:05.449353 25668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:30:05.440725 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45218 (local address 127.18.68.190:46723)
0810 15:30:05.440758 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0810 15:30:05.440759 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 15:30:05.440767 (+ 8us) server_negotiation.cc:407] Connection header received
0810 15:30:05.440786 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:30:05.440787 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:30:05.440795 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:30:05.440848 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:30:05.441512 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:30:05.442238 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:30:05.442988 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:30:05.443267 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:30:05.443345 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:30:05.446433 (+ 3088us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:30:05.446435 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:30:05.446435 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:30:05.446443 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:30:05.448151 (+ 1708us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:30:05.448537 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:30:05.448539 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:30:05.448540 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:30:05.448596 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:30:05.448831 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:30:05.448832 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:30:05.448832 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:30:05.448946 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:30:05.449128 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0810 15:30:05.449167 (+ 39us) server_negotiation.cc:299] Negotiation successful
0810 15:30:05.449243 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260810 15:30:05.447695 25547 master_runner.cc:186] Error getting master registration for 127.18.68.189:46707: OK, instance_id { permanent_uuid: "6202f1895489472eab95b3ddfe7da4b1" instance_seqno: 1786375805248510 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260810 15:30:05.450618 25547 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
Aug 10 15:30:05 dist-test-slave-2p8l krb5kdc[25523](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375805, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.188@KRBTEST.COM for kudu/127.18.68.189@KRBTEST.COM
I20260810 15:30:05.455138 25800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:30:05.439197 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57852 (local address 127.18.68.189:46707)
0810 15:30:05.439248 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0810 15:30:05.439250 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:30:05.441736 (+ 2486us) server_negotiation.cc:407] Connection header received
0810 15:30:05.441832 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:30:05.441833 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:30:05.441844 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:30:05.441873 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:30:05.445047 (+ 3174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:30:05.445695 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:30:05.446732 (+ 1037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:30:05.447045 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:30:05.447094 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:30:05.452139 (+ 5045us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:30:05.452140 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:30:05.452141 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:30:05.452149 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:30:05.453854 (+ 1705us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:30:05.454318 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:30:05.454320 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:30:05.454320 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:30:05.454382 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:30:05.454600 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:30:05.454601 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:30:05.454601 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:30:05.454719 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:30:05.454793 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0810 15:30:05.454969 (+ 176us) server_negotiation.cc:299] Negotiation successful
0810 15:30:05.455040 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260810 15:30:05.455155 25926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:30:05.439060 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.189:46707 (local address 127.0.0.1:57852)
0810 15:30:05.441675 (+ 2615us) negotiation.cc:107] Waiting for socket to connect
0810 15:30:05.441687 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 15:30:05.441762 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:30:05.444680 (+ 2918us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:30:05.444681 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:30:05.444846 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:30:05.444918 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:30:05.444921 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:30:05.445798 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:30:05.445799 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:30:05.446617 (+ 818us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:30:05.446620 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:30:05.447181 (+ 561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:30:05.447182 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:30:05.447255 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:30:05.450327 (+ 3072us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:30:05.450334 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:30:05.452022 (+ 1688us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:30:05.453942 (+ 1920us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:30:05.453943 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:30:05.453944 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:30:05.454228 (+ 284us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:30:05.454453 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:30:05.454454 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:30:05.454455 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:30:05.454518 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:30:05.454798 (+ 280us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:30:05.454799 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:30:05.454846 (+ 47us) client_negotiation.cc:769] Sending connection context
0810 15:30:05.454927 (+ 81us) client_negotiation.cc:240] Negotiation successful
0810 15:30:05.455041 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2597}
Aug 10 15:30:05 dist-test-slave-2p8l krb5kdc[25523](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375804, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.68.189@KRBTEST.COM
I20260810 15:30:05.455760 25922 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.68.188" port: 36757 } has no permanent_uuid. Determining permanent_uuid...
I20260810 15:30:05.459793 25959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:30:05.450144 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57864 (local address 127.18.68.189:46707)
0810 15:30:05.450317 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0810 15:30:05.450319 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:30:05.450328 (+ 9us) server_negotiation.cc:407] Connection header received
0810 15:30:05.450351 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:30:05.450352 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:30:05.450363 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:30:05.451055 (+ 692us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:30:05.451108 (+ 53us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:30:05.451985 (+ 877us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:30:05.452889 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:30:05.453472 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:30:05.453561 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:30:05.456343 (+ 2782us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:30:05.456345 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:30:05.456345 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:30:05.456352 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:30:05.458214 (+ 1862us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:30:05.458619 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:30:05.458621 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:30:05.458621 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:30:05.458677 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:30:05.458908 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:30:05.458909 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:30:05.458910 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:30:05.459048 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:30:05.459600 (+ 552us) server_negotiation.cc:1035] Waiting for connection context
0810 15:30:05.459635 (+ 35us) server_negotiation.cc:299] Negotiation successful
0810 15:30:05.459703 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":114,"threads_started":1}
Aug 10 15:30:05 dist-test-slave-2p8l krb5kdc[25523](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375805, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.188@KRBTEST.COM for kudu/127.18.68.188@KRBTEST.COM
I20260810 15:30:05.462239 18706 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 15:30:05.463326 25928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:30:05.456095 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51830 (local address 127.18.68.188:36757)
0810 15:30:05.456130 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0810 15:30:05.456132 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:30:05.456163 (+ 31us) server_negotiation.cc:407] Connection header received
0810 15:30:05.456232 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:30:05.456232 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:30:05.456241 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:30:05.456294 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:30:05.456559 (+ 265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:30:05.457035 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:30:05.457864 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:30:05.458130 (+ 266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:30:05.458223 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:30:05.460436 (+ 2213us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:30:05.460437 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:30:05.460437 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:30:05.460445 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:30:05.462001 (+ 1556us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:30:05.462384 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:30:05.462385 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:30:05.462386 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:30:05.462451 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:30:05.462669 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:30:05.462669 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:30:05.462670 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:30:05.462862 (+ 192us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:30:05.462938 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0810 15:30:05.463120 (+ 182us) server_negotiation.cc:299] Negotiation successful
0810 15:30:05.463255 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":53,"server-negotiator.queue_time_us":20}
I20260810 15:30:05.463369 25623 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "2d3e72ffb11942069d6d253383ae2a33"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45218
I20260810 15:30:05.463546 25623 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2d3e72ffb11942069d6d253383ae2a33 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260810 15:30:05.463598 25623 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2d3e72ffb11942069d6d253383ae2a33 [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:30:05.464538 25623 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2d3e72ffb11942069d6d253383ae2a33 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e72ffb11942069d6d253383ae2a33" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46723 } } peers { permanent_uuid: "6202f1895489472eab95b3ddfe7da4b1" member_type: VOTER last_known_addr { host: "127.18.68.189" port: 46707 } } peers { permanent_uuid: "302f3ddb90894e52b323ff996228ca93" member_type: VOTER last_known_addr { host: "127.18.68.188" port: 36757 } }
I20260810 15:30:05.464850 25623 leader_election.cc:288] T 00000000000000000000000000000000 P 2d3e72ffb11942069d6d253383ae2a33 [CANDIDATE]: Term 1 election: Requested vote from peers 6202f1895489472eab95b3ddfe7da4b1 (127.18.68.189:46707), 302f3ddb90894e52b323ff996228ca93 (127.18.68.188:36757)
I20260810 15:30:05.464984 25926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:30:05.456070 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.188:36757 (local address 127.0.0.1:51830)
0810 15:30:05.456115 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0810 15:30:05.456126 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 15:30:05.456178 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:30:05.456298 (+ 120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:30:05.456299 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:30:05.456446 (+ 147us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:30:05.456479 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:30:05.456480 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:30:05.457152 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:30:05.457153 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:30:05.457753 (+ 600us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:30:05.457756 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:30:05.458240 (+ 484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:30:05.458241 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:30:05.458292 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:30:05.458812 (+ 520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:30:05.458817 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:30:05.460261 (+ 1444us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:30:05.462091 (+ 1830us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:30:05.462091 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:30:05.462092 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:30:05.462305 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:30:05.462532 (+ 227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:30:05.462533 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:30:05.462533 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:30:05.462597 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:30:05.462947 (+ 350us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:30:05.462948 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:30:05.462995 (+ 47us) client_negotiation.cc:769] Sending connection context
0810 15:30:05.463073 (+ 78us) client_negotiation.cc:240] Negotiation successful
0810 15:30:05.463194 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29}
I20260810 15:30:05.466581 25922 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 302f3ddb90894e52b323ff996228ca93: Bootstrap starting.
I20260810 15:30:05.467427 25922 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 302f3ddb90894e52b323ff996228ca93: Neither blocks nor log segments found. Creating new log.
I20260810 15:30:05.467806 25922 log.cc:824] T 00000000000000000000000000000000 P 302f3ddb90894e52b323ff996228ca93: Log is configured to *not* fsync() on all Append() calls
I20260810 15:30:05.468896 25922 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 302f3ddb90894e52b323ff996228ca93: No bootstrap required, opened a new log
I20260810 15:30:05.473291 25922 raft_consensus.cc:348] T 00000000000000000000000000000000 P 302f3ddb90894e52b323ff996228ca93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e72ffb11942069d6d253383ae2a33" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46723 } } peers { permanent_uuid: "6202f1895489472eab95b3ddfe7da4b1" member_type: VOTER last_known_addr { host: "127.18.68.189" port: 46707 } } peers { permanent_uuid: "302f3ddb90894e52b323ff996228ca93" member_type: VOTER last_known_addr { host: "127.18.68.188" port: 36757 } }
I20260810 15:30:05.473696 25922 raft_consensus.cc:729] T 00000000000000000000000000000000 P 302f3ddb90894e52b323ff996228ca93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 302f3ddb90894e52b323ff996228ca93, State: Initialized, Role: FOLLOWER
I20260810 15:30:05.473939 25922 consensus_queue.cc:260] T 00000000000000000000000000000000 P 302f3ddb90894e52b323ff996228ca93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e72ffb11942069d6d253383ae2a33" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46723 } } peers { permanent_uuid: "6202f1895489472eab95b3ddfe7da4b1" member_type: VOTER last_known_addr { host: "127.18.68.189" port: 46707 } } peers { permanent_uuid: "302f3ddb90894e52b323ff996228ca93" member_type: VOTER last_known_addr { host: "127.18.68.188" port: 36757 } }
I20260810 15:30:05.474678 25922 sys_catalog.cc:564] T 00000000000000000000000000000000 P 302f3ddb90894e52b323ff996228ca93 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 15:30:05.474733 25871 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2d3e72ffb11942069d6d253383ae2a33" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "302f3ddb90894e52b323ff996228ca93"
I20260810 15:30:05.474882 25871 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 302f3ddb90894e52b323ff996228ca93 [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:30:05.475790 25871 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 302f3ddb90894e52b323ff996228ca93 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d3e72ffb11942069d6d253383ae2a33 in term 1.
I20260810 15:30:05.476070 25586 leader_election.cc:302] T 00000000000000000000000000000000 P 2d3e72ffb11942069d6d253383ae2a33 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d3e72ffb11942069d6d253383ae2a33, 302f3ddb90894e52b323ff996228ca93; no voters:
I20260810 15:30:05.476207 25928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:30:05.468071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51844 (local address 127.18.68.188:36757)
0810 15:30:05.468107 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0810 15:30:05.468109 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:30:05.468118 (+ 9us) server_negotiation.cc:407] Connection header received
0810 15:30:05.468148 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:30:05.468149 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:30:05.468159 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:30:05.468217 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:30:05.468971 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:30:05.469664 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:30:05.470693 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:30:05.470966 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:30:05.471010 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:30:05.473077 (+ 2067us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:30:05.473079 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:30:05.473079 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:30:05.473086 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:30:05.474840 (+ 1754us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:30:05.475281 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:30:05.475282 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:30:05.475282 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:30:05.475343 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:30:05.475557 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:30:05.475558 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:30:05.475559 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:30:05.475692 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:30:05.475772 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0810 15:30:05.476014 (+ 242us) server_negotiation.cc:299] Negotiation successful
0810 15:30:05.476107 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260810 15:30:05.476219 25930 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2d3e72ffb11942069d6d253383ae2a33 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 15:30:05.476394 25930 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2d3e72ffb11942069d6d253383ae2a33 [term 1 LEADER]: Becoming Leader. State: Replica: 2d3e72ffb11942069d6d253383ae2a33, State: Running, Role: LEADER
I20260810 15:30:05.476503 25930 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2d3e72ffb11942069d6d253383ae2a33 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e72ffb11942069d6d253383ae2a33" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46723 } } peers { permanent_uuid: "6202f1895489472eab95b3ddfe7da4b1" member_type: VOTER last_known_addr { host: "127.18.68.189" port: 46707 } } peers { permanent_uuid: "302f3ddb90894e52b323ff996228ca93" member_type: VOTER last_known_addr { host: "127.18.68.188" port: 36757 } }
I20260810 15:30:05.476903 25668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:30:05.466671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45228 (local address 127.18.68.190:46723)
0810 15:30:05.466713 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0810 15:30:05.466715 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:30:05.467208 (+ 493us) server_negotiation.cc:407] Connection header received
0810 15:30:05.467306 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:30:05.467308 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:30:05.467320 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:30:05.467376 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:30:05.468137 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:30:05.468947 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:30:05.470030 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:30:05.470353 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:30:05.470398 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:30:05.472033 (+ 1635us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:30:05.472034 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:30:05.472035 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:30:05.472042 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:30:05.473637 (+ 1595us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:30:05.474295 (+ 658us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:30:05.474297 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:30:05.474297 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:30:05.474362 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:30:05.476278 (+ 1916us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:30:05.476279 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:30:05.476279 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:30:05.476428 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:30:05.476501 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0810 15:30:05.476743 (+ 242us) server_negotiation.cc:299] Negotiation successful
0810 15:30:05.476827 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260810 15:30:05.477070 25930 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2d3e72ffb11942069d6d253383ae2a33 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2d3e72ffb11942069d6d253383ae2a33. Latest consensus state: current_term: 1 leader_uuid: "2d3e72ffb11942069d6d253383ae2a33" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e72ffb11942069d6d253383ae2a33" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46723 } } peers { permanent_uuid: "6202f1895489472eab95b3ddfe7da4b1" member_type: VOTER last_known_addr { host: "127.18.68.189" port: 46707 } } peers { permanent_uuid: "302f3ddb90894e52b323ff996228ca93" member_type: VOTER last_known_addr { host: "127.18.68.188" port: 36757 } } }
I20260810 15:30:05.477164 25930 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2d3e72ffb11942069d6d253383ae2a33 [sys.catalog]: This master's current role is: LEADER
I20260810 15:30:05.478324 25970 sys_catalog.cc:455] T 00000000000000000000000000000000 P 302f3ddb90894e52b323ff996228ca93 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e72ffb11942069d6d253383ae2a33" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46723 } } peers { permanent_uuid: "6202f1895489472eab95b3ddfe7da4b1" member_type: VOTER last_known_addr { host: "127.18.68.189" port: 46707 } } peers { permanent_uuid: "302f3ddb90894e52b323ff996228ca93" member_type: VOTER last_known_addr { host: "127.18.68.188" port: 36757 } } }
I20260810 15:30:05.478487 25970 sys_catalog.cc:458] T 00000000000000000000000000000000 P 302f3ddb90894e52b323ff996228ca93 [sys.catalog]: This master's current role is: FOLLOWER
W20260810 15:30:05.478760 25997 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 302f3ddb90894e52b323ff996228ca93: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 15:30:05.478811 25997 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 15:30:05.482193 25979 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 15:30:05.480079 25806 master_runner.cc:186] Error getting master registration for 127.18.68.189:46707: OK, instance_id { permanent_uuid: "6202f1895489472eab95b3ddfe7da4b1" instance_seqno: 1786375805248510 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260810 15:30:05.482358 25806 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260810 15:30:05.483963 25959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:30:05.466960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57878 (local address 127.18.68.189:46707)
0810 15:30:05.466999 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0810 15:30:05.467001 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:30:05.474213 (+ 7212us) server_negotiation.cc:407] Connection header received
0810 15:30:05.474324 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:30:05.474325 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:30:05.474337 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:30:05.474370 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:30:05.475054 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:30:05.475759 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:30:05.478862 (+ 3103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:30:05.479189 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:30:05.479234 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:30:05.480810 (+ 1576us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:30:05.480812 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:30:05.480812 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:30:05.480820 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:30:05.482623 (+ 1803us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:30:05.483016 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:30:05.483017 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:30:05.483018 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:30:05.483085 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:30:05.483322 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:30:05.483323 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:30:05.483323 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:30:05.483468 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:30:05.483576 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0810 15:30:05.483768 (+ 192us) server_negotiation.cc:299] Negotiation successful
0810 15:30:05.483868 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260810 15:30:05.484970 25793 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.68.188" port: 36757 } attempt: 3
Aug 10 15:30:05 dist-test-slave-2p8l krb5kdc[25523](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375805, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.189@KRBTEST.COM for kudu/127.18.68.188@KRBTEST.COM
I20260810 15:30:05.490808 25979 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 15:30:05.492746 25871 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 302f3ddb90894e52b323ff996228ca93 [term 1 FOLLOWER]: Refusing update from remote peer 2d3e72ffb11942069d6d253383ae2a33: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 15:30:05.493453 25971 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 2d3e72ffb11942069d6d253383ae2a33 [LEADER]: Connected to new peer: Peer: permanent_uuid: "302f3ddb90894e52b323ff996228ca93" member_type: VOTER last_known_addr { host: "127.18.68.188" port: 36757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 15:30:05.494501 25798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:30:05.485223 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.188:36757 (local address 127.0.0.1:51858)
0810 15:30:05.485335 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0810 15:30:05.485346 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 15:30:05.485385 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:30:05.485563 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:30:05.485564 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:30:05.485729 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:30:05.485777 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:30:05.485778 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:30:05.486754 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:30:05.486755 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:30:05.487553 (+ 798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:30:05.487555 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:30:05.488079 (+ 524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:30:05.488081 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:30:05.488154 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:30:05.489291 (+ 1137us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:30:05.489296 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:30:05.490924 (+ 1628us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:30:05.493074 (+ 2150us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:30:05.493076 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:30:05.493076 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:30:05.493335 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:30:05.493698 (+ 363us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:30:05.493699 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:30:05.493699 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:30:05.493771 (+ 72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:30:05.494197 (+ 426us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:30:05.494198 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:30:05.494240 (+ 42us) client_negotiation.cc:769] Sending connection context
0810 15:30:05.494308 (+ 68us) client_negotiation.cc:240] Negotiation successful
0810 15:30:05.494402 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":94}
I20260810 15:30:05.495029 25970 sys_catalog.cc:455] T 00000000000000000000000000000000 P 302f3ddb90894e52b323ff996228ca93 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2d3e72ffb11942069d6d253383ae2a33. Latest consensus state: current_term: 1 leader_uuid: "2d3e72ffb11942069d6d253383ae2a33" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e72ffb11942069d6d253383ae2a33" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46723 } } peers { permanent_uuid: "6202f1895489472eab95b3ddfe7da4b1" member_type: VOTER last_known_addr { host: "127.18.68.189" port: 46707 } } peers { permanent_uuid: "302f3ddb90894e52b323ff996228ca93" member_type: VOTER last_known_addr { host: "127.18.68.188" port: 36757 } } }
I20260810 15:30:05.495131 25970 sys_catalog.cc:458] T 00000000000000000000000000000000 P 302f3ddb90894e52b323ff996228ca93 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 15:30:05.495534 25928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:30:05.485367 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51858 (local address 127.18.68.188:36757)
0810 15:30:05.485459 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0810 15:30:05.485461 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:30:05.485468 (+ 7us) server_negotiation.cc:407] Connection header received
0810 15:30:05.485487 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:30:05.485488 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:30:05.485497 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:30:05.485549 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:30:05.485869 (+ 320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:30:05.486662 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:30:05.487645 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:30:05.487945 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:30:05.488019 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:30:05.491010 (+ 2991us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:30:05.491012 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:30:05.491012 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:30:05.491020 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:30:05.492984 (+ 1964us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:30:05.493419 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:30:05.493420 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:30:05.493421 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:30:05.493496 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:30:05.493910 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:30:05.493911 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:30:05.493912 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:30:05.494051 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:30:05.494166 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0810 15:30:05.495365 (+ 1199us) server_negotiation.cc:299] Negotiation successful
0810 15:30:05.495446 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260810 15:30:05.497229 25793 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6202f1895489472eab95b3ddfe7da4b1: Bootstrap starting.
I20260810 15:30:05.497997 25793 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6202f1895489472eab95b3ddfe7da4b1: Neither blocks nor log segments found. Creating new log.
I20260810 15:30:05.498375 25793 log.cc:824] T 00000000000000000000000000000000 P 6202f1895489472eab95b3ddfe7da4b1: Log is configured to *not* fsync() on all Append() calls
I20260810 15:30:05.499126 25793 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6202f1895489472eab95b3ddfe7da4b1: No bootstrap required, opened a new log
I20260810 15:30:05.501170 25793 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6202f1895489472eab95b3ddfe7da4b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e72ffb11942069d6d253383ae2a33" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46723 } } peers { permanent_uuid: "6202f1895489472eab95b3ddfe7da4b1" member_type: VOTER last_known_addr { host: "127.18.68.189" port: 46707 } } peers { permanent_uuid: "302f3ddb90894e52b323ff996228ca93" member_type: VOTER last_known_addr { host: "127.18.68.188" port: 36757 } }
I20260810 15:30:05.501325 25793 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6202f1895489472eab95b3ddfe7da4b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6202f1895489472eab95b3ddfe7da4b1, State: Initialized, Role: FOLLOWER
I20260810 15:30:05.501410 25793 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6202f1895489472eab95b3ddfe7da4b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e72ffb11942069d6d253383ae2a33" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46723 } } peers { permanent_uuid: "6202f1895489472eab95b3ddfe7da4b1" member_type: VOTER last_known_addr { host: "127.18.68.189" port: 46707 } } peers { permanent_uuid: "302f3ddb90894e52b323ff996228ca93" member_type: VOTER last_known_addr { host: "127.18.68.188" port: 36757 } }
I20260810 15:30:05.501713 25793 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6202f1895489472eab95b3ddfe7da4b1 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 15:30:05.501802 25742 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6202f1895489472eab95b3ddfe7da4b1 [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:30:05.502772 25742 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 6202f1895489472eab95b3ddfe7da4b1 [term 1 FOLLOWER]: Refusing update from remote peer 2d3e72ffb11942069d6d253383ae2a33: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 15:30:05.502966 25744 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2d3e72ffb11942069d6d253383ae2a33" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "6202f1895489472eab95b3ddfe7da4b1"
I20260810 15:30:05.503444 25971 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2d3e72ffb11942069d6d253383ae2a33 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "2d3e72ffb11942069d6d253383ae2a33" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e72ffb11942069d6d253383ae2a33" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46723 } } peers { permanent_uuid: "6202f1895489472eab95b3ddfe7da4b1" member_type: VOTER last_known_addr { host: "127.18.68.189" port: 46707 } } peers { permanent_uuid: "302f3ddb90894e52b323ff996228ca93" member_type: VOTER last_known_addr { host: "127.18.68.188" port: 36757 } } }
I20260810 15:30:05.503535 25971 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2d3e72ffb11942069d6d253383ae2a33 [sys.catalog]: This master's current role is: LEADER
I20260810 15:30:05.503679 26000 mvcc.cc:205] Tried to move back new op lower bound from 7316995299295182848 to 7316995299232763904. Current Snapshot: MvccSnapshot[applied={T|T < 7316995299295182848}]
I20260810 15:30:05.503799 25744 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 6202f1895489472eab95b3ddfe7da4b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d3e72ffb11942069d6d253383ae2a33 in term 1.
I20260810 15:30:05.504130 25970 sys_catalog.cc:455] T 00000000000000000000000000000000 P 302f3ddb90894e52b323ff996228ca93 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "2d3e72ffb11942069d6d253383ae2a33" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e72ffb11942069d6d253383ae2a33" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46723 } } peers { permanent_uuid: "6202f1895489472eab95b3ddfe7da4b1" member_type: VOTER last_known_addr { host: "127.18.68.189" port: 46707 } } peers { permanent_uuid: "302f3ddb90894e52b323ff996228ca93" member_type: VOTER last_known_addr { host: "127.18.68.188" port: 36757 } } }
I20260810 15:30:05.504242 25970 sys_catalog.cc:458] T 00000000000000000000000000000000 P 302f3ddb90894e52b323ff996228ca93 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 15:30:05.504103 26001 mvcc.cc:205] Tried to move back new op lower bound from 7316995299295182848 to 7316995299232763904. Current Snapshot: MvccSnapshot[applied={T|T < 7316995299295182848}]
I20260810 15:30:05.504269 25971 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 2d3e72ffb11942069d6d253383ae2a33 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6202f1895489472eab95b3ddfe7da4b1" member_type: VOTER last_known_addr { host: "127.18.68.189" port: 46707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 15:30:05.505518 25979 catalog_manager.cc:1347] Generated new cluster ID: cf77ae235baa49ddafc4103eada1050d
I20260810 15:30:05.505568 25979 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 15:30:05.504441 26006 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6202f1895489472eab95b3ddfe7da4b1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e72ffb11942069d6d253383ae2a33" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46723 } } peers { permanent_uuid: "6202f1895489472eab95b3ddfe7da4b1" member_type: VOTER last_known_addr { host: "127.18.68.189" port: 46707 } } peers { permanent_uuid: "302f3ddb90894e52b323ff996228ca93" member_type: VOTER last_known_addr { host: "127.18.68.188" port: 36757 } } }
I20260810 15:30:05.507330 26006 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6202f1895489472eab95b3ddfe7da4b1 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 15:30:05.507388 26006 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6202f1895489472eab95b3ddfe7da4b1 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "2d3e72ffb11942069d6d253383ae2a33" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e72ffb11942069d6d253383ae2a33" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46723 } } peers { permanent_uuid: "6202f1895489472eab95b3ddfe7da4b1" member_type: VOTER last_known_addr { host: "127.18.68.189" port: 46707 } } peers { permanent_uuid: "302f3ddb90894e52b323ff996228ca93" member_type: VOTER last_known_addr { host: "127.18.68.188" port: 36757 } } }
I20260810 15:30:05.507441 26006 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6202f1895489472eab95b3ddfe7da4b1 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 15:30:05.506162 26033 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6202f1895489472eab95b3ddfe7da4b1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2d3e72ffb11942069d6d253383ae2a33. Latest consensus state: current_term: 1 leader_uuid: "2d3e72ffb11942069d6d253383ae2a33" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e72ffb11942069d6d253383ae2a33" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46723 } } peers { permanent_uuid: "6202f1895489472eab95b3ddfe7da4b1" member_type: VOTER last_known_addr { host: "127.18.68.189" port: 46707 } } peers { permanent_uuid: "302f3ddb90894e52b323ff996228ca93" member_type: VOTER last_known_addr { host: "127.18.68.188" port: 36757 } } }
I20260810 15:30:05.508049 26033 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6202f1895489472eab95b3ddfe7da4b1 [sys.catalog]: This master's current role is: FOLLOWER
W20260810 15:30:05.514361 26034 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 6202f1895489472eab95b3ddfe7da4b1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 15:30:05.514487 26034 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 15:30:05.516418 26030 mvcc.cc:205] Tried to move back new op lower bound from 7316995299295182848 to 7316995299232763904. Current Snapshot: MvccSnapshot[applied={T|T < 7316995299295182848}]
I20260810 15:30:05.540119 25930 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2d3e72ffb11942069d6d253383ae2a33 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "2d3e72ffb11942069d6d253383ae2a33" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d3e72ffb11942069d6d253383ae2a33" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 46723 } } peers { permanent_uuid: "6202f1895489472eab95b3ddfe7da4b1" member_type: VOTER last_known_addr { host: "127.18.68.189" port: 46707 } } peers { permanent_uuid: "302f3ddb90894e52b323ff996228ca93" member_type: VOTER last_known_addr { host: "127.18.68.188" port: 36757 } } }
I20260810 15:30:05.540289 25930 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2d3e72ffb11942069d6d253383ae2a33 [sys.catalog]: This master's current role is: LEADER
I20260810 15:30:05.544214 25979 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 15:30:05.545027 25979 catalog_manager.cc:1504] Loading token signing keys...
I20260810 15:30:05.552956 25979 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2d3e72ffb11942069d6d253383ae2a33: Generated new TSK 0
I20260810 15:30:05.553169 25979 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260810 15:30:05.582882 25668 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 15:30:05.580826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45230 (local address 127.18.68.190:46723)
0810 15:30:05.580879 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0810 15:30:05.580881 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:30:05.582034 (+ 1153us) server_negotiation.cc:407] Connection header received
0810 15:30:05.582191 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:30:05.582193 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:30:05.582205 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:30:05.582241 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:30:05.582798 (+ 557us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45230: BlockingRecv error: recv got EOF from 127.0.0.1:45230 (error 108)
Metrics: {"server-negotiator.queue_time_us":26}
W20260810 15:30:05.584005 25959 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 15:30:05.581283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57886 (local address 127.18.68.189:46707)
0810 15:30:05.581329 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0810 15:30:05.581332 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 15:30:05.583324 (+ 1992us) server_negotiation.cc:407] Connection header received
0810 15:30:05.583441 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:30:05.583442 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:30:05.583456 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:30:05.583491 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:30:05.583939 (+ 448us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57886: BlockingRecv error: recv got EOF from 127.0.0.1:57886 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
W20260810 15:30:05.585168 25928 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 15:30:05.581680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51864 (local address 127.18.68.188:36757)
0810 15:30:05.581724 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0810 15:30:05.581726 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:30:05.584381 (+ 2655us) server_negotiation.cc:407] Connection header received
0810 15:30:05.584651 (+ 270us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:30:05.584652 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:30:05.584665 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:30:05.584701 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:30:05.585106 (+ 405us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51864: BlockingRecv error: recv got EOF from 127.0.0.1:51864 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
W20260810 15:30:05.588265 25959 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 15:30:05.587363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57896 (local address 127.18.68.189:46707)
0810 15:30:05.587404 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0810 15:30:05.587406 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:30:05.587648 (+ 242us) server_negotiation.cc:407] Connection header received
0810 15:30:05.587772 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:30:05.587774 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:30:05.587796 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:30:05.587831 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:30:05.588207 (+ 376us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57896: BlockingRecv error: recv got EOF from 127.0.0.1:57896 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260810 15:30:05.591949 25959 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 15:30:05.590892 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57904 (local address 127.18.68.189:46707)
0810 15:30:05.590933 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0810 15:30:05.590935 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:30:05.591287 (+ 352us) server_negotiation.cc:407] Connection header received
0810 15:30:05.591416 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:30:05.591417 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:30:05.591430 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:30:05.591465 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:30:05.591895 (+ 430us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57904: BlockingRecv error: recv got EOF from 127.0.0.1:57904 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260810 15:30:05.596333 25959 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 15:30:05.595314 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57912 (local address 127.18.68.189:46707)
0810 15:30:05.595357 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0810 15:30:05.595360 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 15:30:05.595682 (+ 322us) server_negotiation.cc:407] Connection header received
0810 15:30:05.595824 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:30:05.595826 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:30:05.595837 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:30:05.595871 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:30:05.596276 (+ 405us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57912: BlockingRecv error: recv got EOF from 127.0.0.1:57912 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260810 15:30:05.603034 25959 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 15:30:05.601916 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57922 (local address 127.18.68.189:46707)
0810 15:30:05.601956 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0810 15:30:05.601958 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:30:05.602305 (+ 347us) server_negotiation.cc:407] Connection header received
0810 15:30:05.602421 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:30:05.602422 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:30:05.602434 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:30:05.602470 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:30:05.602972 (+ 502us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57922: BlockingRecv error: recv got EOF from 127.0.0.1:57922 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260810 15:30:05.613505 25959 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 15:30:05.612535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57930 (local address 127.18.68.189:46707)
0810 15:30:05.612582 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0810 15:30:05.612585 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 15:30:05.612887 (+ 302us) server_negotiation.cc:407] Connection header received
0810 15:30:05.612999 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:30:05.613000 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:30:05.613013 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:30:05.613050 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:30:05.613446 (+ 396us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57930: BlockingRecv error: recv got EOF from 127.0.0.1:57930 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
W20260810 15:30:05.632321 25959 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 15:30:05.631223 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57942 (local address 127.18.68.189:46707)
0810 15:30:05.631275 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0810 15:30:05.631277 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:30:05.631632 (+ 355us) server_negotiation.cc:407] Connection header received
0810 15:30:05.631752 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:30:05.631754 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:30:05.631768 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:30:05.631803 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:30:05.632252 (+ 449us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57942: BlockingRecv error: recv got EOF from 127.0.0.1:57942 (error 108)
Metrics: {"server-negotiator.queue_time_us":27}
W20260810 15:30:05.666762 25959 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 15:30:05.665921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57946 (local address 127.18.68.189:46707)
0810 15:30:05.665973 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0810 15:30:05.665975 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:30:05.666155 (+ 180us) server_negotiation.cc:407] Connection header received
0810 15:30:05.666233 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:30:05.666234 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:30:05.666246 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:30:05.666329 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:30:05.666702 (+ 373us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57946: BlockingRecv error: recv got EOF from 127.0.0.1:57946 (error 108)
Metrics: {"server-negotiator.queue_time_us":26}
W20260810 15:30:05.732929 25959 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 15:30:05.732112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57960 (local address 127.18.68.189:46707)
0810 15:30:05.732204 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0810 15:30:05.732207 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 15:30:05.732275 (+ 68us) server_negotiation.cc:407] Connection header received
0810 15:30:05.732323 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:30:05.732325 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:30:05.732336 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:30:05.732405 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:30:05.732817 (+ 412us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57960: BlockingRecv error: recv got EOF from 127.0.0.1:57960 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
W20260810 15:30:05.863314 25959 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 15:30:05.862337 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57974 (local address 127.18.68.189:46707)
0810 15:30:05.862449 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0810 15:30:05.862452 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 15:30:05.862588 (+ 136us) server_negotiation.cc:407] Connection header received
0810 15:30:05.862710 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:30:05.862711 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:30:05.862725 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:30:05.862791 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:30:05.863244 (+ 453us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57974: BlockingRecv error: recv got EOF from 127.0.0.1:57974 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
W20260810 15:30:06.121515 25959 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 15:30:06.120741 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57980 (local address 127.18.68.189:46707)
0810 15:30:06.120836 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0810 15:30:06.120838 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:30:06.120850 (+ 12us) server_negotiation.cc:407] Connection header received
0810 15:30:06.120920 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:30:06.120921 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:30:06.120933 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:30:06.121004 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:30:06.121416 (+ 412us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57980: BlockingRecv error: recv got EOF from 127.0.0.1:57980 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
I20260810 15:30:06.479300 25997 catalog_manager.cc:1259] Loaded cluster ID: cf77ae235baa49ddafc4103eada1050d
I20260810 15:30:06.479396 25997 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 302f3ddb90894e52b323ff996228ca93: loading cluster ID for follower catalog manager: success
I20260810 15:30:06.480331 25997 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 302f3ddb90894e52b323ff996228ca93: acquiring CA information for follower catalog manager: success
I20260810 15:30:06.480721 25997 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 302f3ddb90894e52b323ff996228ca93: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260810 15:30:06.515959 26034 catalog_manager.cc:1259] Loaded cluster ID: cf77ae235baa49ddafc4103eada1050d
I20260810 15:30:06.516052 26034 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 6202f1895489472eab95b3ddfe7da4b1: loading cluster ID for follower catalog manager: success
I20260810 15:30:06.516866 26034 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 6202f1895489472eab95b3ddfe7da4b1: acquiring CA information for follower catalog manager: success
I20260810 15:30:06.517153 26034 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 6202f1895489472eab95b3ddfe7da4b1: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260810 15:30:06.637900 26140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:30:06.635174 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60344 (local address 127.18.68.189:46707)
0810 15:30:06.635291 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0810 15:30:06.635292 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 15:30:06.635302 (+ 10us) server_negotiation.cc:407] Connection header received
0810 15:30:06.635329 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:30:06.635329 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:30:06.635382 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:30:06.635471 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 15:30:06.635651 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:30:06.636146 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:30:06.636955 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:30:06.637161 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:30:06.637218 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:30:06.637437 (+ 219us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 15:30:06.637597 (+ 160us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 15:30:06.637684 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0810 15:30:06.637803 (+ 119us) server_negotiation.cc:299] Negotiation successful
0810 15:30:06.637826 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97,"thread_start_us":66,"threads_started":1}
I20260810 15:30:06.642666 26150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:30:06.640268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47144 (local address 127.18.68.188:36757)
0810 15:30:06.640403 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0810 15:30:06.640405 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:30:06.640414 (+ 9us) server_negotiation.cc:407] Connection header received
0810 15:30:06.640460 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:30:06.640461 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:30:06.640506 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:30:06.640578 (+ 72us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 15:30:06.640692 (+ 114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:30:06.641199 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:30:06.641890 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:30:06.642147 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:30:06.642197 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:30:06.642328 (+ 131us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 15:30:06.642429 (+ 101us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 15:30:06.642486 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0810 15:30:06.642530 (+ 44us) server_negotiation.cc:299] Negotiation successful
0810 15:30:06.642547 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":111,"thread_start_us":86,"threads_started":1}
I20260810 15:30:06.647557 26140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:30:06.644624 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60356 (local address 127.18.68.189:46707)
0810 15:30:06.644713 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0810 15:30:06.644715 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:30:06.644919 (+ 204us) server_negotiation.cc:407] Connection header received
0810 15:30:06.644981 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:30:06.644981 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:30:06.644993 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:30:06.645041 (+ 48us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 15:30:06.645267 (+ 226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:30:06.646003 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:30:06.646794 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:30:06.647005 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:30:06.647097 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:30:06.647265 (+ 168us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 15:30:06.647300 (+ 35us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 15:30:06.647347 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0810 15:30:06.647445 (+ 98us) server_negotiation.cc:299] Negotiation successful
0810 15:30:06.647470 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260810 15:30:06.647879 26150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:30:06.644616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47148 (local address 127.18.68.188:36757)
0810 15:30:06.644693 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0810 15:30:06.644695 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:30:06.644726 (+ 31us) server_negotiation.cc:407] Connection header received
0810 15:30:06.644820 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:30:06.644822 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:30:06.644834 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:30:06.644885 (+ 51us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 15:30:06.645059 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:30:06.645600 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:30:06.646795 (+ 1195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:30:06.647088 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:30:06.647153 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:30:06.647307 (+ 154us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 15:30:06.647342 (+ 35us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 15:30:06.647389 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0810 15:30:06.647767 (+ 378us) server_negotiation.cc:299] Negotiation successful
0810 15:30:06.647790 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260810 15:30:06.648164 26165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:30:06.644574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40556 (local address 127.18.68.190:46723)
0810 15:30:06.644764 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0810 15:30:06.644767 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 15:30:06.644776 (+ 9us) server_negotiation.cc:407] Connection header received
0810 15:30:06.644823 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:30:06.644824 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:30:06.644901 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:30:06.644984 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 15:30:06.645152 (+ 168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:30:06.645996 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:30:06.647069 (+ 1073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:30:06.647389 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:30:06.647449 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:30:06.647702 (+ 253us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 15:30:06.647813 (+ 111us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 15:30:06.647884 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0810 15:30:06.648046 (+ 162us) server_negotiation.cc:299] Negotiation successful
0810 15:30:06.648072 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":171,"thread_start_us":70,"threads_started":1}
I20260810 15:30:06.650113 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 25547
I20260810 15:30:06.667447 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 25675
I20260810 15:30:06.684134 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 25806
2026-08-10T15:30:06Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (3218 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786375520124696-18706-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 15:30:06 dist-test-slave-2p8l krb5kdc[26173](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 15:30:06 dist-test-slave-2p8l krb5kdc[26173](info): set up 2 sockets
Aug 10 15:30:06 dist-test-slave-2p8l krb5kdc[26173](info): commencing operation
krb5kdc: starting...
W20260810 15:30:08.047760 18706 mini_kdc.cc:121] Time spent starting KDC: real 1.333s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786375520124696-18706-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786375520124696-18706-0/krb5kdc/test-user.keytab.
Aug 10 15:30:08 dist-test-slave-2p8l krb5kdc[26173](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375808, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T15:30:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T15:30:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.18.68.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.68.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.68.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab.
Entry for principal kudu/127.18.68.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab.
I20260810 15:30:08.183377 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786375520124696-18706-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786375520124696-18706-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786375520124696-18706-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.190:39071
--webserver_interface=127.18.68.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab
--principal=kudu/127.18.68.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:35973
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.68.190:39071,127.18.68.189:34095,127.18.68.188:41393
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 15:30:08.267904 26201 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260810 15:30:08.268182 26201 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:30:08.268216 26201 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:30:08.268258 26201 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:30:08.269415 26201 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 15:30:08.269491 26201 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:30:08.269515 26201 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:30:08.269536 26201 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 15:30:08.269567 26201 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 15:30:08.271143 26201 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:35973
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786375520124696-18706-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786375520124696-18706-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.18.68.190:39071,127.18.68.189:34095,127.18.68.188:41393
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.190.keytab
--principal=kudu/127.18.68.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.190:39071
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.18.68.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26201
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786375520124696-18706-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:30:08.271445 26201 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:30:08.271713 26201 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:30:08.276889 26209 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:30:08.276930 26211 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:30:08.276924 26214 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:30:08.277168 26201 server_base.cc:1034] running on GCE node
I20260810 15:30:08.277442 26201 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:30:08.277752 26201 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:30:08.278924 26201 hybrid_clock.cc:648] HybridClock initialized: now 1786375808278910 us; error 32 us; skew 500 ppm
Aug 10 15:30:08 dist-test-slave-2p8l krb5kdc[26173](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375808, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:30:08.281553 26201 init.cc:377] Logged in from keytab as kudu/127.18.68.190@KRBTEST.COM (short username kudu)
I20260810 15:30:08.282168 26201 webserver.cc:460] Webserver started at http://127.18.68.190:39833/ using document root <none> and password file <none>
I20260810 15:30:08.282429 26201 fs_manager.cc:359] Metadata directory not provided
I20260810 15:30:08.282505 26201 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:30:08.282661 26201 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:30:08.283739 26201 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786375520124696-18706-0/minicluster-data/master-0/data/instance:
uuid: "8008b5ca622d4202a835e00d32233979"
format_stamp: "Formatted at 2026-08-10 15:30:08 on dist-test-slave-2p8l"
server_key: "d8394c16d806200c5bafeb031dbbab61"
server_key_iv: "2ab32ed1677383e57c0dc9ddf468d6b0"
server_key_version: "encryptionkey@0"
I20260810 15:30:08.284116 26201 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786375520124696-18706-0/minicluster-data/master-0/wal/instance:
uuid: "8008b5ca622d4202a835e00d32233979"
format_stamp: "Formatted at 2026-08-10 15:30:08 on dist-test-slave-2p8l"
server_key: "d8394c16d806200c5bafeb031dbbab61"
server_key_iv: "2ab32ed1677383e57c0dc9ddf468d6b0"
server_key_version: "encryptionkey@0"
I20260810 15:30:08.285519 26201 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 15:30:08.286345 26229 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:30:08.286525 26201 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 15:30:08.286650 26201 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786375520124696-18706-0/minicluster-data/master-0/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786375520124696-18706-0/minicluster-data/master-0/wal
uuid: "8008b5ca622d4202a835e00d32233979"
format_stamp: "Formatted at 2026-08-10 15:30:08 on dist-test-slave-2p8l"
server_key: "d8394c16d806200c5bafeb031dbbab61"
server_key_iv: "2ab32ed1677383e57c0dc9ddf468d6b0"
server_key_version: "encryptionkey@0"
I20260810 15:30:08.286742 26201 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786375520124696-18706-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786375520124696-18706-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786375520124696-18706-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:30:08.304916 26201 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:30:08.307447 26201 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:30:08.307637 26201 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:30:08.312129 26201 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.190:39071
I20260810 15:30:08.312168 26329 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.190:39071 every 8 connection(s)
I20260810 15:30:08.312573 26201 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786375520124696-18706-0/minicluster-data/master-0/data/info.pb
I20260810 15:30:08.313571 26330 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:30:08.315376 26330 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.68.190" port: 39071 } has no permanent_uuid. Determining permanent_uuid...
I20260810 15:30:08.319856 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 26201
I20260810 15:30:08.320004 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786375520124696-18706-0/minicluster-data/master-0/wal/instance
I20260810 15:30:08.320255 18706 external_mini_cluster.cc:1428] Setting key f213663cf22c0a267185c1293791814b
Aug 10 15:30:08 dist-test-slave-2p8l krb5kdc[26173](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375808, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.190@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
I20260810 15:30:08.326612 26334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:30:08.316195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57484 (local address 127.18.68.190:39071)
0810 15:30:08.316350 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0810 15:30:08.316354 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 15:30:08.316393 (+ 39us) server_negotiation.cc:407] Connection header received
0810 15:30:08.316964 (+ 571us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:30:08.316966 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:30:08.316983 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:30:08.317061 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:30:08.317631 (+ 570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:30:08.318651 (+ 1020us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:30:08.319506 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:30:08.319842 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:30:08.319930 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:30:08.322868 (+ 2938us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:30:08.322876 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:30:08.322876 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:30:08.322883 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:30:08.324613 (+ 1730us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:30:08.325230 (+ 617us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:30:08.325234 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:30:08.325234 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:30:08.325324 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:30:08.325650 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:30:08.325651 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:30:08.325651 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:30:08.325916 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:30:08.325984 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0810 15:30:08.326315 (+ 331us) server_negotiation.cc:299] Negotiation successful
0810 15:30:08.326427 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":85,"threads_started":1}
I20260810 15:30:08.326768 26333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:30:08.316087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:39071 (local address 127.0.0.1:57484)
0810 15:30:08.316248 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0810 15:30:08.316300 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0810 15:30:08.316818 (+ 518us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:30:08.317092 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:30:08.317094 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:30:08.317348 (+ 254us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:30:08.317506 (+ 158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:30:08.317509 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:30:08.318744 (+ 1235us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:30:08.318745 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:30:08.319412 (+ 667us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:30:08.319414 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:30:08.319964 (+ 550us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:30:08.319966 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:30:08.320065 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:30:08.320741 (+ 676us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:30:08.320751 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:30:08.322757 (+ 2006us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:30:08.324722 (+ 1965us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:30:08.324731 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:30:08.324734 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:30:08.325102 (+ 368us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:30:08.325416 (+ 314us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:30:08.325417 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:30:08.325418 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:30:08.325565 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:30:08.326007 (+ 442us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:30:08.326016 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:30:08.326148 (+ 132us) client_negotiation.cc:769] Sending connection context
0810 15:30:08.326278 (+ 130us) client_negotiation.cc:240] Negotiation successful
0810 15:30:08.326556 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"mutex_wait_us":72,"thread_start_us":75,"threads_started":1}
I20260810 15:30:08.327657 26330 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.68.189" port: 34095 } has no permanent_uuid. Determining permanent_uuid...
I20260810 15:30:08.328101 26333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:30:08.327930 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.189:34095 (local address 127.0.0.1:49654)
0810 15:30:08.327994 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0810 15:30:08.328069 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.189:34095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260810 15:30:08.328317 26234 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.18.68.189:34095: connect: Connection refused (error 111)
I20260810 15:30:08.328945 26333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:30:08.328810 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.189:34095 (local address 127.0.0.1:49670)
0810 15:30:08.328875 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0810 15:30:08.328911 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.189:34095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260810 15:30:08.329159 26330 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.68.189:34095: Network error: Client connection negotiation failed: client connection to 127.18.68.189:34095: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.18.68.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.68.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.68.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.189.keytab.
Entry for principal kudu/127.18.68.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.189.keytab.
I20260810 15:30:08.352928 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786375520124696-18706-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786375520124696-18706-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786375520124696-18706-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786375520124696-18706-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.189:34095
--webserver_interface=127.18.68.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.189.keytab
--principal=kudu/127.18.68.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:35973
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.68.190:39071,127.18.68.189:34095,127.18.68.188:41393
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 15:30:08.378419 26330 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.68.189" port: 34095 } attempt: 1
I20260810 15:30:08.378983 26333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:30:08.378824 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.189:34095 (local address 127.0.0.1:49682)
0810 15:30:08.378895 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0810 15:30:08.378944 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.189:34095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260810 15:30:08.379408 26333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:30:08.379314 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.189:34095 (local address 127.0.0.1:49686)
0810 15:30:08.379363 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0810 15:30:08.379391 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.189:34095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260810 15:30:08.379555 26330 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.68.189:34095: Network error: Client connection negotiation failed: client connection to 127.18.68.189:34095: connect: Connection refused (error 111)
W20260810 15:30:08.438417 26338 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260810 15:30:08.438683 26338 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:30:08.438715 26338 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:30:08.438756 26338 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:30:08.439908 26338 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 15:30:08.439986 26338 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:30:08.440011 26338 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:30:08.440032 26338 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 15:30:08.440061 26338 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 15:30:08.441569 26338 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:35973
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786375520124696-18706-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786375520124696-18706-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.18.68.190:39071,127.18.68.189:34095,127.18.68.188:41393
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.189.keytab
--principal=kudu/127.18.68.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.189:34095
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786375520124696-18706-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.18.68.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26338
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786375520124696-18706-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:30:08.441862 26338 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:30:08.442122 26338 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:30:08.447482 26348 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:30:08.447489 26350 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:30:08.447654 26338 server_base.cc:1034] running on GCE node
W20260810 15:30:08.447480 26346 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:30:08.447698 26330 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.68.189" port: 34095 } attempt: 2
I20260810 15:30:08.448132 26333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:30:08.447971 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.189:34095 (local address 127.0.0.1:49692)
0810 15:30:08.448050 (+ 79us) negotiation.cc:107] Waiting for socket to connect
0810 15:30:08.448095 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.189:34095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260810 15:30:08.448118 26338 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:30:08.448520 26338 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:30:08.448572 26333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:30:08.448451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.189:34095 (local address 127.0.0.1:49706)
0810 15:30:08.448512 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0810 15:30:08.448544 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.189:34095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260810 15:30:08.448669 26330 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.68.189:34095: Network error: Client connection negotiation failed: client connection to 127.18.68.189:34095: connect: Connection refused (error 111)
I20260810 15:30:08.449708 26338 hybrid_clock.cc:648] HybridClock initialized: now 1786375808449682 us; error 45 us; skew 500 ppm
Aug 10 15:30:08 dist-test-slave-2p8l krb5kdc[26173](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375808, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:30:08.452612 26338 init.cc:377] Logged in from keytab as kudu/127.18.68.189@KRBTEST.COM (short username kudu)
I20260810 15:30:08.453114 26338 webserver.cc:460] Webserver started at http://127.18.68.189:45233/ using document root <none> and password file <none>
I20260810 15:30:08.453383 26338 fs_manager.cc:359] Metadata directory not provided
I20260810 15:30:08.453459 26338 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:30:08.453619 26338 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:30:08.454797 26338 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786375520124696-18706-0/minicluster-data/master-1/data/instance:
uuid: "c96e2b8678294b28a4fdeb796bd4e663"
format_stamp: "Formatted at 2026-08-10 15:30:08 on dist-test-slave-2p8l"
server_key: "599388ec097104a9dc93530f70d6d581"
server_key_iv: "b2e206852f19a3b7397ebd1e98147cc0"
server_key_version: "encryptionkey@0"
I20260810 15:30:08.455191 26338 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786375520124696-18706-0/minicluster-data/master-1/wal/instance:
uuid: "c96e2b8678294b28a4fdeb796bd4e663"
format_stamp: "Formatted at 2026-08-10 15:30:08 on dist-test-slave-2p8l"
server_key: "599388ec097104a9dc93530f70d6d581"
server_key_iv: "b2e206852f19a3b7397ebd1e98147cc0"
server_key_version: "encryptionkey@0"
I20260810 15:30:08.456615 26338 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 15:30:08.457468 26362 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:30:08.457717 26338 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:30:08.457924 26338 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786375520124696-18706-0/minicluster-data/master-1/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786375520124696-18706-0/minicluster-data/master-1/wal
uuid: "c96e2b8678294b28a4fdeb796bd4e663"
format_stamp: "Formatted at 2026-08-10 15:30:08 on dist-test-slave-2p8l"
server_key: "599388ec097104a9dc93530f70d6d581"
server_key_iv: "b2e206852f19a3b7397ebd1e98147cc0"
server_key_version: "encryptionkey@0"
I20260810 15:30:08.458019 26338 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786375520124696-18706-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786375520124696-18706-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786375520124696-18706-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:30:08.468487 26338 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:30:08.470929 26338 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:30:08.471105 26338 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:30:08.475402 26338 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.189:34095
I20260810 15:30:08.475483 26459 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.189:34095 every 8 connection(s)
I20260810 15:30:08.475859 26338 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786375520124696-18706-0/minicluster-data/master-1/data/info.pb
I20260810 15:30:08.477018 26460 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:30:08.478761 26460 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.68.190" port: 39071 } has no permanent_uuid. Determining permanent_uuid...
I20260810 15:30:08.479434 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 26338
I20260810 15:30:08.479559 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786375520124696-18706-0/minicluster-data/master-1/wal/instance
I20260810 15:30:08.479820 18706 external_mini_cluster.cc:1428] Setting key 73b9a2c6235b2e83f6b979255afcffab
Aug 10 15:30:08 dist-test-slave-2p8l krb5kdc[26173](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375808, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.189@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.18.68.188@KRBTEST.COM; defaulting to no policy
I20260810 15:30:08.489949 26334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:30:08.479677 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57486 (local address 127.18.68.190:39071)
0810 15:30:08.479744 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0810 15:30:08.479747 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 15:30:08.479982 (+ 235us) server_negotiation.cc:407] Connection header received
0810 15:30:08.480457 (+ 475us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:30:08.480459 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:30:08.480475 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:30:08.480550 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:30:08.481201 (+ 651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:30:08.481930 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:30:08.483463 (+ 1533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:30:08.483716 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:30:08.483799 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:30:08.486439 (+ 2640us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:30:08.486441 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:30:08.486442 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:30:08.486452 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:30:08.488266 (+ 1814us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:30:08.488693 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:30:08.488695 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:30:08.488695 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:30:08.488763 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:30:08.489160 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:30:08.489161 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:30:08.489161 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:30:08.489307 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:30:08.489385 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0810 15:30:08.489781 (+ 396us) server_negotiation.cc:299] Negotiation successful
0810 15:30:08.489859 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260810 15:30:08.490180 26463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:30:08.479573 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:39071 (local address 127.0.0.1:57486)
0810 15:30:08.479822 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0810 15:30:08.479859 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0810 15:30:08.480354 (+ 495us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:30:08.480646 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:30:08.480649 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:30:08.480916 (+ 267us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:30:08.481107 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:30:08.481111 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:30:08.482036 (+ 925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:30:08.482037 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:30:08.483352 (+ 1315us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:30:08.483355 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:30:08.483843 (+ 488us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:30:08.483844 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:30:08.483993 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:30:08.484635 (+ 642us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:30:08.484646 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:30:08.486340 (+ 1694us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:30:08.488361 (+ 2021us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:30:08.488368 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:30:08.488370 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:30:08.488604 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:30:08.488889 (+ 285us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:30:08.488890 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:30:08.488890 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:30:08.489076 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:30:08.489443 (+ 367us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:30:08.489450 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:30:08.489628 (+ 178us) client_negotiation.cc:769] Sending connection context
0810 15:30:08.489735 (+ 107us) client_negotiation.cc:240] Negotiation successful
0810 15:30:08.489881 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":150,"threads_started":1}
I20260810 15:30:08.490856 26460 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.68.189" port: 34095 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.18.68.188@KRBTEST.COM" created.
Aug 10 15:30:08 dist-test-slave-2p8l krb5kdc[26173](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375808, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.189@KRBTEST.COM for kudu/127.18.68.189@KRBTEST.COM
I20260810 15:30:08.500253 26463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:30:08.491154 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.189:34095 (local address 127.0.0.1:49722)
0810 15:30:08.491388 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0810 15:30:08.491397 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 15:30:08.491438 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:30:08.491628 (+ 190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:30:08.491629 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:30:08.491813 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:30:08.491873 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:30:08.491875 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:30:08.492985 (+ 1110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:30:08.492986 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:30:08.493786 (+ 800us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:30:08.493790 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:30:08.494404 (+ 614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:30:08.494405 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:30:08.494490 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:30:08.495062 (+ 572us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:30:08.495067 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:30:08.496575 (+ 1508us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:30:08.499149 (+ 2574us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:30:08.499150 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:30:08.499150 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:30:08.499317 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:30:08.499579 (+ 262us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:30:08.499579 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:30:08.499580 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:30:08.499637 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:30:08.500021 (+ 384us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:30:08.500022 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:30:08.500058 (+ 36us) client_negotiation.cc:769] Sending connection context
0810 15:30:08.500108 (+ 50us) client_negotiation.cc:240] Negotiation successful
0810 15:30:08.500182 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":220}
I20260810 15:30:08.500396 26465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:30:08.491241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49722 (local address 127.18.68.189:34095)
0810 15:30:08.491447 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0810 15:30:08.491451 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 15:30:08.491471 (+ 20us) server_negotiation.cc:407] Connection header received
0810 15:30:08.491490 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:30:08.491492 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:30:08.491503 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:30:08.491585 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:30:08.491974 (+ 389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:30:08.492883 (+ 909us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:30:08.493881 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:30:08.494304 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:30:08.494370 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:30:08.496672 (+ 2302us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:30:08.496682 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:30:08.496682 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:30:08.496691 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:30:08.499042 (+ 2351us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:30:08.499418 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:30:08.499423 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:30:08.499423 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:30:08.499499 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:30:08.499712 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:30:08.499713 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:30:08.499714 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:30:08.499942 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:30:08.500054 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0810 15:30:08.500172 (+ 118us) server_negotiation.cc:299] Negotiation successful
0810 15:30:08.500264 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":174,"thread_start_us":101,"threads_started":1}
I20260810 15:30:08.501089 26460 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.68.188" port: 41393 } has no permanent_uuid. Determining permanent_uuid...
I20260810 15:30:08.501470 26463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:30:08.501352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.188:41393 (local address 127.0.0.1:58600)
0810 15:30:08.501401 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0810 15:30:08.501450 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.188:41393: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260810 15:30:08.501658 26368 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.18.68.188:41393: connect: Connection refused (error 111)
I20260810 15:30:08.502163 26463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:30:08.502044 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.188:41393 (local address 127.0.0.1:58604)
0810 15:30:08.502110 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0810 15:30:08.502138 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.188:41393: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260810 15:30:08.502326 26460 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.68.188:41393: Network error: Client connection negotiation failed: client connection to 127.18.68.188:41393: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.18.68.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.188.keytab.
Entry for principal kudu/127.18.68.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.188.keytab.
I20260810 15:30:08.513182 18706 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskspH5IZ/build/release/bin/kudu
/tmp/dist-test-taskspH5IZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786375520124696-18706-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786375520124696-18706-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786375520124696-18706-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786375520124696-18706-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.188:41393
--webserver_interface=127.18.68.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.188.keytab
--principal=kudu/127.18.68.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.18.68.148:35973
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.18.68.190:39071,127.18.68.189:34095,127.18.68.188:41393
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786375520124696-18706-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786375520124696-18706-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786375520124696-18706-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 15:30:08.539832 26330 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.68.189" port: 34095 } attempt: 3
Aug 10 15:30:08 dist-test-slave-2p8l krb5kdc[26173](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375808, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.190@KRBTEST.COM for kudu/127.18.68.189@KRBTEST.COM
I20260810 15:30:08.547536 26465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:30:08.540364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49730 (local address 127.18.68.189:34095)
0810 15:30:08.540437 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0810 15:30:08.540440 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 15:30:08.540450 (+ 10us) server_negotiation.cc:407] Connection header received
0810 15:30:08.540482 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:30:08.540484 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:30:08.540497 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:30:08.540572 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:30:08.540927 (+ 355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:30:08.541431 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:30:08.542187 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:30:08.542418 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:30:08.542503 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:30:08.544769 (+ 2266us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:30:08.544771 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:30:08.544771 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:30:08.544779 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:30:08.546298 (+ 1519us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:30:08.546701 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:30:08.546702 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:30:08.546702 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:30:08.546763 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:30:08.546968 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:30:08.546969 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:30:08.546969 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:30:08.547089 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:30:08.547178 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0810 15:30:08.547347 (+ 169us) server_negotiation.cc:299] Negotiation successful
0810 15:30:08.547431 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260810 15:30:08.547536 26333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:30:08.540262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.189:34095 (local address 127.0.0.1:49730)
0810 15:30:08.540333 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0810 15:30:08.540352 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0810 15:30:08.540422 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:30:08.540580 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:30:08.540581 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:30:08.540759 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:30:08.540838 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:30:08.540840 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:30:08.541520 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:30:08.541521 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:30:08.542053 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:30:08.542055 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:30:08.542500 (+ 445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:30:08.542501 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:30:08.542585 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:30:08.543150 (+ 565us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:30:08.543154 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:30:08.544634 (+ 1480us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:30:08.546427 (+ 1793us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:30:08.546428 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:30:08.546428 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:30:08.546610 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:30:08.546835 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:30:08.546836 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:30:08.546837 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:30:08.546899 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:30:08.547163 (+ 264us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:30:08.547164 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:30:08.547235 (+ 71us) client_negotiation.cc:769] Sending connection context
0810 15:30:08.547321 (+ 86us) client_negotiation.cc:240] Negotiation successful
0810 15:30:08.547431 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43}
I20260810 15:30:08.548192 26330 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.68.188" port: 41393 } has no permanent_uuid. Determining permanent_uuid...
I20260810 15:30:08.548573 26333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:30:08.548460 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.188:41393 (local address 127.0.0.1:58614)
0810 15:30:08.548515 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0810 15:30:08.548545 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.188:41393: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260810 15:30:08.548897 26333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:30:08.548799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.188:41393 (local address 127.0.0.1:58624)
0810 15:30:08.548850 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0810 15:30:08.548874 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.188:41393: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260810 15:30:08.548993 26330 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.68.188:41393: Network error: Client connection negotiation failed: client connection to 127.18.68.188:41393: connect: Connection refused (error 111)
I20260810 15:30:08.551587 26460 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.68.188" port: 41393 } attempt: 1
I20260810 15:30:08.552039 26463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:30:08.551899 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.188:41393 (local address 127.0.0.1:58638)
0810 15:30:08.551969 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0810 15:30:08.552009 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.188:41393: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260810 15:30:08.552493 26463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:30:08.552368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.188:41393 (local address 127.0.0.1:58650)
0810 15:30:08.552424 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0810 15:30:08.552461 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.188:41393: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260810 15:30:08.552618 26460 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.68.188:41393: Network error: Client connection negotiation failed: client connection to 127.18.68.188:41393: connect: Connection refused (error 111)
I20260810 15:30:08.580158 26330 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.68.188" port: 41393 } attempt: 1
I20260810 15:30:08.580756 26333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:30:08.580550 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.188:41393 (local address 127.0.0.1:58656)
0810 15:30:08.580640 (+ 90us) negotiation.cc:107] Waiting for socket to connect
0810 15:30:08.580703 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.188:41393: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260810 15:30:08.581264 26333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:30:08.581136 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.188:41393 (local address 127.0.0.1:58658)
0810 15:30:08.581205 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0810 15:30:08.581237 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.188:41393: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260810 15:30:08.581419 26330 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.68.188:41393: Network error: Client connection negotiation failed: client connection to 127.18.68.188:41393: connect: Connection refused (error 111)
W20260810 15:30:08.601367 26469 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260810 15:30:08.601648 26469 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 15:30:08.601667 26469 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 15:30:08.601692 26469 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 15:30:08.602979 26469 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 15:30:08.603051 26469 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 15:30:08.603068 26469 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 15:30:08.603081 26469 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 15:30:08.603094 26469 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 15:30:08.604914 26469 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.18.68.148:35973
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786375520124696-18706-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786375520124696-18706-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.18.68.190:39071,127.18.68.189:34095,127.18.68.188:41393
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786375520124696-18706-0/krb5kdc/kudu_127.18.68.188.keytab
--principal=kudu/127.18.68.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.18.68.188:41393
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786375520124696-18706-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.18.68.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26469
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786375520124696-18706-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 14:17:30 UTC on ccycloud.quasar-yaaqgv.root.comops.site
build id 4577963
I20260810 15:30:08.605207 26469 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 15:30:08.605418 26469 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 15:30:08.611076 26477 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:30:08.611074 26482 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 15:30:08.611074 26479 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 15:30:08.611094 26469 server_base.cc:1034] running on GCE node
I20260810 15:30:08.611580 26469 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 15:30:08.611965 26469 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 15:30:08.613201 26469 hybrid_clock.cc:648] HybridClock initialized: now 1786375808613179 us; error 44 us; skew 500 ppm
Aug 10 15:30:08 dist-test-slave-2p8l krb5kdc[26173](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375808, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 15:30:08.616041 26469 init.cc:377] Logged in from keytab as kudu/127.18.68.188@KRBTEST.COM (short username kudu)
I20260810 15:30:08.616532 26469 webserver.cc:460] Webserver started at http://127.18.68.188:45385/ using document root <none> and password file <none>
I20260810 15:30:08.616781 26469 fs_manager.cc:359] Metadata directory not provided
I20260810 15:30:08.616829 26469 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 15:30:08.616986 26469 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 15:30:08.618207 26469 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786375520124696-18706-0/minicluster-data/master-2/data/instance:
uuid: "ffce2544ba1042f78dfb601b67f968fd"
format_stamp: "Formatted at 2026-08-10 15:30:08 on dist-test-slave-2p8l"
server_key: "7a730233a6fe8d25c8779d2c68772bcc"
server_key_iv: "cce0975025b16117b71047711a3d48ca"
server_key_version: "encryptionkey@0"
I20260810 15:30:08.618604 26469 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786375520124696-18706-0/minicluster-data/master-2/wal/instance:
uuid: "ffce2544ba1042f78dfb601b67f968fd"
format_stamp: "Formatted at 2026-08-10 15:30:08 on dist-test-slave-2p8l"
server_key: "7a730233a6fe8d25c8779d2c68772bcc"
server_key_iv: "cce0975025b16117b71047711a3d48ca"
server_key_version: "encryptionkey@0"
I20260810 15:30:08.620182 26469 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 15:30:08.620795 26460 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.68.188" port: 41393 } attempt: 2
I20260810 15:30:08.621133 26495 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 15:30:08.621315 26463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:30:08.621107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.188:41393 (local address 127.0.0.1:58666)
0810 15:30:08.621229 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0810 15:30:08.621276 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.188:41393: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260810 15:30:08.621333 26469 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 15:30:08.621421 26469 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786375520124696-18706-0/minicluster-data/master-2/data,/tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786375520124696-18706-0/minicluster-data/master-2/wal
uuid: "ffce2544ba1042f78dfb601b67f968fd"
format_stamp: "Formatted at 2026-08-10 15:30:08 on dist-test-slave-2p8l"
server_key: "7a730233a6fe8d25c8779d2c68772bcc"
server_key_iv: "cce0975025b16117b71047711a3d48ca"
server_key_version: "encryptionkey@0"
I20260810 15:30:08.621500 26469 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786375520124696-18706-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786375520124696-18706-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786375520124696-18706-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 15:30:08.621749 26463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:30:08.621656 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.188:41393 (local address 127.0.0.1:58682)
0810 15:30:08.621690 (+ 34us) negotiation.cc:107] Waiting for socket to connect
0810 15:30:08.621721 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.188:41393: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":17}
W20260810 15:30:08.621882 26460 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.68.188:41393: Network error: Client connection negotiation failed: client connection to 127.18.68.188:41393: connect: Connection refused (error 111)
I20260810 15:30:08.655690 26469 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 15:30:08.656644 26330 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.68.188" port: 41393 } attempt: 2
I20260810 15:30:08.657198 26333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:30:08.657042 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.188:41393 (local address 127.0.0.1:58696)
0810 15:30:08.657111 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0810 15:30:08.657150 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.188:41393: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260810 15:30:08.657575 26333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:30:08.657473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.188:41393 (local address 127.0.0.1:58708)
0810 15:30:08.657521 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0810 15:30:08.657547 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.18.68.188:41393: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260810 15:30:08.657722 26330 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.18.68.188:41393: Network error: Client connection negotiation failed: client connection to 127.18.68.188:41393: connect: Connection refused (error 111)
I20260810 15:30:08.658865 26469 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 15:30:08.659057 26469 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 15:30:08.663929 26469 rpc_server.cc:307] RPC server started. Bound to: 127.18.68.188:41393
I20260810 15:30:08.663960 26575 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.68.188:41393 every 8 connection(s)
I20260810 15:30:08.664397 26469 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786375520124696-18706-0/minicluster-data/master-2/data/info.pb
I20260810 15:30:08.665534 26576 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 15:30:08.667246 26576 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.68.190" port: 39071 } has no permanent_uuid. Determining permanent_uuid...
I20260810 15:30:08.670259 18706 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskspH5IZ/build/release/bin/kudu as pid 26469
I20260810 15:30:08.670374 18706 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskspH5IZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786375520124696-18706-0/minicluster-data/master-2/wal/instance
I20260810 15:30:08.670610 18706 external_mini_cluster.cc:1428] Setting key 505928198cd4a70fe25db706425d01e6
Aug 10 15:30:08 dist-test-slave-2p8l krb5kdc[26173](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375808, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.188@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
Aug 10 15:30:08 dist-test-slave-2p8l krb5kdc[26173](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375808, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.68.188@KRBTEST.COM
I20260810 15:30:08.678426 26334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:30:08.668023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57502 (local address 127.18.68.190:39071)
0810 15:30:08.668194 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0810 15:30:08.668197 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 15:30:08.668416 (+ 219us) server_negotiation.cc:407] Connection header received
0810 15:30:08.669015 (+ 599us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:30:08.669016 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:30:08.669030 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:30:08.669097 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:30:08.669835 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:30:08.670687 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:30:08.672160 (+ 1473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:30:08.672401 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:30:08.672468 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:30:08.675178 (+ 2710us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:30:08.675180 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:30:08.675180 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:30:08.675190 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:30:08.676761 (+ 1571us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:30:08.677289 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:30:08.677291 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:30:08.677291 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:30:08.677345 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:30:08.677621 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:30:08.677622 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:30:08.677622 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:30:08.677818 (+ 196us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:30:08.677883 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0810 15:30:08.678241 (+ 358us) server_negotiation.cc:299] Negotiation successful
0810 15:30:08.678329 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95}
I20260810 15:30:08.678620 26579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:30:08.667985 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.190:39071 (local address 127.0.0.1:57502)
0810 15:30:08.668269 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0810 15:30:08.668311 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0810 15:30:08.668877 (+ 566us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:30:08.669185 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:30:08.669189 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:30:08.669480 (+ 291us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:30:08.669710 (+ 230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:30:08.669715 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:30:08.670832 (+ 1117us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:30:08.670834 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:30:08.672048 (+ 1214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:30:08.672051 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:30:08.672516 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:30:08.672518 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:30:08.672673 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:30:08.673253 (+ 580us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:30:08.673265 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:30:08.675056 (+ 1791us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:30:08.676882 (+ 1826us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:30:08.676890 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:30:08.676892 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:30:08.677132 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:30:08.677423 (+ 291us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:30:08.677424 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:30:08.677424 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:30:08.677546 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:30:08.677888 (+ 342us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:30:08.677896 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:30:08.678038 (+ 142us) client_negotiation.cc:769] Sending connection context
0810 15:30:08.678207 (+ 169us) client_negotiation.cc:240] Negotiation successful
0810 15:30:08.678372 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":229,"thread_start_us":126,"threads_started":1}
I20260810 15:30:08.679364 26576 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.68.189" port: 34095 } has no permanent_uuid. Determining permanent_uuid...
I20260810 15:30:08.681332 26583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:30:08.671075 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58720 (local address 127.18.68.188:41393)
0810 15:30:08.671339 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0810 15:30:08.671344 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 15:30:08.671370 (+ 26us) server_negotiation.cc:407] Connection header received
0810 15:30:08.671394 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:30:08.671397 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:30:08.671419 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:30:08.671520 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:30:08.672172 (+ 652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:30:08.673217 (+ 1045us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:30:08.674396 (+ 1179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:30:08.674815 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:30:08.674913 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:30:08.677726 (+ 2813us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:30:08.677735 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:30:08.677735 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:30:08.677742 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:30:08.679946 (+ 2204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:30:08.680369 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:30:08.680372 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:30:08.680373 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:30:08.680442 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:30:08.680682 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:30:08.680683 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:30:08.680683 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:30:08.680844 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:30:08.681017 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0810 15:30:08.681107 (+ 90us) server_negotiation.cc:299] Negotiation successful
0810 15:30:08.681199 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":228,"thread_start_us":175,"threads_started":1}
Aug 10 15:30:08 dist-test-slave-2p8l krb5kdc[26173](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375808, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.188@KRBTEST.COM for kudu/127.18.68.189@KRBTEST.COM
Aug 10 15:30:08 dist-test-slave-2p8l krb5kdc[26173](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375808, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.68.190@KRBTEST.COM
I20260810 15:30:08.687011 26579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:30:08.679697 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.189:34095 (local address 127.0.0.1:49732)
0810 15:30:08.679739 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0810 15:30:08.679750 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 15:30:08.679787 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:30:08.679982 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:30:08.679983 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:30:08.680124 (+ 141us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:30:08.680174 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:30:08.680175 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:30:08.680820 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:30:08.680821 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:30:08.681313 (+ 492us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:30:08.681315 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:30:08.681837 (+ 522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:30:08.681838 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:30:08.681931 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:30:08.682387 (+ 456us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:30:08.682392 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:30:08.683813 (+ 1421us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:30:08.685900 (+ 2087us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:30:08.685901 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:30:08.685902 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:30:08.686193 (+ 291us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:30:08.686409 (+ 216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:30:08.686410 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:30:08.686410 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:30:08.686483 (+ 73us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:30:08.686781 (+ 298us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:30:08.686782 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:30:08.686819 (+ 37us) client_negotiation.cc:769] Sending connection context
0810 15:30:08.686873 (+ 54us) client_negotiation.cc:240] Negotiation successful
0810 15:30:08.686946 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":24}
I20260810 15:30:08.687175 26465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:30:08.679778 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49732 (local address 127.18.68.189:34095)
0810 15:30:08.679856 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0810 15:30:08.679858 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:30:08.679866 (+ 8us) server_negotiation.cc:407] Connection header received
0810 15:30:08.679889 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:30:08.679890 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:30:08.679902 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:30:08.679978 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:30:08.680263 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:30:08.680736 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:30:08.681401 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:30:08.681687 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:30:08.681767 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:30:08.683904 (+ 2137us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:30:08.683905 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:30:08.683905 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:30:08.683913 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:30:08.685757 (+ 1844us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:30:08.686276 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:30:08.686277 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:30:08.686277 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:30:08.686327 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:30:08.686552 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:30:08.686553 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:30:08.686553 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:30:08.686681 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:30:08.686745 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0810 15:30:08.686953 (+ 208us) server_negotiation.cc:299] Negotiation successful
0810 15:30:08.687044 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260810 15:30:08.687837 26576 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.18.68.188" port: 41393 } has no permanent_uuid. Determining permanent_uuid...
I20260810 15:30:08.690269 26334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:30:08.682196 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57508 (local address 127.18.68.190:39071)
0810 15:30:08.682240 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0810 15:30:08.682242 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:30:08.682252 (+ 10us) server_negotiation.cc:407] Connection header received
0810 15:30:08.682298 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:30:08.682299 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:30:08.682310 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:30:08.682367 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:30:08.682978 (+ 611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:30:08.683407 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:30:08.684281 (+ 874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:30:08.684493 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:30:08.684597 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:30:08.687177 (+ 2580us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:30:08.687179 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:30:08.687180 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:30:08.687187 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:30:08.688987 (+ 1800us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:30:08.689414 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:30:08.689415 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:30:08.689415 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:30:08.689466 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:30:08.689743 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:30:08.689744 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:30:08.689744 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:30:08.689845 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:30:08.689976 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0810 15:30:08.690135 (+ 159us) server_negotiation.cc:299] Negotiation successful
0810 15:30:08.690204 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
Aug 10 15:30:08 dist-test-slave-2p8l krb5kdc[26173](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375808, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.188@KRBTEST.COM for kudu/127.18.68.188@KRBTEST.COM
Aug 10 15:30:08 dist-test-slave-2p8l krb5kdc[26173](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375808, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.18.68.189@KRBTEST.COM
I20260810 15:30:08.696537 26579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:30:08.688273 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.188:41393 (local address 127.0.0.1:58724)
0810 15:30:08.688331 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0810 15:30:08.688341 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 15:30:08.688384 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:30:08.688510 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:30:08.688511 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:30:08.688649 (+ 138us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:30:08.688689 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:30:08.688690 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:30:08.689615 (+ 925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:30:08.689616 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:30:08.690468 (+ 852us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:30:08.690471 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:30:08.691018 (+ 547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:30:08.691019 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:30:08.691073 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:30:08.691547 (+ 474us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:30:08.691553 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:30:08.692874 (+ 1321us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:30:08.695344 (+ 2470us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:30:08.695345 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:30:08.695346 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:30:08.695529 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:30:08.695779 (+ 250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:30:08.695780 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:30:08.695780 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:30:08.695835 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:30:08.696153 (+ 318us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:30:08.696154 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:30:08.696195 (+ 41us) client_negotiation.cc:769] Sending connection context
0810 15:30:08.696287 (+ 92us) client_negotiation.cc:240] Negotiation successful
0810 15:30:08.696397 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38}
I20260810 15:30:08.696539 26583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:30:08.688336 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58724 (local address 127.18.68.188:41393)
0810 15:30:08.688380 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0810 15:30:08.688382 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:30:08.688392 (+ 10us) server_negotiation.cc:407] Connection header received
0810 15:30:08.688442 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:30:08.688443 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:30:08.688452 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:30:08.688495 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:30:08.688765 (+ 270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:30:08.689522 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:30:08.690556 (+ 1034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:30:08.690905 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:30:08.691019 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:30:08.693296 (+ 2277us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:30:08.693298 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:30:08.693298 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:30:08.693304 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:30:08.695233 (+ 1929us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:30:08.695624 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:30:08.695625 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:30:08.695626 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:30:08.695686 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:30:08.695900 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:30:08.695901 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:30:08.695901 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:30:08.696058 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:30:08.696152 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0810 15:30:08.696319 (+ 167us) server_negotiation.cc:299] Negotiation successful
0810 15:30:08.696444 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":59,"server-negotiator.queue_time_us":24}
I20260810 15:30:08.698192 26576 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ffce2544ba1042f78dfb601b67f968fd: Bootstrap starting.
I20260810 15:30:08.698925 26465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:30:08.691030 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49734 (local address 127.18.68.189:34095)
0810 15:30:08.691070 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0810 15:30:08.691072 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:30:08.691118 (+ 46us) server_negotiation.cc:407] Connection header received
0810 15:30:08.691191 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:30:08.691192 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:30:08.691201 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:30:08.691257 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:30:08.691732 (+ 475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:30:08.692173 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:30:08.692961 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:30:08.693180 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:30:08.693243 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:30:08.695751 (+ 2508us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:30:08.695753 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:30:08.695753 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:30:08.695762 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:30:08.697567 (+ 1805us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:30:08.697960 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:30:08.697961 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:30:08.697962 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:30:08.698022 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:30:08.698335 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:30:08.698335 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:30:08.698336 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:30:08.698440 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:30:08.698629 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0810 15:30:08.698665 (+ 36us) server_negotiation.cc:299] Negotiation successful
0810 15:30:08.698742 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260810 15:30:08.699101 26576 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ffce2544ba1042f78dfb601b67f968fd: Neither blocks nor log segments found. Creating new log.
I20260810 15:30:08.699452 26576 log.cc:824] T 00000000000000000000000000000000 P ffce2544ba1042f78dfb601b67f968fd: Log is configured to *not* fsync() on all Append() calls
I20260810 15:30:08.700414 26576 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ffce2544ba1042f78dfb601b67f968fd: No bootstrap required, opened a new log
I20260810 15:30:08.700690 18706 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 15:30:08.702529 26576 raft_consensus.cc:348] T 00000000000000000000000000000000 P ffce2544ba1042f78dfb601b67f968fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8008b5ca622d4202a835e00d32233979" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 39071 } } peers { permanent_uuid: "c96e2b8678294b28a4fdeb796bd4e663" member_type: VOTER last_known_addr { host: "127.18.68.189" port: 34095 } } peers { permanent_uuid: "ffce2544ba1042f78dfb601b67f968fd" member_type: VOTER last_known_addr { host: "127.18.68.188" port: 41393 } }
I20260810 15:30:08.702701 26576 raft_consensus.cc:729] T 00000000000000000000000000000000 P ffce2544ba1042f78dfb601b67f968fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffce2544ba1042f78dfb601b67f968fd, State: Initialized, Role: FOLLOWER
I20260810 15:30:08.701777 26286 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "8008b5ca622d4202a835e00d32233979"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57508
I20260810 15:30:08.702798 26576 consensus_queue.cc:260] T 00000000000000000000000000000000 P ffce2544ba1042f78dfb601b67f968fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8008b5ca622d4202a835e00d32233979" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 39071 } } peers { permanent_uuid: "c96e2b8678294b28a4fdeb796bd4e663" member_type: VOTER last_known_addr { host: "127.18.68.189" port: 34095 } } peers { permanent_uuid: "ffce2544ba1042f78dfb601b67f968fd" member_type: VOTER last_known_addr { host: "127.18.68.188" port: 41393 } }
I20260810 15:30:08.703141 26576 sys_catalog.cc:564] T 00000000000000000000000000000000 P ffce2544ba1042f78dfb601b67f968fd [sys.catalog]: configured and running, proceeding with master startup.
I20260810 15:30:08.703123 26586 sys_catalog.cc:455] T 00000000000000000000000000000000 P ffce2544ba1042f78dfb601b67f968fd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8008b5ca622d4202a835e00d32233979" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 39071 } } peers { permanent_uuid: "c96e2b8678294b28a4fdeb796bd4e663" member_type: VOTER last_known_addr { host: "127.18.68.189" port: 34095 } } peers { permanent_uuid: "ffce2544ba1042f78dfb601b67f968fd" member_type: VOTER last_known_addr { host: "127.18.68.188" port: 41393 } } }
I20260810 15:30:08.703346 26586 sys_catalog.cc:458] T 00000000000000000000000000000000 P ffce2544ba1042f78dfb601b67f968fd [sys.catalog]: This master's current role is: FOLLOWER
W20260810 15:30:08.705425 26606 catalog_manager.cc:1558] T 00000000000000000000000000000000 P ffce2544ba1042f78dfb601b67f968fd: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 15:30:08.705498 26606 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 15:30:08.705456 26469 master_runner.cc:186] Error getting master registration for 127.18.68.190:39071: OK, instance_id { permanent_uuid: "8008b5ca622d4202a835e00d32233979" instance_seqno: 1786375808310797 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260810 15:30:08.708222 26469 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260810 15:30:08.713061 26460 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.68.188" port: 41393 } attempt: 3
Aug 10 15:30:08 dist-test-slave-2p8l krb5kdc[26173](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375808, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.189@KRBTEST.COM for kudu/127.18.68.188@KRBTEST.COM
I20260810 15:30:08.722115 26463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:30:08.713497 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.188:41393 (local address 127.0.0.1:58732)
0810 15:30:08.713550 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0810 15:30:08.713562 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 15:30:08.713615 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:30:08.713730 (+ 115us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:30:08.713731 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:30:08.713916 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:30:08.713962 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:30:08.713964 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:30:08.714774 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:30:08.714775 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:30:08.716097 (+ 1322us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:30:08.716100 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:30:08.716492 (+ 392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:30:08.716493 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:30:08.716552 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:30:08.717115 (+ 563us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:30:08.717121 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:30:08.718564 (+ 1443us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:30:08.720791 (+ 2227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:30:08.720792 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:30:08.720793 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:30:08.721050 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:30:08.721294 (+ 244us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:30:08.721295 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:30:08.721295 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:30:08.721360 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:30:08.721735 (+ 375us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:30:08.721735 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:30:08.721787 (+ 52us) client_negotiation.cc:769] Sending connection context
0810 15:30:08.721858 (+ 71us) client_negotiation.cc:240] Negotiation successful
0810 15:30:08.721965 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26}
I20260810 15:30:08.722152 26583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:30:08.713560 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58732 (local address 127.18.68.188:41393)
0810 15:30:08.713611 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0810 15:30:08.713613 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:30:08.713625 (+ 12us) server_negotiation.cc:407] Connection header received
0810 15:30:08.713665 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:30:08.713666 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:30:08.713676 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:30:08.713725 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:30:08.714082 (+ 357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:30:08.714694 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:30:08.716198 (+ 1504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:30:08.716401 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:30:08.716483 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:30:08.718662 (+ 2179us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:30:08.718663 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:30:08.718664 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:30:08.718674 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:30:08.720655 (+ 1981us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:30:08.721137 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:30:08.721139 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:30:08.721139 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:30:08.721212 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:30:08.721435 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:30:08.721436 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:30:08.721436 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:30:08.721652 (+ 216us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:30:08.721753 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0810 15:30:08.721906 (+ 153us) server_negotiation.cc:299] Negotiation successful
0810 15:30:08.722004 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260810 15:30:08.724110 26460 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c96e2b8678294b28a4fdeb796bd4e663: Bootstrap starting.
I20260810 15:30:08.725061 26460 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c96e2b8678294b28a4fdeb796bd4e663: Neither blocks nor log segments found. Creating new log.
I20260810 15:30:08.725443 26460 log.cc:824] T 00000000000000000000000000000000 P c96e2b8678294b28a4fdeb796bd4e663: Log is configured to *not* fsync() on all Append() calls
I20260810 15:30:08.726507 26460 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c96e2b8678294b28a4fdeb796bd4e663: No bootstrap required, opened a new log
I20260810 15:30:08.728822 26460 raft_consensus.cc:348] T 00000000000000000000000000000000 P c96e2b8678294b28a4fdeb796bd4e663 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8008b5ca622d4202a835e00d32233979" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 39071 } } peers { permanent_uuid: "c96e2b8678294b28a4fdeb796bd4e663" member_type: VOTER last_known_addr { host: "127.18.68.189" port: 34095 } } peers { permanent_uuid: "ffce2544ba1042f78dfb601b67f968fd" member_type: VOTER last_known_addr { host: "127.18.68.188" port: 41393 } }
I20260810 15:30:08.729004 26460 raft_consensus.cc:729] T 00000000000000000000000000000000 P c96e2b8678294b28a4fdeb796bd4e663 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c96e2b8678294b28a4fdeb796bd4e663, State: Initialized, Role: FOLLOWER
I20260810 15:30:08.729101 26460 consensus_queue.cc:260] T 00000000000000000000000000000000 P c96e2b8678294b28a4fdeb796bd4e663 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8008b5ca622d4202a835e00d32233979" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 39071 } } peers { permanent_uuid: "c96e2b8678294b28a4fdeb796bd4e663" member_type: VOTER last_known_addr { host: "127.18.68.189" port: 34095 } } peers { permanent_uuid: "ffce2544ba1042f78dfb601b67f968fd" member_type: VOTER last_known_addr { host: "127.18.68.188" port: 41393 } }
I20260810 15:30:08.729485 26615 sys_catalog.cc:455] T 00000000000000000000000000000000 P c96e2b8678294b28a4fdeb796bd4e663 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8008b5ca622d4202a835e00d32233979" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 39071 } } peers { permanent_uuid: "c96e2b8678294b28a4fdeb796bd4e663" member_type: VOTER last_known_addr { host: "127.18.68.189" port: 34095 } } peers { permanent_uuid: "ffce2544ba1042f78dfb601b67f968fd" member_type: VOTER last_known_addr { host: "127.18.68.188" port: 41393 } } }
I20260810 15:30:08.729537 26460 sys_catalog.cc:564] T 00000000000000000000000000000000 P c96e2b8678294b28a4fdeb796bd4e663 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 15:30:08.729602 26615 sys_catalog.cc:458] T 00000000000000000000000000000000 P c96e2b8678294b28a4fdeb796bd4e663 [sys.catalog]: This master's current role is: FOLLOWER
W20260810 15:30:08.731737 26631 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c96e2b8678294b28a4fdeb796bd4e663: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 15:30:08.731799 26631 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 15:30:08.732045 26338 master_runner.cc:186] Error getting master registration for 127.18.68.190:39071: OK, instance_id { permanent_uuid: "8008b5ca622d4202a835e00d32233979" instance_seqno: 1786375808310797 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260810 15:30:08.734373 26338 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260810 15:30:08.756868 26330 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.18.68.188" port: 41393 } attempt: 3
Aug 10 15:30:08 dist-test-slave-2p8l krb5kdc[26173](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786375808, etypes {rep=17 tkt=17 ses=17}, kudu/127.18.68.190@KRBTEST.COM for kudu/127.18.68.188@KRBTEST.COM
I20260810 15:30:08.764930 26583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:30:08.757353 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58734 (local address 127.18.68.188:41393)
0810 15:30:08.757393 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0810 15:30:08.757396 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 15:30:08.757427 (+ 31us) server_negotiation.cc:407] Connection header received
0810 15:30:08.757457 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:30:08.757458 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:30:08.757475 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:30:08.757551 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:30:08.757926 (+ 375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:30:08.758685 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:30:08.759411 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:30:08.759715 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:30:08.759793 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:30:08.761961 (+ 2168us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:30:08.761962 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:30:08.761963 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:30:08.761972 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:30:08.763721 (+ 1749us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:30:08.764082 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:30:08.764083 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:30:08.764084 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:30:08.764149 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:30:08.764352 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:30:08.764353 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:30:08.764354 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:30:08.764491 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:30:08.764574 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0810 15:30:08.764737 (+ 163us) server_negotiation.cc:299] Negotiation successful
0810 15:30:08.764821 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260810 15:30:08.764930 26333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:30:08.757258 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.18.68.188:41393 (local address 127.0.0.1:58734)
0810 15:30:08.757326 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0810 15:30:08.757340 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 15:30:08.757388 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 15:30:08.757562 (+ 174us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 15:30:08.757564 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 15:30:08.757782 (+ 218us) client_negotiation.cc:189] Negotiated authn=SASL
0810 15:30:08.757836 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:30:08.757838 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:30:08.758779 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:30:08.758780 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:30:08.759304 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 15:30:08.759306 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 15:30:08.759810 (+ 504us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 15:30:08.759811 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 15:30:08.759875 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:30:08.760372 (+ 497us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 15:30:08.760382 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 15:30:08.761880 (+ 1498us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 15:30:08.763812 (+ 1932us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:30:08.763813 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:30:08.763814 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:30:08.763991 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:30:08.764212 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 15:30:08.764213 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 15:30:08.764213 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 15:30:08.764269 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 15:30:08.764566 (+ 297us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 15:30:08.764567 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 15:30:08.764615 (+ 48us) client_negotiation.cc:769] Sending connection context
0810 15:30:08.764717 (+ 102us) client_negotiation.cc:240] Negotiation successful
0810 15:30:08.764821 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42}
I20260810 15:30:08.767014 26330 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8008b5ca622d4202a835e00d32233979: Bootstrap starting.
I20260810 15:30:08.767830 26330 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8008b5ca622d4202a835e00d32233979: Neither blocks nor log segments found. Creating new log.
I20260810 15:30:08.768153 26330 log.cc:824] T 00000000000000000000000000000000 P 8008b5ca622d4202a835e00d32233979: Log is configured to *not* fsync() on all Append() calls
I20260810 15:30:08.769007 26330 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8008b5ca622d4202a835e00d32233979: No bootstrap required, opened a new log
I20260810 15:30:08.770460 26330 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8008b5ca622d4202a835e00d32233979 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8008b5ca622d4202a835e00d32233979" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 39071 } } peers { permanent_uuid: "c96e2b8678294b28a4fdeb796bd4e663" member_type: VOTER last_known_addr { host: "127.18.68.189" port: 34095 } } peers { permanent_uuid: "ffce2544ba1042f78dfb601b67f968fd" member_type: VOTER last_known_addr { host: "127.18.68.188" port: 41393 } }
I20260810 15:30:08.770607 26330 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8008b5ca622d4202a835e00d32233979 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8008b5ca622d4202a835e00d32233979, State: Initialized, Role: FOLLOWER
I20260810 15:30:08.770695 26330 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8008b5ca622d4202a835e00d32233979 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8008b5ca622d4202a835e00d32233979" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 39071 } } peers { permanent_uuid: "c96e2b8678294b28a4fdeb796bd4e663" member_type: VOTER last_known_addr { host: "127.18.68.189" port: 34095 } } peers { permanent_uuid: "ffce2544ba1042f78dfb601b67f968fd" member_type: VOTER last_known_addr { host: "127.18.68.188" port: 41393 } }
I20260810 15:30:08.771075 26330 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8008b5ca622d4202a835e00d32233979 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 15:30:08.771164 26286 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8008b5ca622d4202a835e00d32233979 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260810 15:30:08.771236 26286 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8008b5ca622d4202a835e00d32233979 [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:30:08.772171 26286 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8008b5ca622d4202a835e00d32233979 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8008b5ca622d4202a835e00d32233979" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 39071 } } peers { permanent_uuid: "c96e2b8678294b28a4fdeb796bd4e663" member_type: VOTER last_known_addr { host: "127.18.68.189" port: 34095 } } peers { permanent_uuid: "ffce2544ba1042f78dfb601b67f968fd" member_type: VOTER last_known_addr { host: "127.18.68.188" port: 41393 } }
I20260810 15:30:08.772468 26286 leader_election.cc:288] T 00000000000000000000000000000000 P 8008b5ca622d4202a835e00d32233979 [CANDIDATE]: Term 1 election: Requested vote from peers c96e2b8678294b28a4fdeb796bd4e663 (127.18.68.189:34095), ffce2544ba1042f78dfb601b67f968fd (127.18.68.188:41393)
I20260810 15:30:08.773201 26417 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8008b5ca622d4202a835e00d32233979" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "c96e2b8678294b28a4fdeb796bd4e663"
I20260810 15:30:08.773386 26417 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c96e2b8678294b28a4fdeb796bd4e663 [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:30:08.774163 26417 raft_consensus.cc:2454] T 00000000000000000000000000000000 P c96e2b8678294b28a4fdeb796bd4e663 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8008b5ca622d4202a835e00d32233979 in term 1.
I20260810 15:30:08.775162 26540 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8008b5ca622d4202a835e00d32233979" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "ffce2544ba1042f78dfb601b67f968fd"
I20260810 15:30:08.775297 26540 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ffce2544ba1042f78dfb601b67f968fd [term 0 FOLLOWER]: Advancing to term 1
I20260810 15:30:08.776849 26540 raft_consensus.cc:2454] T 00000000000000000000000000000000 P ffce2544ba1042f78dfb601b67f968fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8008b5ca622d4202a835e00d32233979 in term 1.
W20260810 15:30:08.773170 26661 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 8008b5ca622d4202a835e00d32233979: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 15:30:08.777725 26661 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 15:30:08.774452 26234 leader_election.cc:302] T 00000000000000000000000000000000 P 8008b5ca622d4202a835e00d32233979 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8008b5ca622d4202a835e00d32233979, c96e2b8678294b28a4fdeb796bd4e663; no voters:
I20260810 15:30:08.771029 26637 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8008b5ca622d4202a835e00d32233979 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8008b5ca622d4202a835e00d32233979" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 39071 } } peers { permanent_uuid: "c96e2b8678294b28a4fdeb796bd4e663" member_type: VOTER last_known_addr { host: "127.18.68.189" port: 34095 } } peers { permanent_uuid: "ffce2544ba1042f78dfb601b67f968fd" member_type: VOTER last_known_addr { host: "127.18.68.188" port: 41393 } } }
I20260810 15:30:08.778290 26637 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8008b5ca622d4202a835e00d32233979 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 15:30:08.778362 26637 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8008b5ca622d4202a835e00d32233979 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 15:30:08.778441 26637 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8008b5ca622d4202a835e00d32233979 [term 1 LEADER]: Becoming Leader. State: Replica: 8008b5ca622d4202a835e00d32233979, State: Running, Role: LEADER
I20260810 15:30:08.778636 26637 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8008b5ca622d4202a835e00d32233979 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8008b5ca622d4202a835e00d32233979" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 39071 } } peers { permanent_uuid: "c96e2b8678294b28a4fdeb796bd4e663" member_type: VOTER last_known_addr { host: "127.18.68.189" port: 34095 } } peers { permanent_uuid: "ffce2544ba1042f78dfb601b67f968fd" member_type: VOTER last_known_addr { host: "127.18.68.188" port: 41393 } }
I20260810 15:30:08.779150 26637 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8008b5ca622d4202a835e00d32233979 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8008b5ca622d4202a835e00d32233979. Latest consensus state: current_term: 1 leader_uuid: "8008b5ca622d4202a835e00d32233979" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8008b5ca622d4202a835e00d32233979" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 39071 } } peers { permanent_uuid: "c96e2b8678294b28a4fdeb796bd4e663" member_type: VOTER last_known_addr { host: "127.18.68.189" port: 34095 } } peers { permanent_uuid: "ffce2544ba1042f78dfb601b67f968fd" member_type: VOTER last_known_addr { host: "127.18.68.188" port: 41393 } } }
I20260810 15:30:08.779242 26637 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8008b5ca622d4202a835e00d32233979 [sys.catalog]: This master's current role is: LEADER
I20260810 15:30:08.780494 26201 master_runner.cc:263] No leader master found from master 8008b5ca622d4202a835e00d32233979
I20260810 15:30:08.780551 26201 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260810 15:30:08.786278 26679 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 15:30:08.786530 26679 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 15:30:08.799175 26334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:30:08.775311 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57514 (local address 127.18.68.190:39071)
0810 15:30:08.775354 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0810 15:30:08.775356 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:30:08.776150 (+ 794us) server_negotiation.cc:407] Connection header received
0810 15:30:08.776298 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:30:08.776300 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:30:08.776311 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:30:08.776344 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:30:08.778839 (+ 2495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:30:08.779714 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:30:08.785446 (+ 5732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:30:08.785746 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:30:08.785795 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:30:08.791236 (+ 5441us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:30:08.791239 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:30:08.791240 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:30:08.791249 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:30:08.792947 (+ 1698us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:30:08.793373 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:30:08.793375 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:30:08.793375 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:30:08.793448 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:30:08.795918 (+ 2470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:30:08.795919 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:30:08.795920 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:30:08.796075 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:30:08.796176 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0810 15:30:08.798899 (+ 2723us) server_negotiation.cc:299] Negotiation successful
0810 15:30:08.799009 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260810 15:30:08.802138 26465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:30:08.775523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49744 (local address 127.18.68.189:34095)
0810 15:30:08.775564 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0810 15:30:08.775566 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:30:08.777937 (+ 2371us) server_negotiation.cc:407] Connection header received
0810 15:30:08.778204 (+ 267us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:30:08.778206 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:30:08.778233 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:30:08.778268 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:30:08.781990 (+ 3722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:30:08.782630 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:30:08.786298 (+ 3668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:30:08.786607 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:30:08.786655 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:30:08.793741 (+ 7086us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:30:08.793742 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:30:08.793743 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:30:08.793752 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:30:08.795494 (+ 1742us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:30:08.800277 (+ 4783us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:30:08.800279 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:30:08.800279 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:30:08.800375 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:30:08.800635 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:30:08.800636 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:30:08.800636 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:30:08.800791 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:30:08.800881 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0810 15:30:08.801851 (+ 970us) server_negotiation.cc:299] Negotiation successful
0810 15:30:08.801959 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260810 15:30:08.803099 26540 raft_consensus.cc:1261] T 00000000000000000000000000000000 P ffce2544ba1042f78dfb601b67f968fd [term 1 FOLLOWER]: Refusing update from remote peer 8008b5ca622d4202a835e00d32233979: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 15:30:08.803422 26583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:30:08.775853 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58740 (local address 127.18.68.188:41393)
0810 15:30:08.775893 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0810 15:30:08.775896 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 15:30:08.778494 (+ 2598us) server_negotiation.cc:407] Connection header received
0810 15:30:08.780719 (+ 2225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:30:08.780721 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:30:08.780732 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:30:08.780764 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:30:08.782752 (+ 1988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:30:08.783369 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:30:08.788299 (+ 4930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:30:08.788601 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:30:08.788645 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:30:08.796404 (+ 7759us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 15:30:08.796406 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 15:30:08.796406 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 15:30:08.796415 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 15:30:08.798195 (+ 1780us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:30:08.800947 (+ 2752us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:30:08.800948 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:30:08.800949 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:30:08.801013 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 15:30:08.801396 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 15:30:08.801397 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 15:30:08.801397 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 15:30:08.801540 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 15:30:08.801624 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0810 15:30:08.803222 (+ 1598us) server_negotiation.cc:299] Negotiation successful
0810 15:30:08.803320 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260810 15:30:08.803493 26677 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 8008b5ca622d4202a835e00d32233979 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ffce2544ba1042f78dfb601b67f968fd" member_type: VOTER last_known_addr { host: "127.18.68.188" port: 41393 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 15:30:08.805032 26586 sys_catalog.cc:455] T 00000000000000000000000000000000 P ffce2544ba1042f78dfb601b67f968fd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8008b5ca622d4202a835e00d32233979. Latest consensus state: current_term: 1 leader_uuid: "8008b5ca622d4202a835e00d32233979" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8008b5ca622d4202a835e00d32233979" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 39071 } } peers { permanent_uuid: "c96e2b8678294b28a4fdeb796bd4e663" member_type: VOTER last_known_addr { host: "127.18.68.189" port: 34095 } } peers { permanent_uuid: "ffce2544ba1042f78dfb601b67f968fd" member_type: VOTER last_known_addr { host: "127.18.68.188" port: 41393 } } }
I20260810 15:30:08.805169 26586 sys_catalog.cc:458] T 00000000000000000000000000000000 P ffce2544ba1042f78dfb601b67f968fd [sys.catalog]: This master's current role is: FOLLOWER
I20260810 15:30:08.806103 26417 raft_consensus.cc:1261] T 00000000000000000000000000000000 P c96e2b8678294b28a4fdeb796bd4e663 [term 1 FOLLOWER]: Refusing update from remote peer 8008b5ca622d4202a835e00d32233979: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 15:30:08.806428 26677 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 8008b5ca622d4202a835e00d32233979 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c96e2b8678294b28a4fdeb796bd4e663" member_type: VOTER last_known_addr { host: "127.18.68.189" port: 34095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 15:30:08.807338 26677 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8008b5ca622d4202a835e00d32233979 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "8008b5ca622d4202a835e00d32233979" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8008b5ca622d4202a835e00d32233979" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 39071 } } peers { permanent_uuid: "c96e2b8678294b28a4fdeb796bd4e663" member_type: VOTER last_known_addr { host: "127.18.68.189" port: 34095 } } peers { permanent_uuid: "ffce2544ba1042f78dfb601b67f968fd" member_type: VOTER last_known_addr { host: "127.18.68.188" port: 41393 } } }
I20260810 15:30:08.807427 26677 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8008b5ca622d4202a835e00d32233979 [sys.catalog]: This master's current role is: LEADER
I20260810 15:30:08.807854 26586 sys_catalog.cc:455] T 00000000000000000000000000000000 P ffce2544ba1042f78dfb601b67f968fd [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "8008b5ca622d4202a835e00d32233979" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8008b5ca622d4202a835e00d32233979" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 39071 } } peers { permanent_uuid: "c96e2b8678294b28a4fdeb796bd4e663" member_type: VOTER last_known_addr { host: "127.18.68.189" port: 34095 } } peers { permanent_uuid: "ffce2544ba1042f78dfb601b67f968fd" member_type: VOTER last_known_addr { host: "127.18.68.188" port: 41393 } } }
I20260810 15:30:08.807850 26615 sys_catalog.cc:455] T 00000000000000000000000000000000 P c96e2b8678294b28a4fdeb796bd4e663 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8008b5ca622d4202a835e00d32233979. Latest consensus state: current_term: 1 leader_uuid: "8008b5ca622d4202a835e00d32233979" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8008b5ca622d4202a835e00d32233979" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 39071 } } peers { permanent_uuid: "c96e2b8678294b28a4fdeb796bd4e663" member_type: VOTER last_known_addr { host: "127.18.68.189" port: 34095 } } peers { permanent_uuid: "ffce2544ba1042f78dfb601b67f968fd" member_type: VOTER last_known_addr { host: "127.18.68.188" port: 41393 } } }
I20260810 15:30:08.807945 26586 sys_catalog.cc:458] T 00000000000000000000000000000000 P ffce2544ba1042f78dfb601b67f968fd [sys.catalog]: This master's current role is: FOLLOWER
I20260810 15:30:08.807955 26615 sys_catalog.cc:458] T 00000000000000000000000000000000 P c96e2b8678294b28a4fdeb796bd4e663 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 15:30:08.808152 26680 mvcc.cc:205] Tried to move back new op lower bound from 7316995312854523904 to 7316995312758218752. Current Snapshot: MvccSnapshot[applied={T|T < 7316995312854523904}]
I20260810 15:30:08.808384 26681 mvcc.cc:205] Tried to move back new op lower bound from 7316995312854523904 to 7316995312758218752. Current Snapshot: MvccSnapshot[applied={T|T < 7316995312854523904}]
I20260810 15:30:08.809178 26679 catalog_manager.cc:1347] Generated new cluster ID: 9a528e6b3f314b1b822f670caf0f2852
I20260810 15:30:08.809237 26679 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 15:30:08.823472 26677 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8008b5ca622d4202a835e00d32233979 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "8008b5ca622d4202a835e00d32233979" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8008b5ca622d4202a835e00d32233979" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 39071 } } peers { permanent_uuid: "c96e2b8678294b28a4fdeb796bd4e663" member_type: VOTER last_known_addr { host: "127.18.68.189" port: 34095 } } peers { permanent_uuid: "ffce2544ba1042f78dfb601b67f968fd" member_type: VOTER last_known_addr { host: "127.18.68.188" port: 41393 } } }
I20260810 15:30:08.823630 26677 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8008b5ca622d4202a835e00d32233979 [sys.catalog]: This master's current role is: LEADER
I20260810 15:30:08.824193 26615 sys_catalog.cc:455] T 00000000000000000000000000000000 P c96e2b8678294b28a4fdeb796bd4e663 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "8008b5ca622d4202a835e00d32233979" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8008b5ca622d4202a835e00d32233979" member_type: VOTER last_known_addr { host: "127.18.68.190" port: 39071 } } peers { permanent_uuid: "c96e2b8678294b28a4fdeb796bd4e663" member_type: VOTER last_known_addr { host: "127.18.68.189" port: 34095 } } peers { permanent_uuid: "ffce2544ba1042f78dfb601b67f968fd" member_type: VOTER last_known_addr { host: "127.18.68.188" port: 41393 } } }
I20260810 15:30:08.824296 26615 sys_catalog.cc:458] T 00000000000000000000000000000000 P c96e2b8678294b28a4fdeb796bd4e663 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 15:30:08.824589 26685 mvcc.cc:205] Tried to move back new op lower bound from 7316995312854523904 to 7316995312758218752. Current Snapshot: MvccSnapshot[applied={T|T < 7316995312854523904}]
I20260810 15:30:08.834209 26679 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 15:30:08.835222 26679 catalog_manager.cc:1504] Loading token signing keys...
I20260810 15:30:08.843297 26679 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8008b5ca622d4202a835e00d32233979: Generated new TSK 0
I20260810 15:30:08.843650 26679 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260810 15:30:08.889822 26334 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 15:30:08.880364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57528 (local address 127.18.68.190:39071)
0810 15:30:08.880420 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0810 15:30:08.880423 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 15:30:08.889006 (+ 8583us) server_negotiation.cc:407] Connection header received
0810 15:30:08.889142 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:30:08.889144 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:30:08.889157 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:30:08.889191 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:30:08.889740 (+ 549us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57528: BlockingRecv error: recv got EOF from 127.0.0.1:57528 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
W20260810 15:30:08.891062 26465 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 15:30:08.886912 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49760 (local address 127.18.68.189:34095)
0810 15:30:08.886970 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0810 15:30:08.886973 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 15:30:08.890465 (+ 3492us) server_negotiation.cc:407] Connection header received
0810 15:30:08.890495 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:30:08.890497 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:30:08.890509 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:30:08.890559 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:30:08.890989 (+ 430us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49760: BlockingRecv error: recv got EOF from 127.0.0.1:49760 (error 108)
Metrics: {"server-negotiator.queue_time_us":25}
W20260810 15:30:08.891811 26583 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 15:30:08.887137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58750 (local address 127.18.68.188:41393)
0810 15:30:08.887180 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0810 15:30:08.887182 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:30:08.890316 (+ 3134us) server_negotiation.cc:407] Connection header received
0810 15:30:08.890352 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:30:08.890353 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:30:08.890366 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:30:08.890428 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:30:08.891749 (+ 1321us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58750: BlockingRecv error: recv got EOF from 127.0.0.1:58750 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260810 15:30:08.894769 26465 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 15:30:08.893854 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49768 (local address 127.18.68.189:34095)
0810 15:30:08.893897 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0810 15:30:08.893899 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:30:08.894158 (+ 259us) server_negotiation.cc:407] Connection header received
0810 15:30:08.894286 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:30:08.894287 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:30:08.894308 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:30:08.894341 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:30:08.894714 (+ 373us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49768: BlockingRecv error: recv got EOF from 127.0.0.1:49768 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260810 15:30:08.918701 26465 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 15:30:08.904229 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49780 (local address 127.18.68.189:34095)
0810 15:30:08.904278 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0810 15:30:08.904280 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:30:08.910349 (+ 6069us) server_negotiation.cc:407] Connection header received
0810 15:30:08.910393 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:30:08.910395 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:30:08.910411 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:30:08.910497 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:30:08.918625 (+ 8128us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49780: BlockingRecv error: recv got EOF from 127.0.0.1:49780 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
W20260810 15:30:08.932812 26465 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 15:30:08.929983 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49792 (local address 127.18.68.189:34095)
0810 15:30:08.930040 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0810 15:30:08.930042 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:30:08.932164 (+ 2122us) server_negotiation.cc:407] Connection header received
0810 15:30:08.932278 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:30:08.932279 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:30:08.932293 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:30:08.932330 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:30:08.932750 (+ 420us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49792: BlockingRecv error: recv got EOF from 127.0.0.1:49792 (error 108)
Metrics: {"server-negotiator.queue_time_us":25}
W20260810 15:30:08.939196 26465 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 15:30:08.938318 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49802 (local address 127.18.68.189:34095)
0810 15:30:08.938383 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0810 15:30:08.938385 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:30:08.938628 (+ 243us) server_negotiation.cc:407] Connection header received
0810 15:30:08.938698 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:30:08.938699 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:30:08.938711 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:30:08.938772 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:30:08.939137 (+ 365us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49802: BlockingRecv error: recv got EOF from 127.0.0.1:49802 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
W20260810 15:30:08.949241 26465 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 15:30:08.948503 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49818 (local address 127.18.68.189:34095)
0810 15:30:08.948554 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0810 15:30:08.948556 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:30:08.948686 (+ 130us) server_negotiation.cc:407] Connection header received
0810 15:30:08.948784 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:30:08.948785 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:30:08.948796 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:30:08.948825 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:30:08.949178 (+ 353us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49818: BlockingRecv error: recv got EOF from 127.0.0.1:49818 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260810 15:30:08.967797 26465 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 15:30:08.966907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49822 (local address 127.18.68.189:34095)
0810 15:30:08.966977 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0810 15:30:08.966979 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:30:08.967132 (+ 153us) server_negotiation.cc:407] Connection header received
0810 15:30:08.967229 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:30:08.967230 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:30:08.967241 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:30:08.967323 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:30:08.967730 (+ 407us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49822: BlockingRecv error: recv got EOF from 127.0.0.1:49822 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
W20260810 15:30:09.002157 26465 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 15:30:09.001303 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49826 (local address 127.18.68.189:34095)
0810 15:30:09.001369 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0810 15:30:09.001371 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:30:09.001467 (+ 96us) server_negotiation.cc:407] Connection header received
0810 15:30:09.001538 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:30:09.001539 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:30:09.001553 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:30:09.001623 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:30:09.002082 (+ 459us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49826: BlockingRecv error: recv got EOF from 127.0.0.1:49826 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
W20260810 15:30:09.068209 26465 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 15:30:09.067396 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49836 (local address 127.18.68.189:34095)
0810 15:30:09.067496 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0810 15:30:09.067498 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:30:09.067546 (+ 48us) server_negotiation.cc:407] Connection header received
0810 15:30:09.067619 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:30:09.067620 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:30:09.067631 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:30:09.067693 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:30:09.068160 (+ 467us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49836: BlockingRecv error: recv got EOF from 127.0.0.1:49836 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
W20260810 15:30:09.198429 26465 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 15:30:09.197703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49842 (local address 127.18.68.189:34095)
0810 15:30:09.197786 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0810 15:30:09.197787 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 15:30:09.197876 (+ 89us) server_negotiation.cc:407] Connection header received
0810 15:30:09.197923 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:30:09.197924 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:30:09.197935 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:30:09.198001 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:30:09.198381 (+ 380us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49842: BlockingRecv error: recv got EOF from 127.0.0.1:49842 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
W20260810 15:30:09.456581 26465 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 15:30:09.455808 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49850 (local address 127.18.68.189:34095)
0810 15:30:09.455886 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0810 15:30:09.455889 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 15:30:09.455904 (+ 15us) server_negotiation.cc:407] Connection header received
0810 15:30:09.456017 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:30:09.456018 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:30:09.456051 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:30:09.456130 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0810 15:30:09.456508 (+ 378us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49850: BlockingRecv error: recv got EOF from 127.0.0.1:49850 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
I20260810 15:30:09.705933 26606 catalog_manager.cc:1259] Loaded cluster ID: 9a528e6b3f314b1b822f670caf0f2852
I20260810 15:30:09.706012 26606 catalog_manager.cc:1552] T 00000000000000000000000000000000 P ffce2544ba1042f78dfb601b67f968fd: loading cluster ID for follower catalog manager: success
I20260810 15:30:09.706895 26606 catalog_manager.cc:1574] T 00000000000000000000000000000000 P ffce2544ba1042f78dfb601b67f968fd: acquiring CA information for follower catalog manager: success
I20260810 15:30:09.707162 26606 catalog_manager.cc:1602] T 00000000000000000000000000000000 P ffce2544ba1042f78dfb601b67f968fd: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260810 15:30:09.732280 26631 catalog_manager.cc:1259] Loaded cluster ID: 9a528e6b3f314b1b822f670caf0f2852
I20260810 15:30:09.732388 26631 catalog_manager.cc:1552] T 00000000000000000000000000000000 P c96e2b8678294b28a4fdeb796bd4e663: loading cluster ID for follower catalog manager: success
I20260810 15:30:09.733217 26631 catalog_manager.cc:1574] T 00000000000000000000000000000000 P c96e2b8678294b28a4fdeb796bd4e663: acquiring CA information for follower catalog manager: success
I20260810 15:30:09.733531 26631 catalog_manager.cc:1602] T 00000000000000000000000000000000 P c96e2b8678294b28a4fdeb796bd4e663: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260810 15:30:09.973096 26787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:30:09.969911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49858 (local address 127.18.68.189:34095)
0810 15:30:09.970076 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0810 15:30:09.970078 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:30:09.970093 (+ 15us) server_negotiation.cc:407] Connection header received
0810 15:30:09.970206 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:30:09.970206 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:30:09.970261 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:30:09.970380 (+ 119us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 15:30:09.970683 (+ 303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:30:09.971312 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:30:09.972282 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:30:09.972488 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:30:09.972544 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:30:09.972761 (+ 217us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 15:30:09.972874 (+ 113us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 15:30:09.972933 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0810 15:30:09.973005 (+ 72us) server_negotiation.cc:299] Negotiation successful
0810 15:30:09.973026 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":122,"thread_start_us":91,"threads_started":1}
I20260810 15:30:09.977763 26793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:30:09.975309 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58762 (local address 127.18.68.188:41393)
0810 15:30:09.975444 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0810 15:30:09.975446 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:30:09.975473 (+ 27us) server_negotiation.cc:407] Connection header received
0810 15:30:09.975511 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:30:09.975511 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:30:09.975552 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:30:09.975623 (+ 71us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 15:30:09.975756 (+ 133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:30:09.976283 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:30:09.977027 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:30:09.977250 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:30:09.977306 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:30:09.977466 (+ 160us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 15:30:09.977573 (+ 107us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 15:30:09.977637 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0810 15:30:09.977675 (+ 38us) server_negotiation.cc:299] Negotiation successful
0810 15:30:09.977695 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":110,"thread_start_us":78,"threads_started":1}
I20260810 15:30:09.982839 26787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:30:09.979768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49866 (local address 127.18.68.189:34095)
0810 15:30:09.979847 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0810 15:30:09.979849 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:30:09.980138 (+ 289us) server_negotiation.cc:407] Connection header received
0810 15:30:09.980195 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:30:09.980196 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:30:09.980215 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:30:09.980271 (+ 56us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 15:30:09.980449 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:30:09.981183 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:30:09.982001 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:30:09.982265 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:30:09.982350 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:30:09.982535 (+ 185us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 15:30:09.982575 (+ 40us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 15:30:09.982635 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0810 15:30:09.982707 (+ 72us) server_negotiation.cc:299] Negotiation successful
0810 15:30:09.982734 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260810 15:30:09.983335 26793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:30:09.979797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58768 (local address 127.18.68.188:41393)
0810 15:30:09.979926 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0810 15:30:09.979928 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:30:09.980263 (+ 335us) server_negotiation.cc:407] Connection header received
0810 15:30:09.980291 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:30:09.980292 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:30:09.980307 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:30:09.980360 (+ 53us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 15:30:09.980588 (+ 228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:30:09.981291 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:30:09.982393 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:30:09.982728 (+ 335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:30:09.982794 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:30:09.983013 (+ 219us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 15:30:09.983045 (+ 32us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 15:30:09.983103 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0810 15:30:09.983240 (+ 137us) server_negotiation.cc:299] Negotiation successful
0810 15:30:09.983266 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104}
I20260810 15:30:09.983379 26802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 15:30:09.979791 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57544 (local address 127.18.68.190:39071)
0810 15:30:09.979952 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0810 15:30:09.979954 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 15:30:09.980093 (+ 139us) server_negotiation.cc:407] Connection header received
0810 15:30:09.980186 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 15:30:09.980187 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 15:30:09.980241 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 15:30:09.980319 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 15:30:09.980504 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:30:09.981073 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:30:09.982324 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 15:30:09.982639 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 15:30:09.982704 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 15:30:09.983004 (+ 300us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 15:30:09.983135 (+ 131us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 15:30:09.983193 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0810 15:30:09.983242 (+ 49us) server_negotiation.cc:299] Negotiation successful
0810 15:30:09.983268 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":81,"threads_started":1}
I20260810 15:30:09.985301 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 26201
I20260810 15:30:10.004673 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 26338
I20260810 15:30:10.019829 18706 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskspH5IZ/build/release/bin/kudu with pid 26469
2026-08-10T15:30:10Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (3331 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (6549 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (289908 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST